-- Logs begin at Mon 2022-02-28 17:57:02 UTC, end at Mon 2022-02-28 19:28:33 UTC. -- Feb 28 18:34:05.068892 dv-cinder-831187-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 28 18:34:05.078178 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 28 18:34:05 2022] *** Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: nodename: dv-cinder-831187-1-iscsi Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: machine: x86_64 Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: clock source: unix Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: pcre jit disabled Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: detected number of CPU cores: 4 Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: current working directory: / Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: detected binary path: /usr/bin/uwsgi-core Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: your processes number limit is 47680 Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: your memory page size is 4096 bytes Feb 28 18:34:05.080417 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: detected max file descriptor number: 2048 Feb 28 18:34:05.081149 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: lock engine: pthread robust mutexes Feb 28 18:34:05.081149 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: thunder lock: enabled Feb 28 18:34:05.081149 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 28 18:34:05.081149 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 28 18:34:05.126776 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: Python main interpreter initialized at 0x55dc8b6ae9c0 Feb 28 18:34:05.126776 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: python threads support enabled Feb 28 18:34:05.126776 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: your server socket listen backlog is limited to 100 connections Feb 28 18:34:05.126776 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: your mercy for graceful operations on workers is 90 seconds Feb 28 18:34:05.127213 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: mapped 403077 bytes (393 KB) for 2 cores Feb 28 18:34:05.127213 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: *** Operational MODE: preforking *** Feb 28 18:34:05.127525 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: *** uWSGI is running in multiple interpreter mode *** Feb 28 18:34:05.127525 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: spawned uWSGI master process (pid: 67121) Feb 28 18:34:05.127746 dv-cinder-831187-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 28 18:34:05.128836 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: spawned uWSGI worker 1 (pid: 67131, cores: 1) Feb 28 18:34:05.128836 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: spawned uWSGI worker 2 (pid: 67132, cores: 1) Feb 28 18:34:05.128836 dv-cinder-831187-1-iscsi devstack@keystone.service[67121]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 28 18:34:10.222708 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 18:34:10.222708 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: from cryptography.utils import int_from_bytes Feb 28 18:34:10.223879 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 18:34:10.223879 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: from cryptography.utils import int_from_bytes Feb 28 18:34:10.224004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 18:34:10.224004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: from cryptography.utils import int_from_bytes Feb 28 18:34:10.224004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 18:34:10.224004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: from cryptography.utils import int_from_bytes Feb 28 18:34:10.274750 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 18:34:10.275013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 18:34:10.275161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] command line args: [] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 18:34:10.275404 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 18:34:10.275532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 18:34:10.275661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ================================================================================ {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 18:34:10.275796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 18:34:10.275796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] command line args: [] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 18:34:10.276040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] admin_token = **** {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.276165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 18:34:10.276275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] config_dir = [] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.276390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ================================================================================ {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 18:34:10.276520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.276520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] config_source = [] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.276745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] admin_token = **** {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.277094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] debug = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.277263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] config_dir = [] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.277455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.279517 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.279517 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] config_source = [] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.279823 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.279971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] debug = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.280254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] insecure_debug = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.280409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.280409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.280704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.280850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] insecure_debug = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.280850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.281138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.281282 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.281417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] list_limit = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.281559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] list_limit = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.281702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] log_config_append = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.281854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] log_config_append = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.281988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.282130 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.282270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] log_dir = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.282420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] log_dir = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.282561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] log_file = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.282708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] log_file = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.282849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.282989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.283153 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.283305 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.283476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.283654 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.283799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.283941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.283941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.284208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.284358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.284503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.284651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.284795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.284941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.285078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.285223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.285368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.285506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.285506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.285763 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.285898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.286042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.286176 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.286312 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.286477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] notification_format = cadf {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.286655 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.286655 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] notification_format = cadf {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.286977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.287159 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.287332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.287332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] publish_errors = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.287638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.287788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.287943 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] publish_errors = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.288093 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.288251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.288402 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.288563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.288563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.288925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.289129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.289312 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.289489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.289660 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] standard_threads = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.289837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] standard_threads = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.290024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] strict_password_check = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.290252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] strict_password_check = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.290527 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.290527 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] use_eventlog = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.290895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.291082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] use_journal = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.291320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] use_eventlog = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.291494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] use_json = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.291672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] use_journal = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.291849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] use_stderr = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.292022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] use_json = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.292205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] use_syslog = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.292339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] use_stderr = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.292339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] use_syslog = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.292566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] watch_log_file = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.292689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] watch_log_file = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:34:10.292800 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.292925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.293080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.293201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.293397 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.293509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.293630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.293753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.293864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.293995 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.294116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.294236 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.294346 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.294459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.294571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.294697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.294808 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.294922 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.295044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.295174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.295336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.295463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.295573 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.295688 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.295810 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.295931 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.296042 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.296042 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.296273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.296273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.296495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.296607 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.296730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.296852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.297016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.297126 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.297257 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.297368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.297481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.297605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.297726 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.297837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.297960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.298094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.298205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.298338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.298458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.298584 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.298695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.298857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.298968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.299094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.299313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.299313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.299569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.299682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.299682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.299914 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.299914 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.300131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.300307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.300434 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.300543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.300657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.300781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.300892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.301007 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.301121 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.301233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.301345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.301345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.301567 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.301679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.301679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.301895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.302007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.302007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.302279 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.302403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.302403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.302611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.302723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.302723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.302954 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.303064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.303064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.303342 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.303454 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.303454 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.303685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.303798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.303798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.304010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.304123 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.304123 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.304343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.304466 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.304466 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.304745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.304876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.305051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.305164 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.305279 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.305392 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.305505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.305631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.305750 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.305861 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.305975 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.306087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.306202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.306325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.306452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.306563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.306694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.306813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.306933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.307044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.307234 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.307346 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.307471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.307582 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.307695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.307810 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.307935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.308046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.308046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.enabled = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.308265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.308265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.308542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.309169 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.309282 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.309397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.309511 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.309624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.309749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.309749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.309972 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.309972 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.310363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.310477 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.310598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.310598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.310820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.310934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.311048 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.311178 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.311178 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.311416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.311539 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.311539 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.311752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.311866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.312045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.enabled = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.312219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.312219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.312429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.312553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.312553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.312771 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.312901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.312901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.313117 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.313234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.313352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.313470 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.313470 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.313783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.313910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.314029 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.314148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.314266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.314406 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.314527 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.314645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.314645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.314880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.314996 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] auth.external = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.314996 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] auth.mapped = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.315308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.315423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.315537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.315658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.315658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] auth.password = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.315884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.315998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] auth.token = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.315998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.316209 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.316332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] catalog.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.316455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.316566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.316566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.316778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.316889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.317003 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.317130 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.317130 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.317351 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.317463 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] credential.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.317586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.317696 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] credential.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.317696 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.317921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.318033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.318033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.318245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.318356 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.318481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.318592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.318592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.318809 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.318920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.319034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.319225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.319225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.319463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.319577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.319698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.319826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.319946 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.320077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.320077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.320311 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.320437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.320437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] federation.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.320654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.320772 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.320906 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] auth.external = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.321025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] federation.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.321025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.321253 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] auth.mapped = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.321373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.321373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.321613 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.321730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.321854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.321981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.321981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.322226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] auth.password = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.322356 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.322356 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.322579 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] auth.token = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.322694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.322815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.322943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.322943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.323192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] catalog.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.323322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.323439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.323558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.323558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.323807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.323919 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.324095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.324208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.324208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.324963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.325093 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.325093 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.325394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.325584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.325584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.325821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] credential.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.325961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.326080 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] credential.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.326203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.326203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.326420 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.326540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.326675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.326794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.326794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.327030 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.327171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.327313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.327426 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.327426 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.327659 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.327777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.327895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.328024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.328149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.328266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.328266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.328496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.328610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.328610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.328847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.328958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.328958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.329185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.329310 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.329439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.329555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.329555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.329775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.329895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.330013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.330218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.330218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.330434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.330559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.330559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.password = **** {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.330777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] federation.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.330910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.331037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.331278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.331278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.331497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] federation.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.331609 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.331609 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.331846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.331969 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.332091 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.332213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.332213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.332443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.332560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.332560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.332791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.332912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.333034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.333169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.333169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.333382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.333503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.333503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.333717 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.333849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.333968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.334090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.334090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.334313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.334432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.334432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.334675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.334796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.334908 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.335028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.335028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.335277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.335388 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.335507 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.335625 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.335625 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.335832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.335960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.335960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.336177 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.336292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.336412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.336528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.336660 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.336772 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.336890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.337055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.337170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.337288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.337459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.337577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.337746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.337861 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.337988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.338181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.338308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.338424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.338541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.338658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.338931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.339068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.339241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] policy.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.339357 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.339469 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.339651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.339766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.339913 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.340207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.340366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] receipt.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.340606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.340723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.340878 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.341035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.341151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.341351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.341466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.341588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.341781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.341910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] resource.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.342060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.342177 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.342298 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] resource.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.342505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.342621 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.342754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.342874 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.342996 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.343286 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.343405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] revoke.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.343624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.343758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.343873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.344084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.344200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] role.cache_time = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.344317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] role.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.344489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.344615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] role.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.344763 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] role.list_limit = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.344876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.344996 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.345235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.345349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.345471 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.345630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.345748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.345945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.346058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.346179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.346780 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.346913 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.346913 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.347165 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.347294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.347294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.347530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.347645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.347770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.347898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.347898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.348114 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.password = **** {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.348248 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.348627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.348746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.348869 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.348990 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.349188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.349314 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.349446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.349604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.349721 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.349896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.350013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.350148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.350359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.350475 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.350598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.350751 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.350867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.351052 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.351187 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.351315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.351522 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.351654 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.351786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.351907 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.352054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.352294 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.352411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.352532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.352665 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.352783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] token.cache_time = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.352973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] token.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.353088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.353209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.353385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.353513 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] token.provider = fernet {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.353668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.353782 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.353919 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.354146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.354261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.354395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.354558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.354675 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.354844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.354959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.355081 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] trust.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.355330 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.355445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.355597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.355762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.355879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.356073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.356200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.356321 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.356529 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.356686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.356901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.356990 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.357291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.357379 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.357655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.connection = **** {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.357744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.358002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.358087 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.358348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.358437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.358697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.358786 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.359031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.359145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.359421 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.359570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.359765 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.359927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.360125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.360385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.360589 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.360733 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.360888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.361070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.361304 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.361436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.361686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.361832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.362069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.362199 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.362463 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.362595 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.362870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.363021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.363296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.363409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.363652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.363827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.364011 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.364208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] policy.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.364342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.364470 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.364594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=67131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 18:34:10.364819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.365198 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.365575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] receipt.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.365960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.366363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.366746 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.367135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.368255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.368255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] resource.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.368525 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.368690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] resource.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.369066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.369463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.369855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.370226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] revoke.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.370617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.370994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.371925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] role.cache_time = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.372310 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] role.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.372699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] role.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.373068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] role.list_limit = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.373471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.373865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.374252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.374657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.375067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.375503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.375904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.376296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.376667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.377059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.377452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.377843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.378233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.378894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.379295 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.379696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.380089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.380480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.380875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.381241 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.381643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.382042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.382424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.382795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.383202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.383571 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.383962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.384415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.384857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.385284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.385671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.386046 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] token.cache_time = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.386424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] token.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.386959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.387936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] token.provider = fernet {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.388339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.388758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.389158 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.389543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.389933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.390321 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.390709 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] trust.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.391088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.391499 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.391875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.392262 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.392658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.393027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.393434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.393852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.394264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.connection = **** {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.394649 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.395052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.395487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.395724 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.395860 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.395980 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.396168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.396331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.396648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.397042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.397436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.397832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.398230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.398643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.399029 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.399463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.399837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.400230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.400591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.400978 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.401358 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:34:10.401630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=67132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 18:34:10.409010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.439584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.439787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.442909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.443280 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.443621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.461291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.496080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.496383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.496776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.551647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.630723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.630934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.670774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.670994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.701958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.702186 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.702385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.702625 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.703050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.703294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.714583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.714815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.715615 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.715840 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.716058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.716273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.728724 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.728939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.729160 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.729379 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.729597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.729737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.729851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.729978 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.730118 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.730246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.730364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.731289 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.731694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.732233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.742449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.744871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.755939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.756103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.756278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.756436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.756570 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.756702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.756833 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.756967 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.757113 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.757248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.757385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=67131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.757516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.757516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.757711 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=67132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:34:10.775714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.775960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 18:34:10.776247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.776445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 18:34:10.776717 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.776974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.777227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.778028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.782691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.783073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 18:34:10.783638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.783850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 18:34:10.784303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.784627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.784784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.785032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.789407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.789691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.789957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/<string:protocol_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.792177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/websso' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.795683 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.795980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.796284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/<string:protocol_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.796567 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/websso' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.800568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/<string:credential_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.803812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/<string:domain_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.804079 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.804353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.804628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>/<string:option>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.804906 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.805160 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/default' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.805421 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/<string:option>/default' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.805687 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.805949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.806215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.806575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.806843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/<string:credential_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.810131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/<string:domain_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.810406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.810687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.810995 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>/<string:option>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.811305 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.811664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/default' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.811838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/<string:option>/default' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.812109 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.812379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.812651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.812950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.834207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.835820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/<string:endpoint_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.836093 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints/<string:endpoint_id>/OS-ENDPOINT-POLICY/policy' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.839690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.842013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/<string:group_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.842128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/<string:endpoint_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.842283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.842420 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints/<string:endpoint_id>/OS-ENDPOINT-POLICY/policy' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.842562 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users/<string:user_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.847651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/<string:group_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.847930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.848211 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users/<string:user_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.849921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/<string:limit_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.850209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.854588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/<string:endpoint_group_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.854867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints/<string:endpoint_id>/projects' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.855167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints/<string:endpoint_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.855453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.855684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/<string:limit_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.856038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.856311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoint_groups' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.856311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/endpoints' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.856577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.856845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects/<string:project_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.860430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/<string:endpoint_group_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.860718 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints/<string:endpoint_id>/projects' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.861003 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints/<string:endpoint_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.861287 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.861560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoint_groups' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.861832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/endpoints' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.862094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.862480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects/<string:project_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.875564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.875847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/auth' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.880353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/<string:idp_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.880633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.880920 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/auth' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.883854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.884148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.885454 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/<string:idp_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.889821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.890113 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.890587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/<string:mapping_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.894243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/<string:sp_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.895090 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/<string:mapping_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.897873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.898171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/inherited_to_projects' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.898450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.898605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/<string:sp_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.898750 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/inherited_to_projects' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.899015 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.899308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.902175 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.903028 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/inherited_to_projects' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.903369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.903864 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/inherited_to_projects' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.904257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.904551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.919063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/<string:consumer_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.919439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.919708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.919964 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/<string:request_token_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.924097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/<string:consumer_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.924393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.924661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.924936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/<string:request_token_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.927725 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.929373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.929649 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.932586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/<string:policy_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.932737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.932867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.933120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints/<string:endpoint_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.933404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.933763 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>/regions/<string:region_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.934363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.934645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.937630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/<string:policy_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.937909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.938190 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints/<string:endpoint_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.938467 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.938739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>/regions/<string:region_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.947496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/<string:project_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.947781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.948058 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags/<string:value>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.948398 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.948674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.948944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.949217 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.952542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/<string:project_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.952832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.953113 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags/<string:value>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.953396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.953675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.953958 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.954239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.968929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/<string:region_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.972120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/<string:registered_limit_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.973001 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/<string:region_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.975576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.976719 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/<string:registered_limit_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.977211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.978799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/<string:role_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.979070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.979377 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies/<string:implied_role_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.979950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.981556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.983231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/<string:role_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.983513 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.983789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies/<string:implied_role_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.989449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.991049 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/<string:service_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.992500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.994078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/<string:service_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:10.994573 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.994860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.995163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.995442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.997246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.997539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.997831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:10.998100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.004643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/<string:trust_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:11.004942 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.005216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles/<string:role_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.007212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/<string:trust_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:11.007461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.007747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles/<string:role_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.013515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/<string:user_id>] {{(pid=67131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:11.013801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/password' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.014077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/groups' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.014351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/projects' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.014616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.014889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2/<string:credential_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.015171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.015441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.015702 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.015956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/<string:user_id>] {{(pid=67132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:34:11.016046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles/<string:role_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.016232 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.016321 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/password' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.016486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials/<string:application_credential_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.016575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/groups' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.016777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/projects' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.016866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.017045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.017287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules/<string:access_rule_id>' {}] {{(pid=67131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.017429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2/<string:credential_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.017558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.017819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.018092 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.018365 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles/<string:role_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.018638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.018895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials/<string:application_credential_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.019216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.019597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules/<string:access_rule_id>' {}] {{(pid=67132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:34:11.056667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dc8b6ae9c0 pid: 67131 (default app) Feb 28 18:34:11.058285 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dc8b6ae9c0 pid: 67132 (default app) Feb 28 18:34:11.060752 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada73a-e87e-4b23-b791-cefd2caa9c7e None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:11.061065 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada73a-e87e-4b23-b791-cefd2caa9c7e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:11.061349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada73a-e87e-4b23-b791-cefd2caa9c7e None None] PATH_INFO: `/v3` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:11.065473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 791 bytes} [Mon Feb 28 18:34:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:19.793413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee357500-08a4-4e49-b8fd-76b33e89e8d2 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:19.793992 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee357500-08a4-4e49-b8fd-76b33e89e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:19.793992 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee357500-08a4-4e49-b8fd-76b33e89e8d2 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:19.798960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1/2] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:19.804853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbae1a3-14e7-4b4b-83c9-6cba390351f9 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:19.809111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbae1a3-14e7-4b4b-83c9-6cba390351f9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:19.809111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbae1a3-14e7-4b4b-83c9-6cba390351f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:19.845006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG oslo_db.sqlalchemy.engines [None req-1dbae1a3-14e7-4b4b-83c9-6cba390351f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=67131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:34:19.996721 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG passlib.handlers.bcrypt [None req-1dbae1a3-14e7-4b4b-83c9-6cba390351f9 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=67131) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 28 18:34:19.997138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG passlib.handlers.bcrypt [None req-1dbae1a3-14e7-4b4b-83c9-6cba390351f9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=67131) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 28 18:34:20.058837 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-1dbae1a3-14e7-4b4b-83c9-6cba390351f9 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:20.060571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1dbae1a3-14e7-4b4b-83c9-6cba390351f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:20.203238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 2/3] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:19 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:34:20.364464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee357500-08a4-4e49-b8fd-76b33e89e8d2 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:20.407953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG oslo_db.sqlalchemy.engines [None req-ee357500-08a4-4e49-b8fd-76b33e89e8d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=67132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:34:20.504591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee357500-08a4-4e49-b8fd-76b33e89e8d2 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:20.508794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7309-12e5-47d9-bb5e-219b911c4763 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6Tk-GuHRToiYikDitKORGw, audit_chain_id=['6Tk-GuHRToiYikDitKORGw']) at 0x7fe09e78ef10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:20.509399 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7309-12e5-47d9-bb5e-219b911c4763 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:20.509704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7309-12e5-47d9-bb5e-219b911c4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:20.510014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7309-12e5-47d9-bb5e-219b911c4763 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:20.519102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7309-12e5-47d9-bb5e-219b911c4763 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:20.571863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c5dd7309-12e5-47d9-bb5e-219b911c4763 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 18:34:20.572199 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7309-12e5-47d9-bb5e-219b911c4763 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:20.582786 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 2/4] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:20 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:20.588929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbae1a3-14e7-4b4b-83c9-6cba390351f9 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:20.600998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbae1a3-14e7-4b4b-83c9-6cba390351f9 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:20.605226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada37e5f-fa84-4887-a37c-9d3b5f51ab51 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6Tk-GuHRToiYikDitKORGw, audit_chain_id=['6Tk-GuHRToiYikDitKORGw']) at 0x7fe09e795d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:20.606287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada37e5f-fa84-4887-a37c-9d3b5f51ab51 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:20.606581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada37e5f-fa84-4887-a37c-9d3b5f51ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:20.606870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada37e5f-fa84-4887-a37c-9d3b5f51ab51 admin admin] PATH_INFO: `/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:20.608423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada37e5f-fa84-4887-a37c-9d3b5f51ab51 admin admin] RBAC: Authorizing `identity:get_project(project_id=17d9ce9af82b4fd68fac993b9e9f37e5)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:20.659880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ada37e5f-fa84-4887-a37c-9d3b5f51ab51 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 18:34:20.660224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada37e5f-fa84-4887-a37c-9d3b5f51ab51 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:20.665162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 3/5] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:20 2022] GET /identity/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:22.796903 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac0b9c-62ef-40ad-bebd-8d9d3e8c16af None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:22.797472 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac0b9c-62ef-40ad-bebd-8d9d3e8c16af None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:22.797472 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac0b9c-62ef-40ad-bebd-8d9d3e8c16af None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:22.801961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 3/6] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:34:22.807700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301f07b-1107-4315-a5fa-ac1d0bf5c7e0 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:22.808089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301f07b-1107-4315-a5fa-ac1d0bf5c7e0 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:22.808477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301f07b-1107-4315-a5fa-ac1d0bf5c7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:22.833432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f301f07b-1107-4315-a5fa-ac1d0bf5c7e0 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:22.834961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f301f07b-1107-4315-a5fa-ac1d0bf5c7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:22.843495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 4/7] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:22 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:22.866172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac0b9c-62ef-40ad-bebd-8d9d3e8c16af None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:22.878286 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac0b9c-62ef-40ad-bebd-8d9d3e8c16af None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:22.882223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881ec88-4c01-4eb2-93d8-3b912b0faac1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=D0v-zekkTpmJTSk5tOUXvw, audit_chain_id=['D0v-zekkTpmJTSk5tOUXvw']) at 0x7fe09e4ef1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:22.882804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881ec88-4c01-4eb2-93d8-3b912b0faac1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:22.883097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881ec88-4c01-4eb2-93d8-3b912b0faac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:22.883410 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881ec88-4c01-4eb2-93d8-3b912b0faac1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:22.891806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881ec88-4c01-4eb2-93d8-3b912b0faac1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:22.893595 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881ec88-4c01-4eb2-93d8-3b912b0faac1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:22.902873 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 4/8] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:22 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:22.908696 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301f07b-1107-4315-a5fa-ac1d0bf5c7e0 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:22.917713 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301f07b-1107-4315-a5fa-ac1d0bf5c7e0 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:22.922481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc8af-6ddd-4c50-b633-5145bc873ed0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=D0v-zekkTpmJTSk5tOUXvw, audit_chain_id=['D0v-zekkTpmJTSk5tOUXvw']) at 0x7fe09e7ba310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:22.923322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc8af-6ddd-4c50-b633-5145bc873ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:22.923624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc8af-6ddd-4c50-b633-5145bc873ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:22.923911 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc8af-6ddd-4c50-b633-5145bc873ed0 admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:22.925262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc8af-6ddd-4c50-b633-5145bc873ed0 admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:22.927147 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc8af-6ddd-4c50-b633-5145bc873ed0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:22.928624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 5/9] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:22 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:25.160438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13d799-b040-42ea-8542-7bb7758fd6d0 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:25.161020 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13d799-b040-42ea-8542-7bb7758fd6d0 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:25.161020 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13d799-b040-42ea-8542-7bb7758fd6d0 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:25.162701 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 5/10] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:25.168448 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90674-4d07-431b-8aa1-fb904ae2c46f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:25.168859 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90674-4d07-431b-8aa1-fb904ae2c46f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:25.169138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90674-4d07-431b-8aa1-fb904ae2c46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:25.191090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-3da90674-4d07-431b-8aa1-fb904ae2c46f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:25.192279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3da90674-4d07-431b-8aa1-fb904ae2c46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:25.199655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 6/11] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:25.223204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13d799-b040-42ea-8542-7bb7758fd6d0 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:25.235324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13d799-b040-42ea-8542-7bb7758fd6d0 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:25.239206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df957ea-6a21-437d-b63e-3b987a89cf5a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YPjThKtZRTqBGK7H3ANByg, audit_chain_id=['YPjThKtZRTqBGK7H3ANByg']) at 0x7fe09e78ecd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:25.239992 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df957ea-6a21-437d-b63e-3b987a89cf5a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:25.240281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df957ea-6a21-437d-b63e-3b987a89cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:25.240562 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df957ea-6a21-437d-b63e-3b987a89cf5a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:25.253830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df957ea-6a21-437d-b63e-3b987a89cf5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:34:25.260146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-5df957ea-6a21-437d-b63e-3b987a89cf5a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:34:25.261448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 6/12] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:25.267363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da90674-4d07-431b-8aa1-fb904ae2c46f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:25.275974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da90674-4d07-431b-8aa1-fb904ae2c46f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:25.281226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58066fc0-1d8f-4653-ae27-54c1acc42141 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YPjThKtZRTqBGK7H3ANByg, audit_chain_id=['YPjThKtZRTqBGK7H3ANByg']) at 0x7fe09e346910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:25.281814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58066fc0-1d8f-4653-ae27-54c1acc42141 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:25.282103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58066fc0-1d8f-4653-ae27-54c1acc42141 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:25.282385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58066fc0-1d8f-4653-ae27-54c1acc42141 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:25.283103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58066fc0-1d8f-4653-ae27-54c1acc42141 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:34:25.283430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58066fc0-1d8f-4653-ae27-54c1acc42141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:25.285130 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-58066fc0-1d8f-4653-ae27-54c1acc42141 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:25.285130 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:34:25.285130 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:34:25.286029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58066fc0-1d8f-4653-ae27-54c1acc42141 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:25.297659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 7/13] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:25.303247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df957ea-6a21-437d-b63e-3b987a89cf5a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:25.312744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df957ea-6a21-437d-b63e-3b987a89cf5a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:25.317583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481ddf9-a247-42ef-92b6-8fb28ef705f2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YPjThKtZRTqBGK7H3ANByg, audit_chain_id=['YPjThKtZRTqBGK7H3ANByg']) at 0x7fe09e499070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:25.318363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481ddf9-a247-42ef-92b6-8fb28ef705f2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:25.318653 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481ddf9-a247-42ef-92b6-8fb28ef705f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:25.318935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481ddf9-a247-42ef-92b6-8fb28ef705f2 admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:25.320536 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481ddf9-a247-42ef-92b6-8fb28ef705f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:25.322658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481ddf9-a247-42ef-92b6-8fb28ef705f2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:25.324277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 7/14] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:25 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:25.329598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58066fc0-1d8f-4653-ae27-54c1acc42141 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:25.339146 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58066fc0-1d8f-4653-ae27-54c1acc42141 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:25.349952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f7bf9-1d8d-4e4a-b099-89e5ce5f0a20 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YPjThKtZRTqBGK7H3ANByg, audit_chain_id=['YPjThKtZRTqBGK7H3ANByg']) at 0x7fe09e411b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:25.350683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f7bf9-1d8d-4e4a-b099-89e5ce5f0a20 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:25.350972 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f7bf9-1d8d-4e4a-b099-89e5ce5f0a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:25.351318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f7bf9-1d8d-4e4a-b099-89e5ce5f0a20 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:25.352450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f7bf9-1d8d-4e4a-b099-89e5ce5f0a20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:25.354161 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f7bf9-1d8d-4e4a-b099-89e5ce5f0a20 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:25.356447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 8/15] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:34:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:25.362139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481ddf9-a247-42ef-92b6-8fb28ef705f2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:25.371579 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481ddf9-a247-42ef-92b6-8fb28ef705f2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:25.376822 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251aaba-fe45-469e-afd4-ada359afcec2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YPjThKtZRTqBGK7H3ANByg, audit_chain_id=['YPjThKtZRTqBGK7H3ANByg']) at 0x7fe09e480d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:25.377403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251aaba-fe45-469e-afd4-ada359afcec2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:25.377692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251aaba-fe45-469e-afd4-ada359afcec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:25.377969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251aaba-fe45-469e-afd4-ada359afcec2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:25.378934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251aaba-fe45-469e-afd4-ada359afcec2 admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.domain.id=default, user.id=6ab015dd8bfa4c7bab33bb2ae75070c3) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:34:25.379355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251aaba-fe45-469e-afd4-ada359afcec2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:25.381105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-c251aaba-fe45-469e-afd4-ada359afcec2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:25.381105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:34:25.381105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:34:25.382266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251aaba-fe45-469e-afd4-ada359afcec2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:25.389296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 8/16] 10.222.0.21 () {56 vars in 1343 bytes} [Mon Feb 28 18:34:25 2022] GET /identity/v3/role_assignments?user.id=6ab015dd8bfa4c7bab33bb2ae75070c3&scope.domain.id=default&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 233 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:27.484141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcbec5-d447-41c1-bc94-edf705cfe68c None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:27.484723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcbec5-d447-41c1-bc94-edf705cfe68c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:27.484723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcbec5-d447-41c1-bc94-edf705cfe68c None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:27.486744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 9/17] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:27.491884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee85ca-1329-41a9-a292-dd265f52880f None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:27.492274 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee85ca-1329-41a9-a292-dd265f52880f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:27.492456 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee85ca-1329-41a9-a292-dd265f52880f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:27.524737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG passlib.handlers.bcrypt [None req-faee85ca-1329-41a9-a292-dd265f52880f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=67132) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 28 18:34:27.525168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG passlib.handlers.bcrypt [None req-faee85ca-1329-41a9-a292-dd265f52880f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=67132) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 28 18:34:27.572170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-faee85ca-1329-41a9-a292-dd265f52880f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:27.574368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-faee85ca-1329-41a9-a292-dd265f52880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:27.610816 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 9/18] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:27.635451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcbec5-d447-41c1-bc94-edf705cfe68c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:27.648100 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcbec5-d447-41c1-bc94-edf705cfe68c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:27.652445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369891d7-b533-4cb6-8d83-d673d9d49bd7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N3eIVy_IQDqbd3Z882ovvg, audit_chain_id=['N3eIVy_IQDqbd3Z882ovvg']) at 0x7fe09e346430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:27.653164 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369891d7-b533-4cb6-8d83-d673d9d49bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:27.653456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369891d7-b533-4cb6-8d83-d673d9d49bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:27.653743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369891d7-b533-4cb6-8d83-d673d9d49bd7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:27.665682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369891d7-b533-4cb6-8d83-d673d9d49bd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:34:27.672109 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-369891d7-b533-4cb6-8d83-d673d9d49bd7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:34:27.673293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 10/19] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:34:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:27.679347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee85ca-1329-41a9-a292-dd265f52880f None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:27.688689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee85ca-1329-41a9-a292-dd265f52880f None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:27.692788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a359085-55ce-4036-ae32-fd803cd037df admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N3eIVy_IQDqbd3Z882ovvg, audit_chain_id=['N3eIVy_IQDqbd3Z882ovvg']) at 0x7fe09e480b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:27.693683 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a359085-55ce-4036-ae32-fd803cd037df admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:27.693979 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a359085-55ce-4036-ae32-fd803cd037df admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:27.694293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a359085-55ce-4036-ae32-fd803cd037df admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:27.695172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a359085-55ce-4036-ae32-fd803cd037df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:34:27.695476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a359085-55ce-4036-ae32-fd803cd037df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:27.696518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-1a359085-55ce-4036-ae32-fd803cd037df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:27.696518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:34:27.696518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:34:27.697424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a359085-55ce-4036-ae32-fd803cd037df admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:27.707593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 10/20] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:27.713199 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369891d7-b533-4cb6-8d83-d673d9d49bd7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:27.723831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369891d7-b533-4cb6-8d83-d673d9d49bd7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:27.728024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3a792-791c-447a-82e4-92377655e95b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N3eIVy_IQDqbd3Z882ovvg, audit_chain_id=['N3eIVy_IQDqbd3Z882ovvg']) at 0x7fe09e315370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:27.728869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3a792-791c-447a-82e4-92377655e95b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:27.729164 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3a792-791c-447a-82e4-92377655e95b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:27.729450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3a792-791c-447a-82e4-92377655e95b admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:27.730637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3a792-791c-447a-82e4-92377655e95b admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:27.732501 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3a792-791c-447a-82e4-92377655e95b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:27.733979 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 11/21] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:27 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:27.739301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a359085-55ce-4036-ae32-fd803cd037df admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:27.749121 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a359085-55ce-4036-ae32-fd803cd037df admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:27.753129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c8bdb-8087-4828-898a-e0de5c23474d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N3eIVy_IQDqbd3Z882ovvg, audit_chain_id=['N3eIVy_IQDqbd3Z882ovvg']) at 0x7fe09e480460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:27.753837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c8bdb-8087-4828-898a-e0de5c23474d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:27.754212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c8bdb-8087-4828-898a-e0de5c23474d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:27.754498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c8bdb-8087-4828-898a-e0de5c23474d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:27.755883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c8bdb-8087-4828-898a-e0de5c23474d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:27.757601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c8bdb-8087-4828-898a-e0de5c23474d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:27.759013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 11/22] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:34:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:27.765029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3a792-791c-447a-82e4-92377655e95b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:27.774429 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3a792-791c-447a-82e4-92377655e95b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:27.778535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf9fd6-f49e-4870-81f2-3c096af461aa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N3eIVy_IQDqbd3Z882ovvg, audit_chain_id=['N3eIVy_IQDqbd3Z882ovvg']) at 0x7fe09e363d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:27.779365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9fd6-f49e-4870-81f2-3c096af461aa admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:27.779659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9fd6-f49e-4870-81f2-3c096af461aa admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:27.779949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9fd6-f49e-4870-81f2-3c096af461aa admin admin] PATH_INFO: `/v3/domains/default/users/6ab015dd8bfa4c7bab33bb2ae75070c3/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:27.781776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf9fd6-f49e-4870-81f2-3c096af461aa admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6ab015dd8bfa4c7bab33bb2ae75070c3, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:27.782781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-cfaf9fd6-f49e-4870-81f2-3c096af461aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:27.782781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:34:27.782781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:34:27.784771 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf9fd6-f49e-4870-81f2-3c096af461aa admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:28.062701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 12/23] 10.222.0.21 () {58 vars in 1382 bytes} [Mon Feb 28 18:34:27 2022] PUT /identity/v3/domains/default/users/6ab015dd8bfa4c7bab33bb2ae75070c3/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:34:30.156866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f771b43-9d14-41bb-9bfa-ff4d0048d4fe None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:30.157416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f771b43-9d14-41bb-9bfa-ff4d0048d4fe None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:30.157416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f771b43-9d14-41bb-9bfa-ff4d0048d4fe None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:30.159083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 12/24] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:34:30.165218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67366def-7ef9-4e89-91af-509051649a02 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:30.165652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67366def-7ef9-4e89-91af-509051649a02 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:30.165801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67366def-7ef9-4e89-91af-509051649a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:30.191043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-67366def-7ef9-4e89-91af-509051649a02 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:30.192579 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-67366def-7ef9-4e89-91af-509051649a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:30.258743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 13/25] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:30 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:30.281496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f771b43-9d14-41bb-9bfa-ff4d0048d4fe None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:30.294185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f771b43-9d14-41bb-9bfa-ff4d0048d4fe None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:30.298251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a67c4-1f7a-4f22-8522-d8ba4b93f5a5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G5ZQr0ZgTm-pm0uC0WShwQ, audit_chain_id=['G5ZQr0ZgTm-pm0uC0WShwQ']) at 0x7fe09e4809d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:30.298967 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a67c4-1f7a-4f22-8522-d8ba4b93f5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:30.299289 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a67c4-1f7a-4f22-8522-d8ba4b93f5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:30.299578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a67c4-1f7a-4f22-8522-d8ba4b93f5a5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:30.313401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a67c4-1f7a-4f22-8522-d8ba4b93f5a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:34:30.319773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-074a67c4-1f7a-4f22-8522-d8ba4b93f5a5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:34:30.320940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 13/26] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:34:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:34:30.327053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67366def-7ef9-4e89-91af-509051649a02 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:30.335989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67366def-7ef9-4e89-91af-509051649a02 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:30.340223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd6b6f-269d-4157-afb4-9217bd824dd7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G5ZQr0ZgTm-pm0uC0WShwQ, audit_chain_id=['G5ZQr0ZgTm-pm0uC0WShwQ']) at 0x7fe09e363e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:30.340827 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd6b6f-269d-4157-afb4-9217bd824dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:30.341118 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd6b6f-269d-4157-afb4-9217bd824dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:30.341409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd6b6f-269d-4157-afb4-9217bd824dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:30.342125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd6b6f-269d-4157-afb4-9217bd824dd7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:34:30.342427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd6b6f-269d-4157-afb4-9217bd824dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:30.344325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd6b6f-269d-4157-afb4-9217bd824dd7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:30.356440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 14/27] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:30.362010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a67c4-1f7a-4f22-8522-d8ba4b93f5a5 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:30.372628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a67c4-1f7a-4f22-8522-d8ba4b93f5a5 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:30.376771 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552ff85-cb7b-4065-89ba-4631e2ec279e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G5ZQr0ZgTm-pm0uC0WShwQ, audit_chain_id=['G5ZQr0ZgTm-pm0uC0WShwQ']) at 0x7fe09e4445e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:30.377569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552ff85-cb7b-4065-89ba-4631e2ec279e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:30.377861 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552ff85-cb7b-4065-89ba-4631e2ec279e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:30.378149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552ff85-cb7b-4065-89ba-4631e2ec279e admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:30.379484 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552ff85-cb7b-4065-89ba-4631e2ec279e admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:30.381301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552ff85-cb7b-4065-89ba-4631e2ec279e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:30.382734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 14/28] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:30 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:30.388043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd6b6f-269d-4157-afb4-9217bd824dd7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:30.397608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd6b6f-269d-4157-afb4-9217bd824dd7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:30.401788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7a872-e2af-4d56-b256-f2f20c8513d8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G5ZQr0ZgTm-pm0uC0WShwQ, audit_chain_id=['G5ZQr0ZgTm-pm0uC0WShwQ']) at 0x7fe09e1c2310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:30.402508 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7a872-e2af-4d56-b256-f2f20c8513d8 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:30.402795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7a872-e2af-4d56-b256-f2f20c8513d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:30.403082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7a872-e2af-4d56-b256-f2f20c8513d8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:30.404223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7a872-e2af-4d56-b256-f2f20c8513d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:30.405929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7a872-e2af-4d56-b256-f2f20c8513d8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:30.407434 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 15/29] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:34:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:34:30.413210 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552ff85-cb7b-4065-89ba-4631e2ec279e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:30.423922 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552ff85-cb7b-4065-89ba-4631e2ec279e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:30.428842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b05034-ae2d-4073-b020-1208830ea63f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G5ZQr0ZgTm-pm0uC0WShwQ, audit_chain_id=['G5ZQr0ZgTm-pm0uC0WShwQ']) at 0x7fe09e4445b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:30.429457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b05034-ae2d-4073-b020-1208830ea63f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:30.429752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b05034-ae2d-4073-b020-1208830ea63f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:30.430039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b05034-ae2d-4073-b020-1208830ea63f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:30.430816 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b05034-ae2d-4073-b020-1208830ea63f admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.domain.id=default, user.id=6ab015dd8bfa4c7bab33bb2ae75070c3) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:34:30.431139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b05034-ae2d-4073-b020-1208830ea63f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:30.433680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b05034-ae2d-4073-b020-1208830ea63f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:30.439494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 15/30] 10.222.0.21 () {56 vars in 1343 bytes} [Mon Feb 28 18:34:30 2022] GET /identity/v3/role_assignments?user.id=6ab015dd8bfa4c7bab33bb2ae75070c3&scope.domain.id=default&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:32.617727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac7b3-b973-4789-8265-692cd9998a0b None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:32.618311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac7b3-b973-4789-8265-692cd9998a0b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:32.618311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cac7b3-b973-4789-8265-692cd9998a0b None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:32.620438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 16/31] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:32.626196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbc516-944d-4a2a-b4a2-1b8e78a398c7 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:32.626666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbc516-944d-4a2a-b4a2-1b8e78a398c7 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:32.626768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbc516-944d-4a2a-b4a2-1b8e78a398c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:32.651405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-1adbc516-944d-4a2a-b4a2-1b8e78a398c7 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:32.653167 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-1adbc516-944d-4a2a-b4a2-1b8e78a398c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:32.660510 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 16/32] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:32.682965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cac7b3-b973-4789-8265-692cd9998a0b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:32.695106 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cac7b3-b973-4789-8265-692cd9998a0b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:32.699788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86113be-6868-4a85-9861-7c2522723e2b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=azjBV9aBR0ii4tPTsME3kA, audit_chain_id=['azjBV9aBR0ii4tPTsME3kA']) at 0x7fe09e1df7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:32.700367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86113be-6868-4a85-9861-7c2522723e2b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:32.700665 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86113be-6868-4a85-9861-7c2522723e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:32.700953 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86113be-6868-4a85-9861-7c2522723e2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:32.708980 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86113be-6868-4a85-9861-7c2522723e2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:32.710948 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86113be-6868-4a85-9861-7c2522723e2b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:32.721729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 17/33] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:32 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:32.727857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbc516-944d-4a2a-b4a2-1b8e78a398c7 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:32.736732 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbc516-944d-4a2a-b4a2-1b8e78a398c7 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:32.741390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9ff1d-278a-4543-b1aa-335a75ade2e1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=azjBV9aBR0ii4tPTsME3kA, audit_chain_id=['azjBV9aBR0ii4tPTsME3kA']) at 0x7fe09e347970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:32.742108 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9ff1d-278a-4543-b1aa-335a75ade2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:32.742397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9ff1d-278a-4543-b1aa-335a75ade2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:32.742680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9ff1d-278a-4543-b1aa-335a75ade2e1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:32.743802 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9ff1d-278a-4543-b1aa-335a75ade2e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:32.745685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9ff1d-278a-4543-b1aa-335a75ade2e1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:32.747295 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 17/34] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:34:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:34.985520 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d29d2-eaed-4bb9-8a49-e1c3eaf7e316 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:34.986104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d29d2-eaed-4bb9-8a49-e1c3eaf7e316 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:34.986104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d29d2-eaed-4bb9-8a49-e1c3eaf7e316 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:34.987816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 18/35] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:34.994734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ec04-3fbe-4619-b9b0-8eef931bce21 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:34.995237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ec04-3fbe-4619-b9b0-8eef931bce21 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:34.995469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ec04-3fbe-4619-b9b0-8eef931bce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.019180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-aaa6ec04-3fbe-4619-b9b0-8eef931bce21 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:35.020363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-aaa6ec04-3fbe-4619-b9b0-8eef931bce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:35.028026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 18/36] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:35.051165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d29d2-eaed-4bb9-8a49-e1c3eaf7e316 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:35.064135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d29d2-eaed-4bb9-8a49-e1c3eaf7e316 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:35.068171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7670337-bc76-444c-8dac-6e9141d820a9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HQOfliKHRlywgGURNNb6TQ, audit_chain_id=['HQOfliKHRlywgGURNNb6TQ']) at 0x7fe09e1f30a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:35.068899 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7670337-bc76-444c-8dac-6e9141d820a9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:35.069195 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7670337-bc76-444c-8dac-6e9141d820a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:35.069482 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7670337-bc76-444c-8dac-6e9141d820a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.082501 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7670337-bc76-444c-8dac-6e9141d820a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:35.084415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7670337-bc76-444c-8dac-6e9141d820a9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:35.102502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-a7670337-bc76-444c-8dac-6e9141d820a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:34:35.103677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 19/37] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:35.109991 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6ec04-3fbe-4619-b9b0-8eef931bce21 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:35.118772 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6ec04-3fbe-4619-b9b0-8eef931bce21 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:35.123661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a744e1-2a74-4905-84fd-890dbca5215b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HQOfliKHRlywgGURNNb6TQ, audit_chain_id=['HQOfliKHRlywgGURNNb6TQ']) at 0x7fe09e4442b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:35.124267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a744e1-2a74-4905-84fd-890dbca5215b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:35.124566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a744e1-2a74-4905-84fd-890dbca5215b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:35.124855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a744e1-2a74-4905-84fd-890dbca5215b admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.125555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a744e1-2a74-4905-84fd-890dbca5215b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:34:35.125860 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a744e1-2a74-4905-84fd-890dbca5215b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:35.126961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-e6a744e1-2a74-4905-84fd-890dbca5215b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:35.126961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:34:35.126961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:34:35.127939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a744e1-2a74-4905-84fd-890dbca5215b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:35.144713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 19/38] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:35.150503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7670337-bc76-444c-8dac-6e9141d820a9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:35.161170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7670337-bc76-444c-8dac-6e9141d820a9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:35.165525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9cf9f-5164-4b1e-87d5-2e35ef3c5296 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HQOfliKHRlywgGURNNb6TQ, audit_chain_id=['HQOfliKHRlywgGURNNb6TQ']) at 0x7fe09e1980d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:35.166135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9cf9f-5164-4b1e-87d5-2e35ef3c5296 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:35.166428 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9cf9f-5164-4b1e-87d5-2e35ef3c5296 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:35.166763 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9cf9f-5164-4b1e-87d5-2e35ef3c5296 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.168194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9cf9f-5164-4b1e-87d5-2e35ef3c5296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:35.169256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-29f9cf9f-5164-4b1e-87d5-2e35ef3c5296 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:35.169256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:34:35.169256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:34:35.170496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9cf9f-5164-4b1e-87d5-2e35ef3c5296 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:35.291618 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 20/39] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:34:35 2022] POST /identity/v3/projects => generated 301 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:34:37.535643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500572c2-d8db-47ef-8fe0-5d2aa4df5687 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:37.536167 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500572c2-d8db-47ef-8fe0-5d2aa4df5687 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:37.536254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500572c2-d8db-47ef-8fe0-5d2aa4df5687 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:37.537884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 20/40] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:37.543533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb71ef8-6b07-4e4a-a95f-093191e668db None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:37.544243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb71ef8-6b07-4e4a-a95f-093191e668db None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:37.544468 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb71ef8-6b07-4e4a-a95f-093191e668db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:37.569413 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-6bb71ef8-6b07-4e4a-a95f-093191e668db None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:37.570593 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-6bb71ef8-6b07-4e4a-a95f-093191e668db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:37.635836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 21/41] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:37.658696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500572c2-d8db-47ef-8fe0-5d2aa4df5687 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:37.671040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500572c2-d8db-47ef-8fe0-5d2aa4df5687 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:37.675299 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d9025-6cfb-4cf0-ae3e-e114ec530785 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VL71tdCRQASb5AALK1CEcg, audit_chain_id=['VL71tdCRQASb5AALK1CEcg']) at 0x7fe09e45d430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:37.675893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d9025-6cfb-4cf0-ae3e-e114ec530785 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:37.676183 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d9025-6cfb-4cf0-ae3e-e114ec530785 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:37.676464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d9025-6cfb-4cf0-ae3e-e114ec530785 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:37.677165 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d9025-6cfb-4cf0-ae3e-e114ec530785 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:37.678161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-c38d9025-6cfb-4cf0-ae3e-e114ec530785 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:37.678161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:34:37.678161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:34:37.679056 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d9025-6cfb-4cf0-ae3e-e114ec530785 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:38.014849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 21/42] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 18:34:37 2022] POST /identity/v3/roles => generated 219 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:34:40.269817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897042-9e72-4e86-9778-52d99371e3ac None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:40.270319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897042-9e72-4e86-9778-52d99371e3ac None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:40.270319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897042-9e72-4e86-9778-52d99371e3ac None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:40.272031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 22/43] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:40.277489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053e31-0fb8-49e4-b6e1-d139f9d63f63 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:40.277908 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053e31-0fb8-49e4-b6e1-d139f9d63f63 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:40.278064 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053e31-0fb8-49e4-b6e1-d139f9d63f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:40.301881 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-29053e31-0fb8-49e4-b6e1-d139f9d63f63 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:40.303373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-29053e31-0fb8-49e4-b6e1-d139f9d63f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:40.310571 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 22/44] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:40.333350 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897042-9e72-4e86-9778-52d99371e3ac None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:40.348598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897042-9e72-4e86-9778-52d99371e3ac None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:40.352650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74bd7-7f2c-4a17-9b67-68840a17fd92 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeM2WoqATiSMXGCu_r5EQA, audit_chain_id=['NeM2WoqATiSMXGCu_r5EQA']) at 0x7fe09e1ccca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:40.353251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74bd7-7f2c-4a17-9b67-68840a17fd92 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:40.353543 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74bd7-7f2c-4a17-9b67-68840a17fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:40.353828 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74bd7-7f2c-4a17-9b67-68840a17fd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:40.354545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e74bd7-7f2c-4a17-9b67-68840a17fd92 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:40.355614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-15e74bd7-7f2c-4a17-9b67-68840a17fd92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:40.355614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:34:40.355614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:34:40.356528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e74bd7-7f2c-4a17-9b67-68840a17fd92 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:40.486564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 23/45] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 18:34:40 2022] POST /identity/v3/roles => generated 225 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:34:42.797462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df3016-a5c5-450e-864d-dc892daa57ee None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:42.798034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df3016-a5c5-450e-864d-dc892daa57ee None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:42.798140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df3016-a5c5-450e-864d-dc892daa57ee None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:42.799813 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 23/46] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:42.805117 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e4459-6671-4fac-b0b9-b4eed9dedd8f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:42.805494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e4459-6671-4fac-b0b9-b4eed9dedd8f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:42.805708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e4459-6671-4fac-b0b9-b4eed9dedd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:42.829013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a26e4459-6671-4fac-b0b9-b4eed9dedd8f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:42.830183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a26e4459-6671-4fac-b0b9-b4eed9dedd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:42.837110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 24/47] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:42 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:42.860089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df3016-a5c5-450e-864d-dc892daa57ee None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:42.871976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df3016-a5c5-450e-864d-dc892daa57ee None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:42.876735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ef49-a0f6-43db-a146-c3dcde0e2190 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-lX-F437QTSh6Fw5fVl25g, audit_chain_id=['-lX-F437QTSh6Fw5fVl25g']) at 0x7fe09e4f3a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:42.877330 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ef49-a0f6-43db-a146-c3dcde0e2190 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:42.877622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ef49-a0f6-43db-a146-c3dcde0e2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:42.877908 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ef49-a0f6-43db-a146-c3dcde0e2190 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:42.878615 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ef49-a0f6-43db-a146-c3dcde0e2190 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:42.880417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ef49-a0f6-43db-a146-c3dcde0e2190 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:42.959479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 24/48] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 18:34:42 2022] POST /identity/v3/roles => generated 223 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:34:45.121054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2eb6d-90d2-4cca-92e5-91d94c4de3ec None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:45.121571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2eb6d-90d2-4cca-92e5-91d94c4de3ec None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:45.121656 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2eb6d-90d2-4cca-92e5-91d94c4de3ec None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:45.123405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 25/49] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:45.129071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01df21e-3edd-4ffa-b45a-5ae88217a399 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:45.129480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01df21e-3edd-4ffa-b45a-5ae88217a399 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:45.129649 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01df21e-3edd-4ffa-b45a-5ae88217a399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:45.155047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-d01df21e-3edd-4ffa-b45a-5ae88217a399 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:45.156266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d01df21e-3edd-4ffa-b45a-5ae88217a399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:45.163748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 25/50] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:45 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:45.186395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2eb6d-90d2-4cca-92e5-91d94c4de3ec None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:45.198959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2eb6d-90d2-4cca-92e5-91d94c4de3ec None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:45.204070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb6c88-86ec-4e9c-8fae-234527cbe967 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kA1ocq7BR7uk_LxcVSuz7A, audit_chain_id=['kA1ocq7BR7uk_LxcVSuz7A']) at 0x7fe09e1df760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:45.205067 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6c88-86ec-4e9c-8fae-234527cbe967 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:45.205548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6c88-86ec-4e9c-8fae-234527cbe967 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:45.206019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6c88-86ec-4e9c-8fae-234527cbe967 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:45.207413 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb6c88-86ec-4e9c-8fae-234527cbe967 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:45.209343 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb6c88-86ec-4e9c-8fae-234527cbe967 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:45.210883 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 26/51] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:34:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:45.217397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01df21e-3edd-4ffa-b45a-5ae88217a399 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:45.226630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01df21e-3edd-4ffa-b45a-5ae88217a399 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:45.230726 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352108e5-77ff-4055-ae90-3e0897bda656 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kA1ocq7BR7uk_LxcVSuz7A, audit_chain_id=['kA1ocq7BR7uk_LxcVSuz7A']) at 0x7fe09e237a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:45.231347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352108e5-77ff-4055-ae90-3e0897bda656 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:45.231670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352108e5-77ff-4055-ae90-3e0897bda656 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:45.231998 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352108e5-77ff-4055-ae90-3e0897bda656 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:45.232670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352108e5-77ff-4055-ae90-3e0897bda656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:45.233672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-352108e5-77ff-4055-ae90-3e0897bda656 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:45.233672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:34:45.233672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:34:45.234903 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352108e5-77ff-4055-ae90-3e0897bda656 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:45.339793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 26/52] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:34:45 2022] POST /identity/v3/projects => generated 312 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:34:47.505957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feebe3-0f7f-44a7-9dc3-70a73bbeeeda None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:47.506584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feebe3-0f7f-44a7-9dc3-70a73bbeeeda None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:47.506584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feebe3-0f7f-44a7-9dc3-70a73bbeeeda None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:47.508242 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 27/53] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:47.513686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364051e5-c4e2-4e0e-a896-7c4e4cd18409 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:47.514148 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364051e5-c4e2-4e0e-a896-7c4e4cd18409 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:47.514247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364051e5-c4e2-4e0e-a896-7c4e4cd18409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:47.536710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-364051e5-c4e2-4e0e-a896-7c4e4cd18409 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:47.537876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-364051e5-c4e2-4e0e-a896-7c4e4cd18409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:47.605391 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 27/54] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:47 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:47.629785 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feebe3-0f7f-44a7-9dc3-70a73bbeeeda None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:47.642384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feebe3-0f7f-44a7-9dc3-70a73bbeeeda None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:47.646397 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d7ab8-0d58-4b85-9494-b71b9c51d565 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UvynnIfWThq9-0uaqjtumw, audit_chain_id=['UvynnIfWThq9-0uaqjtumw']) at 0x7fe09e1fbc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:47.647129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d7ab8-0d58-4b85-9494-b71b9c51d565 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:47.647450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d7ab8-0d58-4b85-9494-b71b9c51d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:47.647735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d7ab8-0d58-4b85-9494-b71b9c51d565 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:47.648897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d7ab8-0d58-4b85-9494-b71b9c51d565 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:47.650594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d7ab8-0d58-4b85-9494-b71b9c51d565 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:47.652135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 28/55] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:34:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:47.659345 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364051e5-c4e2-4e0e-a896-7c4e4cd18409 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:47.668062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364051e5-c4e2-4e0e-a896-7c4e4cd18409 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:47.672342 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7ff5f-4494-453b-b366-4f18eb33655d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UvynnIfWThq9-0uaqjtumw, audit_chain_id=['UvynnIfWThq9-0uaqjtumw']) at 0x7fe09e21ba30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:47.672956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7ff5f-4494-453b-b366-4f18eb33655d admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:47.673336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7ff5f-4494-453b-b366-4f18eb33655d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:47.673629 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7ff5f-4494-453b-b366-4f18eb33655d admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:47.674287 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7ff5f-4494-453b-b366-4f18eb33655d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:47.676312 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7ff5f-4494-453b-b366-4f18eb33655d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:47.830169 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 28/56] 10.222.0.21 () {60 vars in 1161 bytes} [Mon Feb 28 18:34:47 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:34:49.984217 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55dc3c-b811-489a-9842-01d835dee236 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:49.984759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55dc3c-b811-489a-9842-01d835dee236 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:49.984759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55dc3c-b811-489a-9842-01d835dee236 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:49.986451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 29/57] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:49.991872 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636df8b-d0a6-4fb2-a31e-597f396c5cdb None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:49.992316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636df8b-d0a6-4fb2-a31e-597f396c5cdb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:49.992483 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636df8b-d0a6-4fb2-a31e-597f396c5cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:50.016192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-c636df8b-d0a6-4fb2-a31e-597f396c5cdb None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:50.017357 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c636df8b-d0a6-4fb2-a31e-597f396c5cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:50.084859 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 29/58] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:50.110206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55dc3c-b811-489a-9842-01d835dee236 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:50.121902 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55dc3c-b811-489a-9842-01d835dee236 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:50.126103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3db901-9de6-436d-9997-601860bc3703 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOqTSouvRBqo_PoKWAlH3g, audit_chain_id=['qOqTSouvRBqo_PoKWAlH3g']) at 0x7fe09e17f160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:50.126819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3db901-9de6-436d-9997-601860bc3703 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:50.127107 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3db901-9de6-436d-9997-601860bc3703 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:50.127419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3db901-9de6-436d-9997-601860bc3703 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:50.128518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3db901-9de6-436d-9997-601860bc3703 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:50.130206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3db901-9de6-436d-9997-601860bc3703 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:50.131693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 30/59] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:34:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:34:50.137338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636df8b-d0a6-4fb2-a31e-597f396c5cdb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:50.149374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636df8b-d0a6-4fb2-a31e-597f396c5cdb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:50.154531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d68221-f806-4d4e-9fc1-a1520e57c90b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOqTSouvRBqo_PoKWAlH3g, audit_chain_id=['qOqTSouvRBqo_PoKWAlH3g']) at 0x7fe09e21b0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:50.155161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d68221-f806-4d4e-9fc1-a1520e57c90b admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:50.155458 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d68221-f806-4d4e-9fc1-a1520e57c90b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:50.156243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d68221-f806-4d4e-9fc1-a1520e57c90b admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:50.156912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d68221-f806-4d4e-9fc1-a1520e57c90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:50.158338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-70d68221-f806-4d4e-9fc1-a1520e57c90b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:50.158338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:34:50.158338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:34:50.159220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d68221-f806-4d4e-9fc1-a1520e57c90b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:50.250560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 30/60] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:34:50 2022] POST /identity/v3/users => generated 275 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:34:53.001215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e664-9f82-4a9b-8489-8466a2ed3eb0 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:53.001738 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e664-9f82-4a9b-8489-8466a2ed3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:53.001856 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e664-9f82-4a9b-8489-8466a2ed3eb0 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:53.003493 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 31/61] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:53.009426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ef2c-f19a-4ff6-8279-74f9101a4aee None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:53.009885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ef2c-f19a-4ff6-8279-74f9101a4aee None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:53.010005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ef2c-f19a-4ff6-8279-74f9101a4aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:53.033617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-6da0ef2c-f19a-4ff6-8279-74f9101a4aee None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:53.036307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6da0ef2c-f19a-4ff6-8279-74f9101a4aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:53.041948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 31/62] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:53 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:53.065587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e664-9f82-4a9b-8489-8466a2ed3eb0 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:53.077687 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e664-9f82-4a9b-8489-8466a2ed3eb0 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:53.082716 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec9a9-a894-4196-893c-d7a262f3447f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mSqsn6EGTjuT7OkhbPMWIg, audit_chain_id=['mSqsn6EGTjuT7OkhbPMWIg']) at 0x7fe09e17fee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:53.083521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec9a9-a894-4196-893c-d7a262f3447f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:53.083814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec9a9-a894-4196-893c-d7a262f3447f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:53.084101 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ec9a9-a894-4196-893c-d7a262f3447f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:53.096179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ec9a9-a894-4196-893c-d7a262f3447f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:34:53.102965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-459ec9a9-a894-4196-893c-d7a262f3447f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:34:53.104111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 32/63] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:53.110984 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0ef2c-f19a-4ff6-8279-74f9101a4aee None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:53.119792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0ef2c-f19a-4ff6-8279-74f9101a4aee None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:53.123972 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7daaa-59b2-485a-88b2-08f47e9425c4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mSqsn6EGTjuT7OkhbPMWIg, audit_chain_id=['mSqsn6EGTjuT7OkhbPMWIg']) at 0x7fe09e3b5ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:53.124580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7daaa-59b2-485a-88b2-08f47e9425c4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:53.124878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7daaa-59b2-485a-88b2-08f47e9425c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:53.125170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7daaa-59b2-485a-88b2-08f47e9425c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:53.125974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7daaa-59b2-485a-88b2-08f47e9425c4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:34:53.126279 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7daaa-59b2-485a-88b2-08f47e9425c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:53.127964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7daaa-59b2-485a-88b2-08f47e9425c4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:53.136781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 32/64] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:34:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:53.142779 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec9a9-a894-4196-893c-d7a262f3447f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:53.152798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ec9a9-a894-4196-893c-d7a262f3447f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:53.157614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43848f2-fe0a-4ce1-96b9-4aa94301c8a5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mSqsn6EGTjuT7OkhbPMWIg, audit_chain_id=['mSqsn6EGTjuT7OkhbPMWIg']) at 0x7fe09e1f3a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:53.158518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43848f2-fe0a-4ce1-96b9-4aa94301c8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:53.158813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43848f2-fe0a-4ce1-96b9-4aa94301c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:53.159101 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43848f2-fe0a-4ce1-96b9-4aa94301c8a5 admin admin] PATH_INFO: `/v3/users/e3f706901c1d4191ada8dd10650391b6` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:53.179396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43848f2-fe0a-4ce1-96b9-4aa94301c8a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3f706901c1d4191ada8dd10650391b6)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:53.181635 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43848f2-fe0a-4ce1-96b9-4aa94301c8a5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:53.183243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 33/65] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:53 2022] GET /identity/v3/users/e3f706901c1d4191ada8dd10650391b6 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:53.190473 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7daaa-59b2-485a-88b2-08f47e9425c4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:53.199993 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7daaa-59b2-485a-88b2-08f47e9425c4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:53.204251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91ae60-741d-44d2-8125-ecadceafb3ad admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mSqsn6EGTjuT7OkhbPMWIg, audit_chain_id=['mSqsn6EGTjuT7OkhbPMWIg']) at 0x7fe09e3b5c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:53.204830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ae60-741d-44d2-8125-ecadceafb3ad admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:53.205127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ae60-741d-44d2-8125-ecadceafb3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:53.205416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ae60-741d-44d2-8125-ecadceafb3ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:53.213949 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91ae60-741d-44d2-8125-ecadceafb3ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:53.215808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91ae60-741d-44d2-8125-ecadceafb3ad admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:53.225618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 33/66] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:53 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:53.231655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43848f2-fe0a-4ce1-96b9-4aa94301c8a5 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:53.242725 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43848f2-fe0a-4ce1-96b9-4aa94301c8a5 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:53.247289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd963b10-fd55-4e8f-a7b1-8d585d312cd6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mSqsn6EGTjuT7OkhbPMWIg, audit_chain_id=['mSqsn6EGTjuT7OkhbPMWIg']) at 0x7fe09e1885e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:53.248092 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963b10-fd55-4e8f-a7b1-8d585d312cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:53.248390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963b10-fd55-4e8f-a7b1-8d585d312cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:53.248683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963b10-fd55-4e8f-a7b1-8d585d312cd6 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:53.249982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd963b10-fd55-4e8f-a7b1-8d585d312cd6 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:53.252755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd963b10-fd55-4e8f-a7b1-8d585d312cd6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:53.254421 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 34/67] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:53 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:53.260570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91ae60-741d-44d2-8125-ecadceafb3ad admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:53.270088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91ae60-741d-44d2-8125-ecadceafb3ad admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:53.275233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9aab2-1b22-4fcf-93b7-7b1e71822a6b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mSqsn6EGTjuT7OkhbPMWIg, audit_chain_id=['mSqsn6EGTjuT7OkhbPMWIg']) at 0x7fe09e21eac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:53.275833 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9aab2-1b22-4fcf-93b7-7b1e71822a6b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:53.276130 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9aab2-1b22-4fcf-93b7-7b1e71822a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:53.276420 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9aab2-1b22-4fcf-93b7-7b1e71822a6b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:53.277299 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9aab2-1b22-4fcf-93b7-7b1e71822a6b admin admin] RBAC: Adding query filter params (role.id=ddd473dfc0884753855419d1711fd868, scope.project.id=536234568c1a477aaa466a4b57b0731f, user.id=e3f706901c1d4191ada8dd10650391b6) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:34:53.277526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9aab2-1b22-4fcf-93b7-7b1e71822a6b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:53.279419 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9aab2-1b22-4fcf-93b7-7b1e71822a6b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:53.286070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 34/68] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:34:53 2022] GET /identity/v3/role_assignments?user.id=e3f706901c1d4191ada8dd10650391b6&scope.project.id=536234568c1a477aaa466a4b57b0731f&role.id=ddd473dfc0884753855419d1711fd868 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:55.411717 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372b267-5f50-4bbf-90db-44c682663202 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:55.412291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372b267-5f50-4bbf-90db-44c682663202 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:55.412291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372b267-5f50-4bbf-90db-44c682663202 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:55.413967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 35/69] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:55.419412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb08925-694c-4eca-bf3d-a36a4a07faac None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:55.419827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb08925-694c-4eca-bf3d-a36a4a07faac None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:55.419997 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb08925-694c-4eca-bf3d-a36a4a07faac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:55.443319 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4fb08925-694c-4eca-bf3d-a36a4a07faac None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:55.444473 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4fb08925-694c-4eca-bf3d-a36a4a07faac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:55.451294 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 35/70] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:55 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:34:55.474345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372b267-5f50-4bbf-90db-44c682663202 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:55.487200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372b267-5f50-4bbf-90db-44c682663202 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:55.493480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807cf81-061c-4584-bf9e-a44cb720614f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RleZx8wdTAK4d7QEtmxsMA, audit_chain_id=['RleZx8wdTAK4d7QEtmxsMA']) at 0x7fe09e1888b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:55.494199 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807cf81-061c-4584-bf9e-a44cb720614f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:55.494490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807cf81-061c-4584-bf9e-a44cb720614f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:55.494776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807cf81-061c-4584-bf9e-a44cb720614f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:55.506930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807cf81-061c-4584-bf9e-a44cb720614f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:34:55.514027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-6807cf81-061c-4584-bf9e-a44cb720614f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:34:55.515205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 36/71] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:55.521743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb08925-694c-4eca-bf3d-a36a4a07faac None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:55.530532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb08925-694c-4eca-bf3d-a36a4a07faac None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:55.535347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de8d99-05a4-43b2-82fd-18a416c1f583 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RleZx8wdTAK4d7QEtmxsMA, audit_chain_id=['RleZx8wdTAK4d7QEtmxsMA']) at 0x7fe09e21b370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:55.535960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8d99-05a4-43b2-82fd-18a416c1f583 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:55.536252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8d99-05a4-43b2-82fd-18a416c1f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:55.536540 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8d99-05a4-43b2-82fd-18a416c1f583 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:55.537265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de8d99-05a4-43b2-82fd-18a416c1f583 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:34:55.537568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de8d99-05a4-43b2-82fd-18a416c1f583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:55.539204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de8d99-05a4-43b2-82fd-18a416c1f583 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:55.548313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 36/72] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:34:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:55.553923 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807cf81-061c-4584-bf9e-a44cb720614f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:55.564185 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807cf81-061c-4584-bf9e-a44cb720614f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:55.568400 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8557b8-4aba-4052-82c3-8800e8b7bbae admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RleZx8wdTAK4d7QEtmxsMA, audit_chain_id=['RleZx8wdTAK4d7QEtmxsMA']) at 0x7fe09e1f3910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:55.569191 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8557b8-4aba-4052-82c3-8800e8b7bbae admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:55.569480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8557b8-4aba-4052-82c3-8800e8b7bbae admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:55.569761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8557b8-4aba-4052-82c3-8800e8b7bbae admin admin] PATH_INFO: `/v3/users/e3f706901c1d4191ada8dd10650391b6` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:55.570880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8557b8-4aba-4052-82c3-8800e8b7bbae admin admin] RBAC: Authorizing `identity:get_user(user_id=e3f706901c1d4191ada8dd10650391b6)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:55.574804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8557b8-4aba-4052-82c3-8800e8b7bbae admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:55.576726 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 37/73] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:55 2022] GET /identity/v3/users/e3f706901c1d4191ada8dd10650391b6 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:55.583046 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de8d99-05a4-43b2-82fd-18a416c1f583 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:55.592455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de8d99-05a4-43b2-82fd-18a416c1f583 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:55.597658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ed00-00b3-4766-bcf5-a6db7bdabb3a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RleZx8wdTAK4d7QEtmxsMA, audit_chain_id=['RleZx8wdTAK4d7QEtmxsMA']) at 0x7fe09e1e6fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:55.598451 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ed00-00b3-4766-bcf5-a6db7bdabb3a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:55.598745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ed00-00b3-4766-bcf5-a6db7bdabb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:55.599126 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ed00-00b3-4766-bcf5-a6db7bdabb3a admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:55.600166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079ed00-00b3-4766-bcf5-a6db7bdabb3a admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:55.602273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079ed00-00b3-4766-bcf5-a6db7bdabb3a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:55.603862 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 37/74] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:55 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:55.609443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8557b8-4aba-4052-82c3-8800e8b7bbae admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:55.619722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8557b8-4aba-4052-82c3-8800e8b7bbae admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:55.623928 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c83cd5-2693-4d1b-af34-b095edee5e4a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RleZx8wdTAK4d7QEtmxsMA, audit_chain_id=['RleZx8wdTAK4d7QEtmxsMA']) at 0x7fe09e9a0cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:55.624738 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c83cd5-2693-4d1b-af34-b095edee5e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:55.625026 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c83cd5-2693-4d1b-af34-b095edee5e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:55.625967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c83cd5-2693-4d1b-af34-b095edee5e4a admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f/users/e3f706901c1d4191ada8dd10650391b6/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:55.627958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c83cd5-2693-4d1b-af34-b095edee5e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=536234568c1a477aaa466a4b57b0731f, user_id=e3f706901c1d4191ada8dd10650391b6, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:55.630613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c83cd5-2693-4d1b-af34-b095edee5e4a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:55.748319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 38/75] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:34:55 2022] PUT /identity/v3/projects/536234568c1a477aaa466a4b57b0731f/users/e3f706901c1d4191ada8dd10650391b6/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:34:57.892068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844856-c466-418e-a9ba-13ea2976a1ba None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:57.892593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844856-c466-418e-a9ba-13ea2976a1ba None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:57.892698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844856-c466-418e-a9ba-13ea2976a1ba None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:57.894300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 38/76] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:57.899707 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4011a-ecd7-4dd4-a2ac-c14349104b4c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:57.900160 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4011a-ecd7-4dd4-a2ac-c14349104b4c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:57.900287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4011a-ecd7-4dd4-a2ac-c14349104b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:57.923474 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c8a4011a-ecd7-4dd4-a2ac-c14349104b4c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:57.924627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c8a4011a-ecd7-4dd4-a2ac-c14349104b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:57.990198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 39/77] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:57 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:58.013826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2844856-c466-418e-a9ba-13ea2976a1ba None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:58.025743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2844856-c466-418e-a9ba-13ea2976a1ba None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:58.029628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a24525-b405-4d9a-9d1f-5b94d398ea95 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=f_imqK1vTueoSHxek9v-aQ, audit_chain_id=['f_imqK1vTueoSHxek9v-aQ']) at 0x7fe09e21b280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:58.030350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a24525-b405-4d9a-9d1f-5b94d398ea95 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:58.030643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a24525-b405-4d9a-9d1f-5b94d398ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:58.030928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a24525-b405-4d9a-9d1f-5b94d398ea95 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:58.042429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a24525-b405-4d9a-9d1f-5b94d398ea95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:34:58.049323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-61a24525-b405-4d9a-9d1f-5b94d398ea95 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:34:58.050438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 39/78] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:58.056452 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4011a-ecd7-4dd4-a2ac-c14349104b4c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:58.066663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4011a-ecd7-4dd4-a2ac-c14349104b4c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:58.070796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03a857-beab-4f9b-accd-7e830bbb76e5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=f_imqK1vTueoSHxek9v-aQ, audit_chain_id=['f_imqK1vTueoSHxek9v-aQ']) at 0x7fe09e188670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:58.071425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a857-beab-4f9b-accd-7e830bbb76e5 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:58.071718 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a857-beab-4f9b-accd-7e830bbb76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:58.072005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a857-beab-4f9b-accd-7e830bbb76e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:58.072720 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03a857-beab-4f9b-accd-7e830bbb76e5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:34:58.073023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03a857-beab-4f9b-accd-7e830bbb76e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:58.074656 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03a857-beab-4f9b-accd-7e830bbb76e5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:58.083724 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 40/79] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:34:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:58.089340 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a24525-b405-4d9a-9d1f-5b94d398ea95 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:58.099062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a24525-b405-4d9a-9d1f-5b94d398ea95 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:58.103151 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934aef4-ab3b-4c73-82c1-c1095dbcebf0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=f_imqK1vTueoSHxek9v-aQ, audit_chain_id=['f_imqK1vTueoSHxek9v-aQ']) at 0x7fe09e1e6790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:58.103955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934aef4-ab3b-4c73-82c1-c1095dbcebf0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:58.104252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934aef4-ab3b-4c73-82c1-c1095dbcebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:58.104542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934aef4-ab3b-4c73-82c1-c1095dbcebf0 admin admin] PATH_INFO: `/v3/users/e3f706901c1d4191ada8dd10650391b6` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:58.105656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934aef4-ab3b-4c73-82c1-c1095dbcebf0 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3f706901c1d4191ada8dd10650391b6)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:58.107854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934aef4-ab3b-4c73-82c1-c1095dbcebf0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:58.109360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 40/80] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:58 2022] GET /identity/v3/users/e3f706901c1d4191ada8dd10650391b6 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:58.115404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03a857-beab-4f9b-accd-7e830bbb76e5 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:58.124853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03a857-beab-4f9b-accd-7e830bbb76e5 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:58.129563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7af3a2-4e7c-481e-be6f-79b7b1be4821 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=f_imqK1vTueoSHxek9v-aQ, audit_chain_id=['f_imqK1vTueoSHxek9v-aQ']) at 0x7fe09e204460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:58.130149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7af3a2-4e7c-481e-be6f-79b7b1be4821 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:58.130440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7af3a2-4e7c-481e-be6f-79b7b1be4821 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:58.130755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7af3a2-4e7c-481e-be6f-79b7b1be4821 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:58.138541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7af3a2-4e7c-481e-be6f-79b7b1be4821 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:58.140364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7af3a2-4e7c-481e-be6f-79b7b1be4821 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:58.148918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 41/81] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:58 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:58.154575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934aef4-ab3b-4c73-82c1-c1095dbcebf0 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:58.164650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934aef4-ab3b-4c73-82c1-c1095dbcebf0 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:58.168747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842adbd9-1ddb-4f77-8a3a-9c06166ba307 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=f_imqK1vTueoSHxek9v-aQ, audit_chain_id=['f_imqK1vTueoSHxek9v-aQ']) at 0x7fe09e444040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:58.169532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842adbd9-1ddb-4f77-8a3a-9c06166ba307 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:58.169828 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842adbd9-1ddb-4f77-8a3a-9c06166ba307 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:58.170118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842adbd9-1ddb-4f77-8a3a-9c06166ba307 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:58.171248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842adbd9-1ddb-4f77-8a3a-9c06166ba307 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:58.174161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842adbd9-1ddb-4f77-8a3a-9c06166ba307 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:58.175728 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 41/82] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:58 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:58.181447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7af3a2-4e7c-481e-be6f-79b7b1be4821 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:58.190481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7af3a2-4e7c-481e-be6f-79b7b1be4821 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:58.194655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625827e-df5f-4681-8f1d-e9f16f1b7ddd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=f_imqK1vTueoSHxek9v-aQ, audit_chain_id=['f_imqK1vTueoSHxek9v-aQ']) at 0x7fe09e1fb730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:58.195280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625827e-df5f-4681-8f1d-e9f16f1b7ddd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:58.195577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625827e-df5f-4681-8f1d-e9f16f1b7ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:58.195867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625827e-df5f-4681-8f1d-e9f16f1b7ddd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:58.196648 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625827e-df5f-4681-8f1d-e9f16f1b7ddd admin admin] RBAC: Adding query filter params (role.id=ddd473dfc0884753855419d1711fd868, scope.project.id=536234568c1a477aaa466a4b57b0731f, user.id=e3f706901c1d4191ada8dd10650391b6) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:34:58.196959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625827e-df5f-4681-8f1d-e9f16f1b7ddd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:58.197974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-a625827e-df5f-4681-8f1d-e9f16f1b7ddd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:58.197974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:34:58.197974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:34:58.199167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625827e-df5f-4681-8f1d-e9f16f1b7ddd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:34:58.205023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 42/83] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:34:58 2022] GET /identity/v3/role_assignments?user.id=e3f706901c1d4191ada8dd10650391b6&scope.project.id=536234568c1a477aaa466a4b57b0731f&role.id=ddd473dfc0884753855419d1711fd868 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:00.528073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97e9ae-f0ad-47cc-a983-ac55c67b339e None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:00.528721 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97e9ae-f0ad-47cc-a983-ac55c67b339e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:00.528721 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97e9ae-f0ad-47cc-a983-ac55c67b339e None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:00.530325 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 42/84] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:00.536273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ef22-26ac-45d9-93b0-13a75725fa47 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:00.536746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ef22-26ac-45d9-93b0-13a75725fa47 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:00.536855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ef22-26ac-45d9-93b0-13a75725fa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:00.559754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-dbc5ef22-26ac-45d9-93b0-13a75725fa47 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:00.560974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-dbc5ef22-26ac-45d9-93b0-13a75725fa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:00.568918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 43/85] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:00 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:00.592180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97e9ae-f0ad-47cc-a983-ac55c67b339e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:00.606372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97e9ae-f0ad-47cc-a983-ac55c67b339e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:00.611037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7d6ce-dc57-443c-94f4-201211ceeb40 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pZJyGcQBQ12UFoYRAUoG4A, audit_chain_id=['pZJyGcQBQ12UFoYRAUoG4A']) at 0x7fe09e4442b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:00.611799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7d6ce-dc57-443c-94f4-201211ceeb40 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:00.612097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7d6ce-dc57-443c-94f4-201211ceeb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:00.612388 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7d6ce-dc57-443c-94f4-201211ceeb40 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:00.624247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7d6ce-dc57-443c-94f4-201211ceeb40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:00.630695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-11c7d6ce-dc57-443c-94f4-201211ceeb40 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:35:00.631876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 43/86] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:00.638031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5ef22-26ac-45d9-93b0-13a75725fa47 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:00.647775 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5ef22-26ac-45d9-93b0-13a75725fa47 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:00.651948 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1f9bb-72d2-450e-9640-1860c362f3b7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pZJyGcQBQ12UFoYRAUoG4A, audit_chain_id=['pZJyGcQBQ12UFoYRAUoG4A']) at 0x7fe09e1b07f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:00.652549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1f9bb-72d2-450e-9640-1860c362f3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:00.652838 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1f9bb-72d2-450e-9640-1860c362f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:00.653399 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1f9bb-72d2-450e-9640-1860c362f3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:00.654112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1f9bb-72d2-450e-9640-1860c362f3b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:00.654411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1f9bb-72d2-450e-9640-1860c362f3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:00.656064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1f9bb-72d2-450e-9640-1860c362f3b7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:00.665630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 44/87] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:00.671331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7d6ce-dc57-443c-94f4-201211ceeb40 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:00.681744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7d6ce-dc57-443c-94f4-201211ceeb40 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:00.685902 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ca27-9a08-470c-abce-93314444f286 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pZJyGcQBQ12UFoYRAUoG4A, audit_chain_id=['pZJyGcQBQ12UFoYRAUoG4A']) at 0x7fe09e212100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:00.686706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ca27-9a08-470c-abce-93314444f286 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:00.687004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ca27-9a08-470c-abce-93314444f286 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:00.687324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ca27-9a08-470c-abce-93314444f286 admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:00.688864 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557ca27-9a08-470c-abce-93314444f286 admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:00.690695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557ca27-9a08-470c-abce-93314444f286 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:00.692231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 44/88] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:00 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:00.697784 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1f9bb-72d2-450e-9640-1860c362f3b7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:00.707645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1f9bb-72d2-450e-9640-1860c362f3b7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:00.711897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aade93-850c-44dc-9e8e-a256598fa70a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pZJyGcQBQ12UFoYRAUoG4A, audit_chain_id=['pZJyGcQBQ12UFoYRAUoG4A']) at 0x7fe09e1d79d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:00.712482 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aade93-850c-44dc-9e8e-a256598fa70a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:00.712777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aade93-850c-44dc-9e8e-a256598fa70a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:00.713068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aade93-850c-44dc-9e8e-a256598fa70a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:00.722168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aade93-850c-44dc-9e8e-a256598fa70a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:00.723980 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aade93-850c-44dc-9e8e-a256598fa70a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:00.732705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 45/89] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:00 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:35:00.739042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ca27-9a08-470c-abce-93314444f286 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:00.748751 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ca27-9a08-470c-abce-93314444f286 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:00.753193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2651d-9d78-4a28-ad40-c69ef5c428f4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pZJyGcQBQ12UFoYRAUoG4A, audit_chain_id=['pZJyGcQBQ12UFoYRAUoG4A']) at 0x7fe09e212940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:00.753995 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2651d-9d78-4a28-ad40-c69ef5c428f4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:00.754295 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2651d-9d78-4a28-ad40-c69ef5c428f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:00.754589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2651d-9d78-4a28-ad40-c69ef5c428f4 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:00.755736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2651d-9d78-4a28-ad40-c69ef5c428f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:00.757817 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2651d-9d78-4a28-ad40-c69ef5c428f4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:00.759418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 45/90] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:00 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:00.765267 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aade93-850c-44dc-9e8e-a256598fa70a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:00.774885 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aade93-850c-44dc-9e8e-a256598fa70a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:00.779176 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af62e0-4e39-48b1-ab95-b2525c8466b4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pZJyGcQBQ12UFoYRAUoG4A, audit_chain_id=['pZJyGcQBQ12UFoYRAUoG4A']) at 0x7fe09e1c8f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:00.779727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af62e0-4e39-48b1-ab95-b2525c8466b4 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:00.780049 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af62e0-4e39-48b1-ab95-b2525c8466b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:00.780340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af62e0-4e39-48b1-ab95-b2525c8466b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:00.781120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af62e0-4e39-48b1-ab95-b2525c8466b4 admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=536234568c1a477aaa466a4b57b0731f, user.id=6ab015dd8bfa4c7bab33bb2ae75070c3) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:00.782154 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af62e0-4e39-48b1-ab95-b2525c8466b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:00.784054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af62e0-4e39-48b1-ab95-b2525c8466b4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:00.789798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 46/91] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:00 2022] GET /identity/v3/role_assignments?user.id=6ab015dd8bfa4c7bab33bb2ae75070c3&scope.project.id=536234568c1a477aaa466a4b57b0731f&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:02.919282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a4cb4-6fa6-460d-baef-1c24f55a9bad None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:02.919841 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a4cb4-6fa6-460d-baef-1c24f55a9bad None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:02.919841 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a4cb4-6fa6-460d-baef-1c24f55a9bad None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:02.921546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 46/92] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:02.926890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6730e8-bb46-4d88-aa2c-738a59d404ca None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:02.927345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6730e8-bb46-4d88-aa2c-738a59d404ca None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:02.927573 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6730e8-bb46-4d88-aa2c-738a59d404ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:02.950043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-0e6730e8-bb46-4d88-aa2c-738a59d404ca None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:02.951334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-0e6730e8-bb46-4d88-aa2c-738a59d404ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:02.958643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 47/93] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:02 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:02.981694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a4cb4-6fa6-460d-baef-1c24f55a9bad None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:02.993756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a4cb4-6fa6-460d-baef-1c24f55a9bad None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:02.998006 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e9ccf-6364-4a51-886e-5303557a5fa4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Wnp-EGgESS-QhureGig1tQ, audit_chain_id=['Wnp-EGgESS-QhureGig1tQ']) at 0x7fe09e2124f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:02.998748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e9ccf-6364-4a51-886e-5303557a5fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:02.999042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e9ccf-6364-4a51-886e-5303557a5fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:02.999358 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e9ccf-6364-4a51-886e-5303557a5fa4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:03.011957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e9ccf-6364-4a51-886e-5303557a5fa4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:03.019051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-ab7e9ccf-6364-4a51-886e-5303557a5fa4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:35:03.020290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 47/94] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:03.026196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6730e8-bb46-4d88-aa2c-738a59d404ca None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:03.036034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6730e8-bb46-4d88-aa2c-738a59d404ca None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:03.040260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0993e6a-08f0-4a61-a645-6ebf3ec6c1fa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Wnp-EGgESS-QhureGig1tQ, audit_chain_id=['Wnp-EGgESS-QhureGig1tQ']) at 0x7fe09e1e50d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:03.040877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0993e6a-08f0-4a61-a645-6ebf3ec6c1fa admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:03.041169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0993e6a-08f0-4a61-a645-6ebf3ec6c1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:03.041456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0993e6a-08f0-4a61-a645-6ebf3ec6c1fa admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:03.042185 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0993e6a-08f0-4a61-a645-6ebf3ec6c1fa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:03.042488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0993e6a-08f0-4a61-a645-6ebf3ec6c1fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:03.044170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0993e6a-08f0-4a61-a645-6ebf3ec6c1fa admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:03.053340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 48/95] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:03.059783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e9ccf-6364-4a51-886e-5303557a5fa4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:03.070579 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e9ccf-6364-4a51-886e-5303557a5fa4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:03.074835 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1139d2-d66b-4761-93fc-82b46caae08a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Wnp-EGgESS-QhureGig1tQ, audit_chain_id=['Wnp-EGgESS-QhureGig1tQ']) at 0x7fe09e1a1250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:03.075689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1139d2-d66b-4761-93fc-82b46caae08a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:03.075989 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1139d2-d66b-4761-93fc-82b46caae08a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:03.076281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1139d2-d66b-4761-93fc-82b46caae08a admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:03.077411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1139d2-d66b-4761-93fc-82b46caae08a admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:03.079879 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1139d2-d66b-4761-93fc-82b46caae08a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:03.081417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 48/96] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:03 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:03.087205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0993e6a-08f0-4a61-a645-6ebf3ec6c1fa admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:03.097701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0993e6a-08f0-4a61-a645-6ebf3ec6c1fa admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:03.103279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c133-f327-4412-b372-dd7d603c266c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Wnp-EGgESS-QhureGig1tQ, audit_chain_id=['Wnp-EGgESS-QhureGig1tQ']) at 0x7fe09e1c2a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:03.104093 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c133-f327-4412-b372-dd7d603c266c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:03.104388 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c133-f327-4412-b372-dd7d603c266c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:03.104679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c133-f327-4412-b372-dd7d603c266c admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:03.105831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7c133-f327-4412-b372-dd7d603c266c admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:03.108025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7c133-f327-4412-b372-dd7d603c266c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:03.109672 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 49/97] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:03 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:03.115931 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1139d2-d66b-4761-93fc-82b46caae08a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:03.127106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1139d2-d66b-4761-93fc-82b46caae08a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:03.131589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f03bd9-d96c-4770-8de3-9c63b30bee2c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Wnp-EGgESS-QhureGig1tQ, audit_chain_id=['Wnp-EGgESS-QhureGig1tQ']) at 0x7fe09e1941f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:03.132445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f03bd9-d96c-4770-8de3-9c63b30bee2c admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:03.132741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f03bd9-d96c-4770-8de3-9c63b30bee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:03.133025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f03bd9-d96c-4770-8de3-9c63b30bee2c admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f/users/6ab015dd8bfa4c7bab33bb2ae75070c3/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:03.134861 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f03bd9-d96c-4770-8de3-9c63b30bee2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=536234568c1a477aaa466a4b57b0731f, user_id=6ab015dd8bfa4c7bab33bb2ae75070c3, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:03.135928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-d4f03bd9-d96c-4770-8de3-9c63b30bee2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:35:03.135928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:35:03.135928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:35:03.137930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f03bd9-d96c-4770-8de3-9c63b30bee2c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:03.221598 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 49/98] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:35:03 2022] PUT /identity/v3/projects/536234568c1a477aaa466a4b57b0731f/users/6ab015dd8bfa4c7bab33bb2ae75070c3/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:35:05.431346 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65322d-6a2c-4f8b-b6c0-3c7b35ac7d25 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:05.431876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65322d-6a2c-4f8b-b6c0-3c7b35ac7d25 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:05.431959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65322d-6a2c-4f8b-b6c0-3c7b35ac7d25 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:05.433698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 50/99] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:05.440440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03be9fb-c67f-4029-8393-c7fb962dedc3 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:05.440941 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03be9fb-c67f-4029-8393-c7fb962dedc3 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:05.441026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03be9fb-c67f-4029-8393-c7fb962dedc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:05.463935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-e03be9fb-c67f-4029-8393-c7fb962dedc3 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:05.465108 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e03be9fb-c67f-4029-8393-c7fb962dedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:05.534451 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 50/100] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:05 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:05.558596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65322d-6a2c-4f8b-b6c0-3c7b35ac7d25 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:05.571907 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65322d-6a2c-4f8b-b6c0-3c7b35ac7d25 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:05.576124 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4acc23-3ac2-4d31-8544-a460c0f7b636 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E1XwO4xoSVuBK-845T_llA, audit_chain_id=['E1XwO4xoSVuBK-845T_llA']) at 0x7fe09e3bdee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:05.576867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4acc23-3ac2-4d31-8544-a460c0f7b636 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:05.577165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4acc23-3ac2-4d31-8544-a460c0f7b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:05.577457 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4acc23-3ac2-4d31-8544-a460c0f7b636 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:05.591898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4acc23-3ac2-4d31-8544-a460c0f7b636 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:05.599451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-5a4acc23-3ac2-4d31-8544-a460c0f7b636 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:35:05.600664 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 51/101] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:05.606741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03be9fb-c67f-4029-8393-c7fb962dedc3 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:05.615825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03be9fb-c67f-4029-8393-c7fb962dedc3 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:05.619920 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401d84f-8f9b-4b29-9f54-ed7d5500525f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E1XwO4xoSVuBK-845T_llA, audit_chain_id=['E1XwO4xoSVuBK-845T_llA']) at 0x7fe09e212460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:05.620527 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401d84f-8f9b-4b29-9f54-ed7d5500525f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:05.620821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401d84f-8f9b-4b29-9f54-ed7d5500525f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:05.621104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401d84f-8f9b-4b29-9f54-ed7d5500525f admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:05.621818 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401d84f-8f9b-4b29-9f54-ed7d5500525f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:05.622121 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401d84f-8f9b-4b29-9f54-ed7d5500525f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:05.623788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401d84f-8f9b-4b29-9f54-ed7d5500525f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:05.634444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 51/102] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:05.640205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4acc23-3ac2-4d31-8544-a460c0f7b636 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:05.649910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4acc23-3ac2-4d31-8544-a460c0f7b636 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:05.654127 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b975d-963b-44c5-b40f-b0360ea3a326 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E1XwO4xoSVuBK-845T_llA, audit_chain_id=['E1XwO4xoSVuBK-845T_llA']) at 0x7fe09e1b0130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:05.654939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b975d-963b-44c5-b40f-b0360ea3a326 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:05.655280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b975d-963b-44c5-b40f-b0360ea3a326 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:05.655567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b975d-963b-44c5-b40f-b0360ea3a326 admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:05.656667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b975d-963b-44c5-b40f-b0360ea3a326 admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:05.658510 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b975d-963b-44c5-b40f-b0360ea3a326 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:05.660028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 52/103] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:05 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:05.665566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401d84f-8f9b-4b29-9f54-ed7d5500525f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:05.675757 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401d84f-8f9b-4b29-9f54-ed7d5500525f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:05.679942 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5ea0c-f55f-43f0-a751-a7b87aed96ea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E1XwO4xoSVuBK-845T_llA, audit_chain_id=['E1XwO4xoSVuBK-845T_llA']) at 0x7fe09e21b640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:05.680532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5ea0c-f55f-43f0-a751-a7b87aed96ea admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:05.680826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5ea0c-f55f-43f0-a751-a7b87aed96ea admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:05.681111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5ea0c-f55f-43f0-a751-a7b87aed96ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:05.690193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5ea0c-f55f-43f0-a751-a7b87aed96ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:05.691969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5ea0c-f55f-43f0-a751-a7b87aed96ea admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:05.700811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 52/104] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:05 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:35:05.706459 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b975d-963b-44c5-b40f-b0360ea3a326 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:05.715964 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b975d-963b-44c5-b40f-b0360ea3a326 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:05.720362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b1eb9-b8c2-4bf1-bb5f-17a468a028e9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E1XwO4xoSVuBK-845T_llA, audit_chain_id=['E1XwO4xoSVuBK-845T_llA']) at 0x7fe09e1b83d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:05.721146 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b1eb9-b8c2-4bf1-bb5f-17a468a028e9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:05.721431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b1eb9-b8c2-4bf1-bb5f-17a468a028e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:05.721963 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b1eb9-b8c2-4bf1-bb5f-17a468a028e9 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:05.723046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b1eb9-b8c2-4bf1-bb5f-17a468a028e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:05.725125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b1eb9-b8c2-4bf1-bb5f-17a468a028e9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:05.726652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 53/105] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:05 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:05.732602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5ea0c-f55f-43f0-a751-a7b87aed96ea admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:05.741929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5ea0c-f55f-43f0-a751-a7b87aed96ea admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:05.746298 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c6e13-28a2-4409-b14b-bcb89dbfe7be admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E1XwO4xoSVuBK-845T_llA, audit_chain_id=['E1XwO4xoSVuBK-845T_llA']) at 0x7fe09e212c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:05.746895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c6e13-28a2-4409-b14b-bcb89dbfe7be admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:05.747271 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c6e13-28a2-4409-b14b-bcb89dbfe7be admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:05.747515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c6e13-28a2-4409-b14b-bcb89dbfe7be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:05.748298 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c6e13-28a2-4409-b14b-bcb89dbfe7be admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=536234568c1a477aaa466a4b57b0731f, user.id=6ab015dd8bfa4c7bab33bb2ae75070c3) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:05.748612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c6e13-28a2-4409-b14b-bcb89dbfe7be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:05.751060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c6e13-28a2-4409-b14b-bcb89dbfe7be admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:05.757284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 53/106] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:05 2022] GET /identity/v3/role_assignments?user.id=6ab015dd8bfa4c7bab33bb2ae75070c3&scope.project.id=536234568c1a477aaa466a4b57b0731f&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:08.079958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec4e3d-2449-4787-b1fb-30987356505b None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:08.080555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec4e3d-2449-4787-b1fb-30987356505b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:08.080555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec4e3d-2449-4787-b1fb-30987356505b None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:08.082221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 54/107] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:08.088116 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50191250-0c59-4560-8105-ec5117eb6537 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:08.088601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50191250-0c59-4560-8105-ec5117eb6537 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:08.088681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50191250-0c59-4560-8105-ec5117eb6537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:08.112924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-50191250-0c59-4560-8105-ec5117eb6537 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:08.114125 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-50191250-0c59-4560-8105-ec5117eb6537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:08.122136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 54/108] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:08.146745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec4e3d-2449-4787-b1fb-30987356505b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:08.160639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec4e3d-2449-4787-b1fb-30987356505b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:08.164993 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76ed09-7cd7-425c-a729-78faa2b3de26 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_aJNbxXcSS6iyOqzTGNgww, audit_chain_id=['_aJNbxXcSS6iyOqzTGNgww']) at 0x7fe09e1b8790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:08.165787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76ed09-7cd7-425c-a729-78faa2b3de26 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:08.166123 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76ed09-7cd7-425c-a729-78faa2b3de26 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:08.166464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76ed09-7cd7-425c-a729-78faa2b3de26 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:08.185455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76ed09-7cd7-425c-a729-78faa2b3de26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:08.192480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-9a76ed09-7cd7-425c-a729-78faa2b3de26 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:35:08.193783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 55/109] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:35:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:08.202119 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50191250-0c59-4560-8105-ec5117eb6537 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:08.213025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50191250-0c59-4560-8105-ec5117eb6537 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:08.217711 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184634f-3950-43fa-a31b-8dee4e6ee44c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_aJNbxXcSS6iyOqzTGNgww, audit_chain_id=['_aJNbxXcSS6iyOqzTGNgww']) at 0x7fe09e1a1460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:08.218522 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184634f-3950-43fa-a31b-8dee4e6ee44c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:08.219516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184634f-3950-43fa-a31b-8dee4e6ee44c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:08.220032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184634f-3950-43fa-a31b-8dee4e6ee44c admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:08.220796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184634f-3950-43fa-a31b-8dee4e6ee44c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:08.221106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184634f-3950-43fa-a31b-8dee4e6ee44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:08.223254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184634f-3950-43fa-a31b-8dee4e6ee44c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:08.236013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 55/110] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:35:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:08.244798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76ed09-7cd7-425c-a729-78faa2b3de26 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:08.255583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76ed09-7cd7-425c-a729-78faa2b3de26 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:08.259844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00092294-aca6-4687-a922-6eee05c89fe6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_aJNbxXcSS6iyOqzTGNgww, audit_chain_id=['_aJNbxXcSS6iyOqzTGNgww']) at 0x7fe09e1c2700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:08.260671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00092294-aca6-4687-a922-6eee05c89fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:08.260965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00092294-aca6-4687-a922-6eee05c89fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:08.261255 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00092294-aca6-4687-a922-6eee05c89fe6 admin admin] PATH_INFO: `/v3/users/e3f706901c1d4191ada8dd10650391b6` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:08.262420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00092294-aca6-4687-a922-6eee05c89fe6 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3f706901c1d4191ada8dd10650391b6)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:08.264627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00092294-aca6-4687-a922-6eee05c89fe6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:08.266791 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 56/111] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:08 2022] GET /identity/v3/users/e3f706901c1d4191ada8dd10650391b6 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:08.272729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184634f-3950-43fa-a31b-8dee4e6ee44c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:08.283187 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184634f-3950-43fa-a31b-8dee4e6ee44c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:08.287774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c5989-d394-46e3-85f6-7b21440a40d5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_aJNbxXcSS6iyOqzTGNgww, audit_chain_id=['_aJNbxXcSS6iyOqzTGNgww']) at 0x7fe09e1a1670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:08.288431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5989-d394-46e3-85f6-7b21440a40d5 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:08.288766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5989-d394-46e3-85f6-7b21440a40d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:08.289091 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5989-d394-46e3-85f6-7b21440a40d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:08.299405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c5989-d394-46e3-85f6-7b21440a40d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:08.301227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c5989-d394-46e3-85f6-7b21440a40d5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:08.311374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 56/112] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:35:08.325891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00092294-aca6-4687-a922-6eee05c89fe6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:08.337878 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00092294-aca6-4687-a922-6eee05c89fe6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:08.342445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa4e77-8033-44cc-9c87-75f393d0c0f0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_aJNbxXcSS6iyOqzTGNgww, audit_chain_id=['_aJNbxXcSS6iyOqzTGNgww']) at 0x7fe09e1b05e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:08.343292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa4e77-8033-44cc-9c87-75f393d0c0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:08.343622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa4e77-8033-44cc-9c87-75f393d0c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:08.343903 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa4e77-8033-44cc-9c87-75f393d0c0f0 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:08.345213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa4e77-8033-44cc-9c87-75f393d0c0f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:08.347616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa4e77-8033-44cc-9c87-75f393d0c0f0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:08.349250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 57/113] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:08 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:08.355854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c5989-d394-46e3-85f6-7b21440a40d5 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:08.368729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c5989-d394-46e3-85f6-7b21440a40d5 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:08.374359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaafddd-a578-4a98-b9b6-491ad9af6105 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_aJNbxXcSS6iyOqzTGNgww, audit_chain_id=['_aJNbxXcSS6iyOqzTGNgww']) at 0x7fe09e19b910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:08.376021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaafddd-a578-4a98-b9b6-491ad9af6105 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:08.376430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaafddd-a578-4a98-b9b6-491ad9af6105 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:08.376840 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaafddd-a578-4a98-b9b6-491ad9af6105 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:08.378019 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaafddd-a578-4a98-b9b6-491ad9af6105 admin admin] RBAC: Adding query filter params (role.id=5fae8096df3e470085794883a1631067, scope.project.id=536234568c1a477aaa466a4b57b0731f, user.id=e3f706901c1d4191ada8dd10650391b6) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:08.378451 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaafddd-a578-4a98-b9b6-491ad9af6105 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:08.381288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaafddd-a578-4a98-b9b6-491ad9af6105 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:08.389847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 57/114] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:08 2022] GET /identity/v3/role_assignments?user.id=e3f706901c1d4191ada8dd10650391b6&scope.project.id=536234568c1a477aaa466a4b57b0731f&role.id=5fae8096df3e470085794883a1631067 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:10.527593 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811d86-7481-458a-90e8-11de0e7291ad None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:10.528119 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811d86-7481-458a-90e8-11de0e7291ad None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:10.528203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811d86-7481-458a-90e8-11de0e7291ad None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:10.529807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 58/115] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:10.536045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039fc57-38ba-4d7d-adfe-ca5f7f7835f1 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:10.536468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039fc57-38ba-4d7d-adfe-ca5f7f7835f1 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:10.536628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039fc57-38ba-4d7d-adfe-ca5f7f7835f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:10.558831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-8039fc57-38ba-4d7d-adfe-ca5f7f7835f1 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:10.560112 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8039fc57-38ba-4d7d-adfe-ca5f7f7835f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:10.567686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 58/116] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:10 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:10.591407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74811d86-7481-458a-90e8-11de0e7291ad None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:10.605055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74811d86-7481-458a-90e8-11de0e7291ad None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:10.610417 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3791f-9144-44c8-bfb8-c2b1ce31a5d9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSyvn2gDQQKkoKFdNexoHw, audit_chain_id=['lSyvn2gDQQKkoKFdNexoHw']) at 0x7fe09e1b0700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:10.611189 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3791f-9144-44c8-bfb8-c2b1ce31a5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:10.611487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3791f-9144-44c8-bfb8-c2b1ce31a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:10.611821 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3791f-9144-44c8-bfb8-c2b1ce31a5d9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:10.623368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3791f-9144-44c8-bfb8-c2b1ce31a5d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:10.630607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-8fc3791f-9144-44c8-bfb8-c2b1ce31a5d9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:35:10.631774 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 59/117] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:35:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:10.637723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039fc57-38ba-4d7d-adfe-ca5f7f7835f1 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:10.646963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039fc57-38ba-4d7d-adfe-ca5f7f7835f1 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:10.651346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bb6bb-32e7-4a17-91ee-cfb03c95a15e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSyvn2gDQQKkoKFdNexoHw, audit_chain_id=['lSyvn2gDQQKkoKFdNexoHw']) at 0x7fe09e13f8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:10.651969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bb6bb-32e7-4a17-91ee-cfb03c95a15e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:10.652264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bb6bb-32e7-4a17-91ee-cfb03c95a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:10.652554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bb6bb-32e7-4a17-91ee-cfb03c95a15e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:10.653278 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bb6bb-32e7-4a17-91ee-cfb03c95a15e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:10.653585 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bb6bb-32e7-4a17-91ee-cfb03c95a15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:10.655240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bb6bb-32e7-4a17-91ee-cfb03c95a15e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:10.664755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 59/118] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:35:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:10.670381 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3791f-9144-44c8-bfb8-c2b1ce31a5d9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:10.680974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3791f-9144-44c8-bfb8-c2b1ce31a5d9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:10.685194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c1697-6693-4d00-ac79-6c87625d449f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSyvn2gDQQKkoKFdNexoHw, audit_chain_id=['lSyvn2gDQQKkoKFdNexoHw']) at 0x7fe09e1c2820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:10.685982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c1697-6693-4d00-ac79-6c87625d449f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:10.686275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c1697-6693-4d00-ac79-6c87625d449f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:10.686564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c1697-6693-4d00-ac79-6c87625d449f admin admin] PATH_INFO: `/v3/users/e3f706901c1d4191ada8dd10650391b6` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:10.688013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c1697-6693-4d00-ac79-6c87625d449f admin admin] RBAC: Authorizing `identity:get_user(user_id=e3f706901c1d4191ada8dd10650391b6)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:10.690150 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c1697-6693-4d00-ac79-6c87625d449f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:10.691660 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 60/119] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:10 2022] GET /identity/v3/users/e3f706901c1d4191ada8dd10650391b6 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:10.697905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bb6bb-32e7-4a17-91ee-cfb03c95a15e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:10.711485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bb6bb-32e7-4a17-91ee-cfb03c95a15e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:10.717503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cd78a-f570-4bab-b99a-7ff276685c36 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSyvn2gDQQKkoKFdNexoHw, audit_chain_id=['lSyvn2gDQQKkoKFdNexoHw']) at 0x7fe09e1c0b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:10.718991 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd78a-f570-4bab-b99a-7ff276685c36 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:10.719323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd78a-f570-4bab-b99a-7ff276685c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:10.719621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd78a-f570-4bab-b99a-7ff276685c36 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:10.720896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cd78a-f570-4bab-b99a-7ff276685c36 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:10.723376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cd78a-f570-4bab-b99a-7ff276685c36 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:10.724968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 60/120] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:10 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:10.730776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c1697-6693-4d00-ac79-6c87625d449f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:10.741055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c1697-6693-4d00-ac79-6c87625d449f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:10.745307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61282df-2277-4fd3-90ab-48b2eed9a35b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSyvn2gDQQKkoKFdNexoHw, audit_chain_id=['lSyvn2gDQQKkoKFdNexoHw']) at 0x7fe09e3bdeb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:10.746167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61282df-2277-4fd3-90ab-48b2eed9a35b admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:10.746464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61282df-2277-4fd3-90ab-48b2eed9a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:10.746757 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61282df-2277-4fd3-90ab-48b2eed9a35b admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f/users/e3f706901c1d4191ada8dd10650391b6/roles/5fae8096df3e470085794883a1631067` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:10.748912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61282df-2277-4fd3-90ab-48b2eed9a35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=536234568c1a477aaa466a4b57b0731f, user_id=e3f706901c1d4191ada8dd10650391b6, role_id=5fae8096df3e470085794883a1631067)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:10.751823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61282df-2277-4fd3-90ab-48b2eed9a35b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:10.827459 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 61/121] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:35:10 2022] PUT /identity/v3/projects/536234568c1a477aaa466a4b57b0731f/users/e3f706901c1d4191ada8dd10650391b6/roles/5fae8096df3e470085794883a1631067 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:35:12.957593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943681e-3ca1-406d-bc55-59179f6a95d3 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:12.957962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943681e-3ca1-406d-bc55-59179f6a95d3 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:12.957962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943681e-3ca1-406d-bc55-59179f6a95d3 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:12.959638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 61/122] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:12.964941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdbaa-46d2-4dbc-a9b1-6c3e720842e8 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:12.965384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdbaa-46d2-4dbc-a9b1-6c3e720842e8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:12.965515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdbaa-46d2-4dbc-a9b1-6c3e720842e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:12.988865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-9c5bdbaa-46d2-4dbc-a9b1-6c3e720842e8 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:12.990003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9c5bdbaa-46d2-4dbc-a9b1-6c3e720842e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:13.053813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 62/123] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:12 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:13.076893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943681e-3ca1-406d-bc55-59179f6a95d3 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:13.088777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943681e-3ca1-406d-bc55-59179f6a95d3 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:13.092794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839bbc-0234-4e2a-88cd-694071789548 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KNOgiAF8S0esVJl6lbMoZw, audit_chain_id=['KNOgiAF8S0esVJl6lbMoZw']) at 0x7fe09e4f3460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:13.094054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839bbc-0234-4e2a-88cd-694071789548 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:13.094342 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839bbc-0234-4e2a-88cd-694071789548 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:13.094626 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839bbc-0234-4e2a-88cd-694071789548 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:13.106198 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81839bbc-0234-4e2a-88cd-694071789548 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:13.113535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-81839bbc-0234-4e2a-88cd-694071789548 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:35:13.114647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 62/124] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:35:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:13.120480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bdbaa-46d2-4dbc-a9b1-6c3e720842e8 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:13.129410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bdbaa-46d2-4dbc-a9b1-6c3e720842e8 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:13.133553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317759-6e75-43d0-b1b6-245b2d973b66 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KNOgiAF8S0esVJl6lbMoZw, audit_chain_id=['KNOgiAF8S0esVJl6lbMoZw']) at 0x7fe09e1b8970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:13.134148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317759-6e75-43d0-b1b6-245b2d973b66 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:13.134444 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317759-6e75-43d0-b1b6-245b2d973b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:13.134738 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317759-6e75-43d0-b1b6-245b2d973b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:13.135489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba317759-6e75-43d0-b1b6-245b2d973b66 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:13.135797 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba317759-6e75-43d0-b1b6-245b2d973b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:13.137402 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba317759-6e75-43d0-b1b6-245b2d973b66 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:13.146599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 63/125] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:35:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:13.152063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839bbc-0234-4e2a-88cd-694071789548 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:13.161839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839bbc-0234-4e2a-88cd-694071789548 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:13.165840 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121214a7-31ef-4b82-bf44-642ce8d0ddeb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KNOgiAF8S0esVJl6lbMoZw, audit_chain_id=['KNOgiAF8S0esVJl6lbMoZw']) at 0x7fe09e19b310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:13.166658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121214a7-31ef-4b82-bf44-642ce8d0ddeb admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:13.166942 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121214a7-31ef-4b82-bf44-642ce8d0ddeb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:13.167254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121214a7-31ef-4b82-bf44-642ce8d0ddeb admin admin] PATH_INFO: `/v3/users/e3f706901c1d4191ada8dd10650391b6` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:13.168355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121214a7-31ef-4b82-bf44-642ce8d0ddeb admin admin] RBAC: Authorizing `identity:get_user(user_id=e3f706901c1d4191ada8dd10650391b6)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:13.170489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121214a7-31ef-4b82-bf44-642ce8d0ddeb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:13.172077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 63/126] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:13 2022] GET /identity/v3/users/e3f706901c1d4191ada8dd10650391b6 => generated 275 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:13.177253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317759-6e75-43d0-b1b6-245b2d973b66 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:13.186394 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317759-6e75-43d0-b1b6-245b2d973b66 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:13.190802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca88e8-86b0-4b1a-9e4d-f5f6f8417862 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KNOgiAF8S0esVJl6lbMoZw, audit_chain_id=['KNOgiAF8S0esVJl6lbMoZw']) at 0x7fe09e188f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:13.191409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca88e8-86b0-4b1a-9e4d-f5f6f8417862 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:13.191701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca88e8-86b0-4b1a-9e4d-f5f6f8417862 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:13.191986 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca88e8-86b0-4b1a-9e4d-f5f6f8417862 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:13.199611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca88e8-86b0-4b1a-9e4d-f5f6f8417862 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:13.201353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca88e8-86b0-4b1a-9e4d-f5f6f8417862 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:13.210414 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 64/127] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:13 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:35:13.215919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121214a7-31ef-4b82-bf44-642ce8d0ddeb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:13.225953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121214a7-31ef-4b82-bf44-642ce8d0ddeb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:13.229952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db5bfb-4b7a-4999-b817-3c83151e9a92 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KNOgiAF8S0esVJl6lbMoZw, audit_chain_id=['KNOgiAF8S0esVJl6lbMoZw']) at 0x7fe09e194cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:13.230718 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db5bfb-4b7a-4999-b817-3c83151e9a92 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:13.231009 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db5bfb-4b7a-4999-b817-3c83151e9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:13.231334 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db5bfb-4b7a-4999-b817-3c83151e9a92 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:13.232410 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db5bfb-4b7a-4999-b817-3c83151e9a92 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:13.234483 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db5bfb-4b7a-4999-b817-3c83151e9a92 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:13.236055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 64/128] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:13 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:13.241748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca88e8-86b0-4b1a-9e4d-f5f6f8417862 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:13.251021 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca88e8-86b0-4b1a-9e4d-f5f6f8417862 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:13.255420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04065a45-f058-431d-890b-7252837b9bf9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KNOgiAF8S0esVJl6lbMoZw, audit_chain_id=['KNOgiAF8S0esVJl6lbMoZw']) at 0x7fe09e1b87f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:13.255998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065a45-f058-431d-890b-7252837b9bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:13.256294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065a45-f058-431d-890b-7252837b9bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:13.256586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065a45-f058-431d-890b-7252837b9bf9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:13.257358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04065a45-f058-431d-890b-7252837b9bf9 admin admin] RBAC: Adding query filter params (role.id=5fae8096df3e470085794883a1631067, scope.project.id=536234568c1a477aaa466a4b57b0731f, user.id=e3f706901c1d4191ada8dd10650391b6) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:13.257669 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04065a45-f058-431d-890b-7252837b9bf9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:13.259602 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04065a45-f058-431d-890b-7252837b9bf9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:13.266632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 65/129] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:13 2022] GET /identity/v3/role_assignments?user.id=e3f706901c1d4191ada8dd10650391b6&scope.project.id=536234568c1a477aaa466a4b57b0731f&role.id=5fae8096df3e470085794883a1631067 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:15.574001 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae92a-9cb0-44fe-9f7d-7116178369a6 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:15.574554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae92a-9cb0-44fe-9f7d-7116178369a6 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:15.574554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae92a-9cb0-44fe-9f7d-7116178369a6 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:15.576272 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 65/130] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:15.582063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad366d6-df82-4f58-902a-9c9188c103b9 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:15.582443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad366d6-df82-4f58-902a-9c9188c103b9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:15.582669 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad366d6-df82-4f58-902a-9c9188c103b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:15.605114 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-2ad366d6-df82-4f58-902a-9c9188c103b9 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:15.606269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-2ad366d6-df82-4f58-902a-9c9188c103b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:15.613834 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 66/131] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:15 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:15.637586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae92a-9cb0-44fe-9f7d-7116178369a6 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:15.649830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae92a-9cb0-44fe-9f7d-7116178369a6 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:15.653794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868d9fd-bb99-4646-849a-6ac525d38ad8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dLMmlBexRySaZRiG_PIa5w, audit_chain_id=['dLMmlBexRySaZRiG_PIa5w']) at 0x7fe09e1940a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:15.654516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868d9fd-bb99-4646-849a-6ac525d38ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:15.654811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868d9fd-bb99-4646-849a-6ac525d38ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:15.655102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868d9fd-bb99-4646-849a-6ac525d38ad8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:15.666624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868d9fd-bb99-4646-849a-6ac525d38ad8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:15.673036 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-4868d9fd-bb99-4646-849a-6ac525d38ad8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:35:15.674134 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 66/132] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:15.680201 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad366d6-df82-4f58-902a-9c9188c103b9 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:15.689006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad366d6-df82-4f58-902a-9c9188c103b9 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:15.693054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c9c7-c831-4c2c-b8fe-6db348533be2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dLMmlBexRySaZRiG_PIa5w, audit_chain_id=['dLMmlBexRySaZRiG_PIa5w']) at 0x7fe09e1df5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:15.693646 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c9c7-c831-4c2c-b8fe-6db348533be2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:15.693936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c9c7-c831-4c2c-b8fe-6db348533be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:15.694217 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c9c7-c831-4c2c-b8fe-6db348533be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:15.694935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c9c7-c831-4c2c-b8fe-6db348533be2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:15.695272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c9c7-c831-4c2c-b8fe-6db348533be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:15.696863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c9c7-c831-4c2c-b8fe-6db348533be2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:15.705902 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 67/133] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:15.711539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868d9fd-bb99-4646-849a-6ac525d38ad8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:15.724307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868d9fd-bb99-4646-849a-6ac525d38ad8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:15.728406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f004e2-b203-49c5-9b99-f379a10c03dc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dLMmlBexRySaZRiG_PIa5w, audit_chain_id=['dLMmlBexRySaZRiG_PIa5w']) at 0x7fe09e14e0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:15.729188 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f004e2-b203-49c5-9b99-f379a10c03dc admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:15.729478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f004e2-b203-49c5-9b99-f379a10c03dc admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:15.729759 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f004e2-b203-49c5-9b99-f379a10c03dc admin admin] PATH_INFO: `/v3/users/e3f706901c1d4191ada8dd10650391b6` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:15.730849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f004e2-b203-49c5-9b99-f379a10c03dc admin admin] RBAC: Authorizing `identity:get_user(user_id=e3f706901c1d4191ada8dd10650391b6)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:15.733132 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f004e2-b203-49c5-9b99-f379a10c03dc admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:15.734609 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 67/134] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:15 2022] GET /identity/v3/users/e3f706901c1d4191ada8dd10650391b6 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:35:15.740194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c9c7-c831-4c2c-b8fe-6db348533be2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:15.749763 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c9c7-c831-4c2c-b8fe-6db348533be2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:15.753830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d37c2d-12d8-4388-8d9a-c75cfd882561 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dLMmlBexRySaZRiG_PIa5w, audit_chain_id=['dLMmlBexRySaZRiG_PIa5w']) at 0x7fe09e1b8610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:15.754404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d37c2d-12d8-4388-8d9a-c75cfd882561 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:15.754694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d37c2d-12d8-4388-8d9a-c75cfd882561 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:15.754978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d37c2d-12d8-4388-8d9a-c75cfd882561 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:15.762567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d37c2d-12d8-4388-8d9a-c75cfd882561 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:15.764339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d37c2d-12d8-4388-8d9a-c75cfd882561 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:15.773143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 68/135] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:15 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:35:15.778445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f004e2-b203-49c5-9b99-f379a10c03dc admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:15.788481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f004e2-b203-49c5-9b99-f379a10c03dc admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:15.792454 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb1109-5a26-4ddf-8f6e-c3226f564535 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dLMmlBexRySaZRiG_PIa5w, audit_chain_id=['dLMmlBexRySaZRiG_PIa5w']) at 0x7fe09e143f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:15.793221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb1109-5a26-4ddf-8f6e-c3226f564535 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:15.793510 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb1109-5a26-4ddf-8f6e-c3226f564535 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:15.793792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb1109-5a26-4ddf-8f6e-c3226f564535 admin admin] PATH_INFO: `/v3/projects/ac76409d077b47e09b22f91e992c58e0` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:15.795007 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb1109-5a26-4ddf-8f6e-c3226f564535 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac76409d077b47e09b22f91e992c58e0)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:15.797261 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb1109-5a26-4ddf-8f6e-c3226f564535 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:15.798747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 68/136] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:15 2022] GET /identity/v3/projects/ac76409d077b47e09b22f91e992c58e0 => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:15.804427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d37c2d-12d8-4388-8d9a-c75cfd882561 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:15.813598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d37c2d-12d8-4388-8d9a-c75cfd882561 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:15.817942 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a2597-c999-4315-8994-3405d0c39989 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dLMmlBexRySaZRiG_PIa5w, audit_chain_id=['dLMmlBexRySaZRiG_PIa5w']) at 0x7fe09e1fbb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:15.818517 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a2597-c999-4315-8994-3405d0c39989 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:15.818806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a2597-c999-4315-8994-3405d0c39989 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:15.819088 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a2597-c999-4315-8994-3405d0c39989 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:15.819926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a2597-c999-4315-8994-3405d0c39989 admin admin] RBAC: Adding query filter params (role.id=ddd473dfc0884753855419d1711fd868, scope.project.id=ac76409d077b47e09b22f91e992c58e0, user.id=e3f706901c1d4191ada8dd10650391b6) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:15.820233 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a2597-c999-4315-8994-3405d0c39989 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:15.822058 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a2597-c999-4315-8994-3405d0c39989 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:15.828129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 69/137] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:15 2022] GET /identity/v3/role_assignments?user.id=e3f706901c1d4191ada8dd10650391b6&scope.project.id=ac76409d077b47e09b22f91e992c58e0&role.id=ddd473dfc0884753855419d1711fd868 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:17.902889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878be0e-7b13-4333-abb6-6a56b34baf5e None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:17.903563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878be0e-7b13-4333-abb6-6a56b34baf5e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:17.903563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878be0e-7b13-4333-abb6-6a56b34baf5e None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:17.905124 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 69/138] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:17.910357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a18bf-0a11-44b0-9aa1-07afe51c95a9 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:17.910795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a18bf-0a11-44b0-9aa1-07afe51c95a9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:17.910900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a18bf-0a11-44b0-9aa1-07afe51c95a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:17.933278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-1a0a18bf-0a11-44b0-9aa1-07afe51c95a9 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:17.934418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1a0a18bf-0a11-44b0-9aa1-07afe51c95a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:17.941949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 70/139] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:17 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:17.963959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878be0e-7b13-4333-abb6-6a56b34baf5e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:17.976718 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878be0e-7b13-4333-abb6-6a56b34baf5e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:17.980874 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe6ae-299c-4148-93a7-e73e1f20362b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mquEEByvQ9-Mj3ThwgM1EA, audit_chain_id=['mquEEByvQ9-Mj3ThwgM1EA']) at 0x7fe09e1432b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:17.981589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe6ae-299c-4148-93a7-e73e1f20362b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:17.981885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe6ae-299c-4148-93a7-e73e1f20362b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:17.982172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afe6ae-299c-4148-93a7-e73e1f20362b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:17.994393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afe6ae-299c-4148-93a7-e73e1f20362b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:18.002214 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-c2afe6ae-299c-4148-93a7-e73e1f20362b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:35:18.003341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 70/140] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:18.009267 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a18bf-0a11-44b0-9aa1-07afe51c95a9 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:18.018573 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a18bf-0a11-44b0-9aa1-07afe51c95a9 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:18.022572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed95dc-d50a-4ea9-9272-30c4c0513838 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mquEEByvQ9-Mj3ThwgM1EA, audit_chain_id=['mquEEByvQ9-Mj3ThwgM1EA']) at 0x7fe09e1df2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:18.023195 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed95dc-d50a-4ea9-9272-30c4c0513838 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:18.023486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed95dc-d50a-4ea9-9272-30c4c0513838 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:18.023769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed95dc-d50a-4ea9-9272-30c4c0513838 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:18.024474 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed95dc-d50a-4ea9-9272-30c4c0513838 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:18.024773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed95dc-d50a-4ea9-9272-30c4c0513838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:18.026394 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed95dc-d50a-4ea9-9272-30c4c0513838 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:18.035599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 71/141] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:18.040997 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe6ae-299c-4148-93a7-e73e1f20362b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:18.051992 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afe6ae-299c-4148-93a7-e73e1f20362b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:18.056094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617494f-3d17-4941-8f11-21590c400f54 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mquEEByvQ9-Mj3ThwgM1EA, audit_chain_id=['mquEEByvQ9-Mj3ThwgM1EA']) at 0x7fe09e1a16d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:18.056881 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617494f-3d17-4941-8f11-21590c400f54 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:18.057177 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617494f-3d17-4941-8f11-21590c400f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:18.057579 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617494f-3d17-4941-8f11-21590c400f54 admin admin] PATH_INFO: `/v3/users/e3f706901c1d4191ada8dd10650391b6` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:18.058606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617494f-3d17-4941-8f11-21590c400f54 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3f706901c1d4191ada8dd10650391b6)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:18.060810 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617494f-3d17-4941-8f11-21590c400f54 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:18.062875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 71/142] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:18 2022] GET /identity/v3/users/e3f706901c1d4191ada8dd10650391b6 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:18.069584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed95dc-d50a-4ea9-9272-30c4c0513838 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:18.078970 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed95dc-d50a-4ea9-9272-30c4c0513838 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:18.082949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a5110-1751-48a2-ae26-704fc345355b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mquEEByvQ9-Mj3ThwgM1EA, audit_chain_id=['mquEEByvQ9-Mj3ThwgM1EA']) at 0x7fe09e1dfac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:18.083752 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a5110-1751-48a2-ae26-704fc345355b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:18.084043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a5110-1751-48a2-ae26-704fc345355b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:18.084332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a5110-1751-48a2-ae26-704fc345355b admin admin] PATH_INFO: `/v3/projects/ac76409d077b47e09b22f91e992c58e0` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:18.085445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a5110-1751-48a2-ae26-704fc345355b admin admin] RBAC: Authorizing `identity:get_project(project_id=ac76409d077b47e09b22f91e992c58e0)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:18.087505 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a5110-1751-48a2-ae26-704fc345355b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:18.088983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 72/143] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:18 2022] GET /identity/v3/projects/ac76409d077b47e09b22f91e992c58e0 => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:18.095012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617494f-3d17-4941-8f11-21590c400f54 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:18.104646 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617494f-3d17-4941-8f11-21590c400f54 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:18.108703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dae302-feec-4837-ba9b-c3167f57cfd6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mquEEByvQ9-Mj3ThwgM1EA, audit_chain_id=['mquEEByvQ9-Mj3ThwgM1EA']) at 0x7fe09e1a1130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:18.110107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dae302-feec-4837-ba9b-c3167f57cfd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:18.110393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dae302-feec-4837-ba9b-c3167f57cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:18.110676 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dae302-feec-4837-ba9b-c3167f57cfd6 admin admin] PATH_INFO: `/v3/projects/ac76409d077b47e09b22f91e992c58e0/users/e3f706901c1d4191ada8dd10650391b6/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:18.112491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dae302-feec-4837-ba9b-c3167f57cfd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac76409d077b47e09b22f91e992c58e0, user_id=e3f706901c1d4191ada8dd10650391b6, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:18.115138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dae302-feec-4837-ba9b-c3167f57cfd6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:18.197806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 72/144] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:35:18 2022] PUT /identity/v3/projects/ac76409d077b47e09b22f91e992c58e0/users/e3f706901c1d4191ada8dd10650391b6/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:35:20.315896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30208b1-f16b-4302-8b3e-41704ff54c85 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:20.316415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30208b1-f16b-4302-8b3e-41704ff54c85 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:20.316415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30208b1-f16b-4302-8b3e-41704ff54c85 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:20.318111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 73/145] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:20.323417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658970ea-6121-47da-ac76-7e8d19ce2556 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:20.323865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658970ea-6121-47da-ac76-7e8d19ce2556 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:20.323865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658970ea-6121-47da-ac76-7e8d19ce2556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:20.346736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-658970ea-6121-47da-ac76-7e8d19ce2556 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:20.347938 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-658970ea-6121-47da-ac76-7e8d19ce2556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:20.412777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 73/146] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:20.435431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30208b1-f16b-4302-8b3e-41704ff54c85 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:20.447819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30208b1-f16b-4302-8b3e-41704ff54c85 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:20.451934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d3d6-e950-420f-b5df-d33f497d82b3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ek0PB0K7RO2MZb0dHxK_4g, audit_chain_id=['Ek0PB0K7RO2MZb0dHxK_4g']) at 0x7fe09e1df610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:20.453216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d3d6-e950-420f-b5df-d33f497d82b3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:20.453550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d3d6-e950-420f-b5df-d33f497d82b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:20.453839 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d3d6-e950-420f-b5df-d33f497d82b3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:20.465548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037d3d6-e950-420f-b5df-d33f497d82b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:20.472384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-1037d3d6-e950-420f-b5df-d33f497d82b3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:35:20.473484 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 74/147] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:20.479551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658970ea-6121-47da-ac76-7e8d19ce2556 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:20.488327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658970ea-6121-47da-ac76-7e8d19ce2556 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:20.492439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8021da-14b9-4df2-a482-298dd2ec14d8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ek0PB0K7RO2MZb0dHxK_4g, audit_chain_id=['Ek0PB0K7RO2MZb0dHxK_4g']) at 0x7fe09e1c0e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:20.493041 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8021da-14b9-4df2-a482-298dd2ec14d8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:20.493336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8021da-14b9-4df2-a482-298dd2ec14d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:20.493626 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8021da-14b9-4df2-a482-298dd2ec14d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:20.494341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8021da-14b9-4df2-a482-298dd2ec14d8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:20.494647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8021da-14b9-4df2-a482-298dd2ec14d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:20.496290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8021da-14b9-4df2-a482-298dd2ec14d8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:20.506004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 74/148] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:35:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:20.511478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d3d6-e950-420f-b5df-d33f497d82b3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:20.521517 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d3d6-e950-420f-b5df-d33f497d82b3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:20.525609 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7dcc6-0f3d-45ca-b4fb-c432a5a93a90 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ek0PB0K7RO2MZb0dHxK_4g, audit_chain_id=['Ek0PB0K7RO2MZb0dHxK_4g']) at 0x7fe09e204220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:20.526405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7dcc6-0f3d-45ca-b4fb-c432a5a93a90 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:20.526697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7dcc6-0f3d-45ca-b4fb-c432a5a93a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:20.526983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7dcc6-0f3d-45ca-b4fb-c432a5a93a90 admin admin] PATH_INFO: `/v3/users/e3f706901c1d4191ada8dd10650391b6` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:20.528128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7dcc6-0f3d-45ca-b4fb-c432a5a93a90 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3f706901c1d4191ada8dd10650391b6)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:20.530260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7dcc6-0f3d-45ca-b4fb-c432a5a93a90 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:20.531784 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 75/149] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:20 2022] GET /identity/v3/users/e3f706901c1d4191ada8dd10650391b6 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:20.537104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8021da-14b9-4df2-a482-298dd2ec14d8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:20.546627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8021da-14b9-4df2-a482-298dd2ec14d8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:20.550682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25e595-62ea-41b7-973b-74679bd4bb70 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ek0PB0K7RO2MZb0dHxK_4g, audit_chain_id=['Ek0PB0K7RO2MZb0dHxK_4g']) at 0x7fe09e4f3220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:20.551295 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25e595-62ea-41b7-973b-74679bd4bb70 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:20.551592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25e595-62ea-41b7-973b-74679bd4bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:20.551918 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25e595-62ea-41b7-973b-74679bd4bb70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:20.560107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25e595-62ea-41b7-973b-74679bd4bb70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:20.562431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25e595-62ea-41b7-973b-74679bd4bb70 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:20.570947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 75/150] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:20 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:35:20.576581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7dcc6-0f3d-45ca-b4fb-c432a5a93a90 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:20.586754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7dcc6-0f3d-45ca-b4fb-c432a5a93a90 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:20.590845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c2c4c-aad2-4a1e-8a57-aaa4b876986d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ek0PB0K7RO2MZb0dHxK_4g, audit_chain_id=['Ek0PB0K7RO2MZb0dHxK_4g']) at 0x7fe09e2045b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:20.591660 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c2c4c-aad2-4a1e-8a57-aaa4b876986d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:20.591952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c2c4c-aad2-4a1e-8a57-aaa4b876986d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:20.592238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c2c4c-aad2-4a1e-8a57-aaa4b876986d admin admin] PATH_INFO: `/v3/projects/ac76409d077b47e09b22f91e992c58e0` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:20.593540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c2c4c-aad2-4a1e-8a57-aaa4b876986d admin admin] RBAC: Authorizing `identity:get_project(project_id=ac76409d077b47e09b22f91e992c58e0)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:20.595635 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c2c4c-aad2-4a1e-8a57-aaa4b876986d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:20.597407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 76/151] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:20 2022] GET /identity/v3/projects/ac76409d077b47e09b22f91e992c58e0 => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:20.603186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25e595-62ea-41b7-973b-74679bd4bb70 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:20.612004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25e595-62ea-41b7-973b-74679bd4bb70 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:20.616077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d396-3a87-4e65-a027-dfdcf3e3d6fa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ek0PB0K7RO2MZb0dHxK_4g, audit_chain_id=['Ek0PB0K7RO2MZb0dHxK_4g']) at 0x7fe09e7057c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:20.616663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d396-3a87-4e65-a027-dfdcf3e3d6fa admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:20.616960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d396-3a87-4e65-a027-dfdcf3e3d6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:20.617263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d396-3a87-4e65-a027-dfdcf3e3d6fa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:20.618039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d396-3a87-4e65-a027-dfdcf3e3d6fa admin admin] RBAC: Adding query filter params (role.id=ddd473dfc0884753855419d1711fd868, scope.project.id=ac76409d077b47e09b22f91e992c58e0, user.id=e3f706901c1d4191ada8dd10650391b6) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:20.618346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d396-3a87-4e65-a027-dfdcf3e3d6fa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:20.620231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d396-3a87-4e65-a027-dfdcf3e3d6fa admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:20.626500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 76/152] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:20 2022] GET /identity/v3/role_assignments?user.id=e3f706901c1d4191ada8dd10650391b6&scope.project.id=ac76409d077b47e09b22f91e992c58e0&role.id=ddd473dfc0884753855419d1711fd868 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:22.772512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3029c-e3bc-4d4e-bebd-14924edbfc6d None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:22.773061 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3029c-e3bc-4d4e-bebd-14924edbfc6d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:22.773061 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3029c-e3bc-4d4e-bebd-14924edbfc6d None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:22.774766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 77/153] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:22.779902 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63b77-b490-4f94-bda7-949211125e25 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:22.780346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63b77-b490-4f94-bda7-949211125e25 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:22.780871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63b77-b490-4f94-bda7-949211125e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:22.802401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-59d63b77-b490-4f94-bda7-949211125e25 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:22.803574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-59d63b77-b490-4f94-bda7-949211125e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:22.810364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 77/154] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:22 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:22.833900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3029c-e3bc-4d4e-bebd-14924edbfc6d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:22.845629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3029c-e3bc-4d4e-bebd-14924edbfc6d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:22.849943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78562ee8-3de3-4d74-952d-6aa2de672f07 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vr2iwyFFSS2HW_kkvmJD-g, audit_chain_id=['vr2iwyFFSS2HW_kkvmJD-g']) at 0x7fe09e2049a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:22.850675 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78562ee8-3de3-4d74-952d-6aa2de672f07 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:22.850965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78562ee8-3de3-4d74-952d-6aa2de672f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:22.851281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78562ee8-3de3-4d74-952d-6aa2de672f07 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:22.852358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78562ee8-3de3-4d74-952d-6aa2de672f07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:22.854063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78562ee8-3de3-4d74-952d-6aa2de672f07 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:22.855527 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 78/155] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:35:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:22.861059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63b77-b490-4f94-bda7-949211125e25 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:22.869584 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63b77-b490-4f94-bda7-949211125e25 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:22.873741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41239b-4c59-46fb-aeea-8af1f26e172a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vr2iwyFFSS2HW_kkvmJD-g, audit_chain_id=['vr2iwyFFSS2HW_kkvmJD-g']) at 0x7fe09e143cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:22.874914 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41239b-4c59-46fb-aeea-8af1f26e172a admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:22.875245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41239b-4c59-46fb-aeea-8af1f26e172a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:22.875534 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41239b-4c59-46fb-aeea-8af1f26e172a admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:22.876179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41239b-4c59-46fb-aeea-8af1f26e172a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:22.878072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41239b-4c59-46fb-aeea-8af1f26e172a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:22.976629 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 78/156] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:35:22 2022] POST /identity/v3/projects => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:35:25.101676 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8a9a-329b-437a-8eb2-82e17212a008 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:25.102225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8a9a-329b-437a-8eb2-82e17212a008 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:25.102225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8a9a-329b-437a-8eb2-82e17212a008 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:25.104151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 79/157] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:25.109650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bcbf2-69ff-4671-b325-bf57822bf162 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:25.110093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bcbf2-69ff-4671-b325-bf57822bf162 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:25.110219 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bcbf2-69ff-4671-b325-bf57822bf162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:25.132578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-541bcbf2-69ff-4671-b325-bf57822bf162 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:25.133715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-541bcbf2-69ff-4671-b325-bf57822bf162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:25.199849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 79/158] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:25.224560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8a9a-329b-437a-8eb2-82e17212a008 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:25.237091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8a9a-329b-437a-8eb2-82e17212a008 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:25.241171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e1da0-a58d-4a17-b457-e6af6b9584f8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QNem3RjHTMe5zHnsGB6nvQ, audit_chain_id=['QNem3RjHTMe5zHnsGB6nvQ']) at 0x7fe09e204850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:25.241887 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e1da0-a58d-4a17-b457-e6af6b9584f8 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:25.242177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e1da0-a58d-4a17-b457-e6af6b9584f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:25.242456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e1da0-a58d-4a17-b457-e6af6b9584f8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:25.243570 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e1da0-a58d-4a17-b457-e6af6b9584f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:25.245250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e1da0-a58d-4a17-b457-e6af6b9584f8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:25.246709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 80/159] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:25.253268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bcbf2-69ff-4671-b325-bf57822bf162 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:25.262499 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bcbf2-69ff-4671-b325-bf57822bf162 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:25.266816 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f156fc4-ac53-4efd-b3a4-0b26f335b072 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QNem3RjHTMe5zHnsGB6nvQ, audit_chain_id=['QNem3RjHTMe5zHnsGB6nvQ']) at 0x7fe09e21e100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:25.267452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156fc4-ac53-4efd-b3a4-0b26f335b072 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:25.267742 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156fc4-ac53-4efd-b3a4-0b26f335b072 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:25.268021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156fc4-ac53-4efd-b3a4-0b26f335b072 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:25.268680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f156fc4-ac53-4efd-b3a4-0b26f335b072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:25.270614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f156fc4-ac53-4efd-b3a4-0b26f335b072 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:25.357330 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 80/160] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:35:25 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:35:27.676412 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a0698-6018-4abb-9274-32aa973056f0 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:27.676957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a0698-6018-4abb-9274-32aa973056f0 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:27.676957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a0698-6018-4abb-9274-32aa973056f0 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:27.678636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 81/161] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:27.683794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03bae6-17d1-4799-9d61-3c034dece326 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:27.684181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03bae6-17d1-4799-9d61-3c034dece326 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:27.684363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03bae6-17d1-4799-9d61-3c034dece326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:27.706935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3d03bae6-17d1-4799-9d61-3c034dece326 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:27.708184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3d03bae6-17d1-4799-9d61-3c034dece326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:27.715100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 81/162] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:27.738473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a0698-6018-4abb-9274-32aa973056f0 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:27.751138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a0698-6018-4abb-9274-32aa973056f0 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:27.755165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e0dab-4a53-4e7f-89b7-38709531f615 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=adncO4zBTnqmK2rE6DbR1g, audit_chain_id=['adncO4zBTnqmK2rE6DbR1g']) at 0x7fe09e17fc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:27.755995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e0dab-4a53-4e7f-89b7-38709531f615 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:27.756290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e0dab-4a53-4e7f-89b7-38709531f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:27.756574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e0dab-4a53-4e7f-89b7-38709531f615 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:27.768112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e0dab-4a53-4e7f-89b7-38709531f615 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:27.774410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-e21e0dab-4a53-4e7f-89b7-38709531f615 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:35:27.775512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 82/163] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:27.782041 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03bae6-17d1-4799-9d61-3c034dece326 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:27.790753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03bae6-17d1-4799-9d61-3c034dece326 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:27.794832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b29f74-0851-473f-85e2-b60d52dc1b9f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=adncO4zBTnqmK2rE6DbR1g, audit_chain_id=['adncO4zBTnqmK2rE6DbR1g']) at 0x7fe09e1a1790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:27.795462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b29f74-0851-473f-85e2-b60d52dc1b9f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:27.796448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b29f74-0851-473f-85e2-b60d52dc1b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:27.796801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b29f74-0851-473f-85e2-b60d52dc1b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:27.797514 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b29f74-0851-473f-85e2-b60d52dc1b9f admin admin] RBAC: Adding query filter params (name=member) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:27.797819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b29f74-0851-473f-85e2-b60d52dc1b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:27.799497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b29f74-0851-473f-85e2-b60d52dc1b9f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:27.808424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 82/164] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:35:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:27.814612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e0dab-4a53-4e7f-89b7-38709531f615 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:27.824040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e0dab-4a53-4e7f-89b7-38709531f615 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:27.828920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a86f9-0994-4ee9-b908-04d0cc8680fd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=adncO4zBTnqmK2rE6DbR1g, audit_chain_id=['adncO4zBTnqmK2rE6DbR1g']) at 0x7fe09e1dfaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:27.829709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a86f9-0994-4ee9-b908-04d0cc8680fd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:27.829992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a86f9-0994-4ee9-b908-04d0cc8680fd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:27.830272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a86f9-0994-4ee9-b908-04d0cc8680fd admin admin] PATH_INFO: `/v3/users/fa368b61f4ec43809f98dee2899427d4` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:27.851286 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a86f9-0994-4ee9-b908-04d0cc8680fd admin admin] RBAC: Authorizing `identity:get_user(user_id=fa368b61f4ec43809f98dee2899427d4)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:27.855424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a86f9-0994-4ee9-b908-04d0cc8680fd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:27.858265 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 83/165] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:27 2022] GET /identity/v3/users/fa368b61f4ec43809f98dee2899427d4 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:27.864486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b29f74-0851-473f-85e2-b60d52dc1b9f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:27.874239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b29f74-0851-473f-85e2-b60d52dc1b9f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:27.878251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076ff8b-ed5c-4f18-a1e2-14e682555c2b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=adncO4zBTnqmK2rE6DbR1g, audit_chain_id=['adncO4zBTnqmK2rE6DbR1g']) at 0x7fe09e2125e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:27.878828 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076ff8b-ed5c-4f18-a1e2-14e682555c2b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:27.879137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076ff8b-ed5c-4f18-a1e2-14e682555c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:27.879424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076ff8b-ed5c-4f18-a1e2-14e682555c2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:27.887467 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076ff8b-ed5c-4f18-a1e2-14e682555c2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:27.889197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076ff8b-ed5c-4f18-a1e2-14e682555c2b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:27.897848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 83/166] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:27 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:35:27.903510 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a86f9-0994-4ee9-b908-04d0cc8680fd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:27.913602 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a86f9-0994-4ee9-b908-04d0cc8680fd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:27.917924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39429a63-6731-4192-83c1-2bb938537947 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=adncO4zBTnqmK2rE6DbR1g, audit_chain_id=['adncO4zBTnqmK2rE6DbR1g']) at 0x7fe09e1fbcd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:27.918697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39429a63-6731-4192-83c1-2bb938537947 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:27.918981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39429a63-6731-4192-83c1-2bb938537947 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:27.919283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39429a63-6731-4192-83c1-2bb938537947 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:27.920362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39429a63-6731-4192-83c1-2bb938537947 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:27.923126 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39429a63-6731-4192-83c1-2bb938537947 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:27.924653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 84/167] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:27 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:35:27.930515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076ff8b-ed5c-4f18-a1e2-14e682555c2b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:27.939628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076ff8b-ed5c-4f18-a1e2-14e682555c2b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:27.943760 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685e7fe-bb1b-41a9-b50c-209d28384aa9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=adncO4zBTnqmK2rE6DbR1g, audit_chain_id=['adncO4zBTnqmK2rE6DbR1g']) at 0x7fe09e1e6610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:27.944336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685e7fe-bb1b-41a9-b50c-209d28384aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:27.944624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685e7fe-bb1b-41a9-b50c-209d28384aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:27.944911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685e7fe-bb1b-41a9-b50c-209d28384aa9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:27.945815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685e7fe-bb1b-41a9-b50c-209d28384aa9 admin admin] RBAC: Adding query filter params (role.id=ddd473dfc0884753855419d1711fd868, scope.project.id=957d6be248554f84b1624d5a66f21ae1, user.id=fa368b61f4ec43809f98dee2899427d4) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:27.945982 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685e7fe-bb1b-41a9-b50c-209d28384aa9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:27.947836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685e7fe-bb1b-41a9-b50c-209d28384aa9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:27.953337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 84/168] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:27 2022] GET /identity/v3/role_assignments?user.id=fa368b61f4ec43809f98dee2899427d4&scope.project.id=957d6be248554f84b1624d5a66f21ae1&role.id=ddd473dfc0884753855419d1711fd868 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:30.136574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62be145-f1d3-4257-be13-cc3d4d59da84 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:30.137090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62be145-f1d3-4257-be13-cc3d4d59da84 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:30.137219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62be145-f1d3-4257-be13-cc3d4d59da84 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:30.138805 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 85/169] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:30.144765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e5c44-63a9-4616-8dad-43931c40e82c None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:30.145193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e5c44-63a9-4616-8dad-43931c40e82c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:30.145341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e5c44-63a9-4616-8dad-43931c40e82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:30.167474 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-029e5c44-63a9-4616-8dad-43931c40e82c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:30.168621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-029e5c44-63a9-4616-8dad-43931c40e82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:30.175727 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 85/170] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:30 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:30.198059 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62be145-f1d3-4257-be13-cc3d4d59da84 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:30.210481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62be145-f1d3-4257-be13-cc3d4d59da84 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:30.215634 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bae979-f7a6-4e61-8333-b5e0af67e287 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rb3y9Sw7RpSyQda0RioGFQ, audit_chain_id=['rb3y9Sw7RpSyQda0RioGFQ']) at 0x7fe09e17fb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:30.216349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bae979-f7a6-4e61-8333-b5e0af67e287 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:30.216641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bae979-f7a6-4e61-8333-b5e0af67e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:30.216925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bae979-f7a6-4e61-8333-b5e0af67e287 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:30.228432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bae979-f7a6-4e61-8333-b5e0af67e287 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:30.235022 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-24bae979-f7a6-4e61-8333-b5e0af67e287 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:35:30.236155 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 86/171] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:30.241636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e5c44-63a9-4616-8dad-43931c40e82c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:30.250586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e5c44-63a9-4616-8dad-43931c40e82c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:30.254612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae2472-5645-4fc9-b22a-485ccc60f6c4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rb3y9Sw7RpSyQda0RioGFQ, audit_chain_id=['rb3y9Sw7RpSyQda0RioGFQ']) at 0x7fe09e1a1ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:30.255233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae2472-5645-4fc9-b22a-485ccc60f6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:30.255524 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae2472-5645-4fc9-b22a-485ccc60f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:30.255807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae2472-5645-4fc9-b22a-485ccc60f6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:30.256517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae2472-5645-4fc9-b22a-485ccc60f6c4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:30.256818 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae2472-5645-4fc9-b22a-485ccc60f6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:30.258576 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae2472-5645-4fc9-b22a-485ccc60f6c4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:30.267694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 86/172] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:35:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:30.273100 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bae979-f7a6-4e61-8333-b5e0af67e287 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:30.283768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bae979-f7a6-4e61-8333-b5e0af67e287 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:30.288144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040c1c-e4e0-48df-bf94-9067b6355e07 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rb3y9Sw7RpSyQda0RioGFQ, audit_chain_id=['rb3y9Sw7RpSyQda0RioGFQ']) at 0x7fe09e143e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:30.288996 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040c1c-e4e0-48df-bf94-9067b6355e07 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:30.289282 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040c1c-e4e0-48df-bf94-9067b6355e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:30.289562 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040c1c-e4e0-48df-bf94-9067b6355e07 admin admin] PATH_INFO: `/v3/users/fa368b61f4ec43809f98dee2899427d4` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:30.290709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040c1c-e4e0-48df-bf94-9067b6355e07 admin admin] RBAC: Authorizing `identity:get_user(user_id=fa368b61f4ec43809f98dee2899427d4)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:30.292994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040c1c-e4e0-48df-bf94-9067b6355e07 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:30.294447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 87/173] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:30 2022] GET /identity/v3/users/fa368b61f4ec43809f98dee2899427d4 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:30.299789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae2472-5645-4fc9-b22a-485ccc60f6c4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:30.308974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae2472-5645-4fc9-b22a-485ccc60f6c4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:30.313571 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f974d-8e19-4572-9e75-0836c1ba0117 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rb3y9Sw7RpSyQda0RioGFQ, audit_chain_id=['rb3y9Sw7RpSyQda0RioGFQ']) at 0x7fe09e21e580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:30.314502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f974d-8e19-4572-9e75-0836c1ba0117 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:30.314797 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f974d-8e19-4572-9e75-0836c1ba0117 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:30.315079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f974d-8e19-4572-9e75-0836c1ba0117 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:30.316197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f974d-8e19-4572-9e75-0836c1ba0117 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:30.318207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f974d-8e19-4572-9e75-0836c1ba0117 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:30.319745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 87/174] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:30 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:30.325234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040c1c-e4e0-48df-bf94-9067b6355e07 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:30.335776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040c1c-e4e0-48df-bf94-9067b6355e07 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:30.339890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa155b-d5c2-45b3-9d14-a034b1768ab3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rb3y9Sw7RpSyQda0RioGFQ, audit_chain_id=['rb3y9Sw7RpSyQda0RioGFQ']) at 0x7fe09e143220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:30.340693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa155b-d5c2-45b3-9d14-a034b1768ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:30.340983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa155b-d5c2-45b3-9d14-a034b1768ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:30.341299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa155b-d5c2-45b3-9d14-a034b1768ab3 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1/users/fa368b61f4ec43809f98dee2899427d4/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:30.343563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa155b-d5c2-45b3-9d14-a034b1768ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957d6be248554f84b1624d5a66f21ae1, user_id=fa368b61f4ec43809f98dee2899427d4, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:30.346448 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa155b-d5c2-45b3-9d14-a034b1768ab3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:30.437829 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 88/175] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:35:30 2022] PUT /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1/users/fa368b61f4ec43809f98dee2899427d4/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:35:32.602626 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca2df-9892-418b-b273-e2a20e2e58b6 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:32.603194 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca2df-9892-418b-b273-e2a20e2e58b6 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:32.603194 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca2df-9892-418b-b273-e2a20e2e58b6 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:32.604875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 88/176] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:32.610653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734995d-1ab9-481f-bdfc-57c00071cce8 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:32.611043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734995d-1ab9-481f-bdfc-57c00071cce8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:32.611253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734995d-1ab9-481f-bdfc-57c00071cce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:32.634739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d734995d-1ab9-481f-bdfc-57c00071cce8 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:32.635902 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d734995d-1ab9-481f-bdfc-57c00071cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:32.705110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 89/177] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:32.728520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ca2df-9892-418b-b273-e2a20e2e58b6 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:32.741359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ca2df-9892-418b-b273-e2a20e2e58b6 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:32.745443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d7cfb-d2af-4c5d-b77a-59876b31e79a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8-u8U_FYRC60WXtCEb-nIQ, audit_chain_id=['8-u8U_FYRC60WXtCEb-nIQ']) at 0x7fe09e212e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:32.746159 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d7cfb-d2af-4c5d-b77a-59876b31e79a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:32.746450 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d7cfb-d2af-4c5d-b77a-59876b31e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:32.746735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d7cfb-d2af-4c5d-b77a-59876b31e79a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:32.760155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d7cfb-d2af-4c5d-b77a-59876b31e79a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:32.766515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-b51d7cfb-d2af-4c5d-b77a-59876b31e79a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:35:32.767648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 89/178] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:32.773905 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734995d-1ab9-481f-bdfc-57c00071cce8 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:32.782526 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734995d-1ab9-481f-bdfc-57c00071cce8 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:32.786549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99816606-4fd1-43a3-97ab-cbf2e65db9ae admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8-u8U_FYRC60WXtCEb-nIQ, audit_chain_id=['8-u8U_FYRC60WXtCEb-nIQ']) at 0x7fe09e1a7a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:32.787165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99816606-4fd1-43a3-97ab-cbf2e65db9ae admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:32.787455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99816606-4fd1-43a3-97ab-cbf2e65db9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:32.787735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99816606-4fd1-43a3-97ab-cbf2e65db9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:32.788438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99816606-4fd1-43a3-97ab-cbf2e65db9ae admin admin] RBAC: Adding query filter params (name=member) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:32.788734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99816606-4fd1-43a3-97ab-cbf2e65db9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:32.790330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99816606-4fd1-43a3-97ab-cbf2e65db9ae admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:32.799291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 90/179] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:32.804650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d7cfb-d2af-4c5d-b77a-59876b31e79a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:32.814649 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d7cfb-d2af-4c5d-b77a-59876b31e79a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:32.818798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a80de8-b3bd-4964-9d5c-757caee184d1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8-u8U_FYRC60WXtCEb-nIQ, audit_chain_id=['8-u8U_FYRC60WXtCEb-nIQ']) at 0x7fe09e4f3070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:32.819618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a80de8-b3bd-4964-9d5c-757caee184d1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:32.819910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a80de8-b3bd-4964-9d5c-757caee184d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:32.820191 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a80de8-b3bd-4964-9d5c-757caee184d1 admin admin] PATH_INFO: `/v3/users/fa368b61f4ec43809f98dee2899427d4` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:32.821291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a80de8-b3bd-4964-9d5c-757caee184d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=fa368b61f4ec43809f98dee2899427d4)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:32.823478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a80de8-b3bd-4964-9d5c-757caee184d1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:32.824923 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 90/180] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:32 2022] GET /identity/v3/users/fa368b61f4ec43809f98dee2899427d4 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:35:32.830572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99816606-4fd1-43a3-97ab-cbf2e65db9ae admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:32.840130 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99816606-4fd1-43a3-97ab-cbf2e65db9ae admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:32.844342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fdf2f-619b-4110-8f2e-005d342ff386 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8-u8U_FYRC60WXtCEb-nIQ, audit_chain_id=['8-u8U_FYRC60WXtCEb-nIQ']) at 0x7fe09e1a7bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:32.845087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fdf2f-619b-4110-8f2e-005d342ff386 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:32.845289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fdf2f-619b-4110-8f2e-005d342ff386 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:32.845576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fdf2f-619b-4110-8f2e-005d342ff386 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:32.853770 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fdf2f-619b-4110-8f2e-005d342ff386 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:32.855469 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fdf2f-619b-4110-8f2e-005d342ff386 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:32.864792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 91/181] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:32 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:35:32.870457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a80de8-b3bd-4964-9d5c-757caee184d1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:32.881179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a80de8-b3bd-4964-9d5c-757caee184d1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:32.885236 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cddfed-7b11-4c1c-ab7c-efd0c25d0232 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8-u8U_FYRC60WXtCEb-nIQ, audit_chain_id=['8-u8U_FYRC60WXtCEb-nIQ']) at 0x7fe09e14af10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:32.886009 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cddfed-7b11-4c1c-ab7c-efd0c25d0232 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:32.886298 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cddfed-7b11-4c1c-ab7c-efd0c25d0232 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:32.886578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cddfed-7b11-4c1c-ab7c-efd0c25d0232 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:32.887696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cddfed-7b11-4c1c-ab7c-efd0c25d0232 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:32.890248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cddfed-7b11-4c1c-ab7c-efd0c25d0232 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:32.891858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 91/182] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:32 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:32.897490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fdf2f-619b-4110-8f2e-005d342ff386 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:32.906848 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fdf2f-619b-4110-8f2e-005d342ff386 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:32.913128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9c395-d58a-434c-b675-7e1e67ddc074 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8-u8U_FYRC60WXtCEb-nIQ, audit_chain_id=['8-u8U_FYRC60WXtCEb-nIQ']) at 0x7fe09e1a7550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:32.914066 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9c395-d58a-434c-b675-7e1e67ddc074 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:32.914542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9c395-d58a-434c-b675-7e1e67ddc074 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:32.915003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9c395-d58a-434c-b675-7e1e67ddc074 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:32.916431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9c395-d58a-434c-b675-7e1e67ddc074 admin admin] RBAC: Adding query filter params (role.id=ddd473dfc0884753855419d1711fd868, scope.project.id=957d6be248554f84b1624d5a66f21ae1, user.id=fa368b61f4ec43809f98dee2899427d4) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:32.916940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9c395-d58a-434c-b675-7e1e67ddc074 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:32.920268 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9c395-d58a-434c-b675-7e1e67ddc074 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:32.926928 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 92/183] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:32 2022] GET /identity/v3/role_assignments?user.id=fa368b61f4ec43809f98dee2899427d4&scope.project.id=957d6be248554f84b1624d5a66f21ae1&role.id=ddd473dfc0884753855419d1711fd868 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:35.184357 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab39f9-9ba8-4fa3-8cc7-2c2c36bb0c9c None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:35.184876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab39f9-9ba8-4fa3-8cc7-2c2c36bb0c9c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:35.184983 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab39f9-9ba8-4fa3-8cc7-2c2c36bb0c9c None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:35.187305 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 92/184] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:35.192678 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8b35-9949-4e40-934a-7cba94c67827 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:35.193075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8b35-9949-4e40-934a-7cba94c67827 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:35.193240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8b35-9949-4e40-934a-7cba94c67827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:35.215691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-289a8b35-9949-4e40-934a-7cba94c67827 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:35.216765 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-289a8b35-9949-4e40-934a-7cba94c67827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:35.224716 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 93/185] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:35 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:35.247803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab39f9-9ba8-4fa3-8cc7-2c2c36bb0c9c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:35.259820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab39f9-9ba8-4fa3-8cc7-2c2c36bb0c9c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:35.263978 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50af75-dfd4-4450-a491-202cd388c086 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4l-c0BLOSTWTd19Kp4yGRA, audit_chain_id=['4l-c0BLOSTWTd19Kp4yGRA']) at 0x7fe09e14a2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:35.265316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50af75-dfd4-4450-a491-202cd388c086 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:35.265604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50af75-dfd4-4450-a491-202cd388c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:35.265885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50af75-dfd4-4450-a491-202cd388c086 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:35.276871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50af75-dfd4-4450-a491-202cd388c086 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:35.283835 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-cf50af75-dfd4-4450-a491-202cd388c086 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:35:35.284964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 93/186] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:35:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:35.290804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a8b35-9949-4e40-934a-7cba94c67827 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:35.299720 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a8b35-9949-4e40-934a-7cba94c67827 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:35.303809 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115be4ea-d9f1-4017-8a67-f647561c2d2d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4l-c0BLOSTWTd19Kp4yGRA, audit_chain_id=['4l-c0BLOSTWTd19Kp4yGRA']) at 0x7fe09e204940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:35.304398 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115be4ea-d9f1-4017-8a67-f647561c2d2d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:35.304685 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115be4ea-d9f1-4017-8a67-f647561c2d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:35.304968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115be4ea-d9f1-4017-8a67-f647561c2d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:35.305680 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115be4ea-d9f1-4017-8a67-f647561c2d2d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:35.305982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115be4ea-d9f1-4017-8a67-f647561c2d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:35.307608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115be4ea-d9f1-4017-8a67-f647561c2d2d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:35.316515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 94/187] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:35.321722 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50af75-dfd4-4450-a491-202cd388c086 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:35.333276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50af75-dfd4-4450-a491-202cd388c086 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:35.337378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4aab2-5091-44e3-aeee-023b72418746 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4l-c0BLOSTWTd19Kp4yGRA, audit_chain_id=['4l-c0BLOSTWTd19Kp4yGRA']) at 0x7fe09e21b160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:35.338172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4aab2-5091-44e3-aeee-023b72418746 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:35.338464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4aab2-5091-44e3-aeee-023b72418746 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:35.338751 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4aab2-5091-44e3-aeee-023b72418746 admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:35.339872 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4aab2-5091-44e3-aeee-023b72418746 admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:35.341725 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4aab2-5091-44e3-aeee-023b72418746 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:35.343775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 94/188] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:35 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:35.349485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115be4ea-d9f1-4017-8a67-f647561c2d2d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:35.359155 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115be4ea-d9f1-4017-8a67-f647561c2d2d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:35.363221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7f1dc-b05e-4a43-af16-89a727049e26 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4l-c0BLOSTWTd19Kp4yGRA, audit_chain_id=['4l-c0BLOSTWTd19Kp4yGRA']) at 0x7fe09e143880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:35.363789 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7f1dc-b05e-4a43-af16-89a727049e26 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:35.364072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7f1dc-b05e-4a43-af16-89a727049e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:35.364350 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7f1dc-b05e-4a43-af16-89a727049e26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:35.372006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7f1dc-b05e-4a43-af16-89a727049e26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:35.374258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7f1dc-b05e-4a43-af16-89a727049e26 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:35.382716 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 95/189] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:35 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:35:35.388100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4aab2-5091-44e3-aeee-023b72418746 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:35.400815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4aab2-5091-44e3-aeee-023b72418746 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:35.405616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d1874-e296-40b7-8b01-1549709e43d1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4l-c0BLOSTWTd19Kp4yGRA, audit_chain_id=['4l-c0BLOSTWTd19Kp4yGRA']) at 0x7fe09e21b400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:35.406396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d1874-e296-40b7-8b01-1549709e43d1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:35.406689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d1874-e296-40b7-8b01-1549709e43d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:35.406974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d1874-e296-40b7-8b01-1549709e43d1 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:35.408106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d1874-e296-40b7-8b01-1549709e43d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:35.410163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d1874-e296-40b7-8b01-1549709e43d1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:35.411714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 95/190] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:35 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:35.417387 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7f1dc-b05e-4a43-af16-89a727049e26 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:35.426013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7f1dc-b05e-4a43-af16-89a727049e26 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:35.430040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df7f2f-1bc4-4b0c-a7a0-b77168dd5761 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4l-c0BLOSTWTd19Kp4yGRA, audit_chain_id=['4l-c0BLOSTWTd19Kp4yGRA']) at 0x7fe09e204d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:35.430610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df7f2f-1bc4-4b0c-a7a0-b77168dd5761 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:35.430896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df7f2f-1bc4-4b0c-a7a0-b77168dd5761 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:35.431212 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df7f2f-1bc4-4b0c-a7a0-b77168dd5761 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:35.431984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df7f2f-1bc4-4b0c-a7a0-b77168dd5761 admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=957d6be248554f84b1624d5a66f21ae1, user.id=6ab015dd8bfa4c7bab33bb2ae75070c3) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:35.432286 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df7f2f-1bc4-4b0c-a7a0-b77168dd5761 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:35.434284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df7f2f-1bc4-4b0c-a7a0-b77168dd5761 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:35.440482 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 96/191] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:35 2022] GET /identity/v3/role_assignments?user.id=6ab015dd8bfa4c7bab33bb2ae75070c3&scope.project.id=957d6be248554f84b1624d5a66f21ae1&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:37.585712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d06f06-fb8a-40b2-889d-b11c6d6f55f3 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:37.586246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d06f06-fb8a-40b2-889d-b11c6d6f55f3 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:37.586246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d06f06-fb8a-40b2-889d-b11c6d6f55f3 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:37.588035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 96/192] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:37.594086 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cfdd8-60f1-4087-8809-8e2e2415f19e None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:37.594527 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cfdd8-60f1-4087-8809-8e2e2415f19e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:37.594646 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cfdd8-60f1-4087-8809-8e2e2415f19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:37.626457 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e99cfdd8-60f1-4087-8809-8e2e2415f19e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:37.627645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e99cfdd8-60f1-4087-8809-8e2e2415f19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:37.641414 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 97/193] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:37.664493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d06f06-fb8a-40b2-889d-b11c6d6f55f3 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:37.676605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d06f06-fb8a-40b2-889d-b11c6d6f55f3 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:37.680582 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d7dbf-cf29-45b8-b7aa-839de17e6d54 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UMnH6ld1TIa7BHFhgESBTQ, audit_chain_id=['UMnH6ld1TIa7BHFhgESBTQ']) at 0x7fe09e21bee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:37.681290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d7dbf-cf29-45b8-b7aa-839de17e6d54 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:37.681577 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d7dbf-cf29-45b8-b7aa-839de17e6d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:37.681855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d7dbf-cf29-45b8-b7aa-839de17e6d54 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:37.693612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d7dbf-cf29-45b8-b7aa-839de17e6d54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:37.699927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-bb5d7dbf-cf29-45b8-b7aa-839de17e6d54 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:35:37.701018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 97/194] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:35:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:37.706858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cfdd8-60f1-4087-8809-8e2e2415f19e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:37.715903 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cfdd8-60f1-4087-8809-8e2e2415f19e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:37.720533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd9439-b79d-447b-854b-8e3fb078b1b2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UMnH6ld1TIa7BHFhgESBTQ, audit_chain_id=['UMnH6ld1TIa7BHFhgESBTQ']) at 0x7fe09e17f400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:37.721498 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd9439-b79d-447b-854b-8e3fb078b1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:37.721832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd9439-b79d-447b-854b-8e3fb078b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:37.722173 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd9439-b79d-447b-854b-8e3fb078b1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:37.723019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd9439-b79d-447b-854b-8e3fb078b1b2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:37.723384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd9439-b79d-447b-854b-8e3fb078b1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:37.725122 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd9439-b79d-447b-854b-8e3fb078b1b2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:37.734285 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 98/195] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:37.739632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d7dbf-cf29-45b8-b7aa-839de17e6d54 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:37.749643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d7dbf-cf29-45b8-b7aa-839de17e6d54 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:37.753574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbf62c-92b6-46d6-9716-5b86570a6743 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UMnH6ld1TIa7BHFhgESBTQ, audit_chain_id=['UMnH6ld1TIa7BHFhgESBTQ']) at 0x7fe09e14a070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:37.754349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbf62c-92b6-46d6-9716-5b86570a6743 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:37.754633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbf62c-92b6-46d6-9716-5b86570a6743 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:37.754908 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbf62c-92b6-46d6-9716-5b86570a6743 admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:37.756015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbf62c-92b6-46d6-9716-5b86570a6743 admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:37.757874 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbf62c-92b6-46d6-9716-5b86570a6743 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:37.759341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 98/196] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:37 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:37.765201 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd9439-b79d-447b-854b-8e3fb078b1b2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:37.774604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd9439-b79d-447b-854b-8e3fb078b1b2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:37.778732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3ca1a-25f0-410c-885d-71825f76e64b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UMnH6ld1TIa7BHFhgESBTQ, audit_chain_id=['UMnH6ld1TIa7BHFhgESBTQ']) at 0x7fe09e17fdc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:37.779555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ca1a-25f0-410c-885d-71825f76e64b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:37.780382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ca1a-25f0-410c-885d-71825f76e64b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:37.780668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ca1a-25f0-410c-885d-71825f76e64b admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:37.781944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3ca1a-25f0-410c-885d-71825f76e64b admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:37.784003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3ca1a-25f0-410c-885d-71825f76e64b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:37.785512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 99/197] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:37 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:37.791018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbf62c-92b6-46d6-9716-5b86570a6743 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:37.801219 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbf62c-92b6-46d6-9716-5b86570a6743 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:37.805216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd3aeb-1eeb-4f35-ab81-2143a9a497e9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UMnH6ld1TIa7BHFhgESBTQ, audit_chain_id=['UMnH6ld1TIa7BHFhgESBTQ']) at 0x7fe09e1965e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:37.806019 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd3aeb-1eeb-4f35-ab81-2143a9a497e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:37.806307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd3aeb-1eeb-4f35-ab81-2143a9a497e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:37.806587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd3aeb-1eeb-4f35-ab81-2143a9a497e9 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1/users/6ab015dd8bfa4c7bab33bb2ae75070c3/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:37.808455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd3aeb-1eeb-4f35-ab81-2143a9a497e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957d6be248554f84b1624d5a66f21ae1, user_id=6ab015dd8bfa4c7bab33bb2ae75070c3, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:37.811151 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd3aeb-1eeb-4f35-ab81-2143a9a497e9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:37.888973 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 99/198] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:35:37 2022] PUT /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1/users/6ab015dd8bfa4c7bab33bb2ae75070c3/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:35:40.036785 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10428fc3-6e97-4af3-89d3-ab4578f40972 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:40.037296 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10428fc3-6e97-4af3-89d3-ab4578f40972 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:40.037381 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10428fc3-6e97-4af3-89d3-ab4578f40972 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:40.039054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 100/199] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:40.044296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092456b-e567-42e3-a257-e4dfc5f438e1 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:40.044678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092456b-e567-42e3-a257-e4dfc5f438e1 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:40.044869 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092456b-e567-42e3-a257-e4dfc5f438e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:40.067497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4092456b-e567-42e3-a257-e4dfc5f438e1 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:40.068670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4092456b-e567-42e3-a257-e4dfc5f438e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:40.134132 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 100/200] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:40.158438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10428fc3-6e97-4af3-89d3-ab4578f40972 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:40.170374 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10428fc3-6e97-4af3-89d3-ab4578f40972 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:40.174406 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84383f10-05fe-4b79-917b-dd964cdbe346 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sxL4Ilx_RDqBXBWoNWY4lw, audit_chain_id=['sxL4Ilx_RDqBXBWoNWY4lw']) at 0x7fe09e1a7e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:40.175128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84383f10-05fe-4b79-917b-dd964cdbe346 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:40.175437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84383f10-05fe-4b79-917b-dd964cdbe346 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:40.175717 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84383f10-05fe-4b79-917b-dd964cdbe346 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:40.187029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84383f10-05fe-4b79-917b-dd964cdbe346 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:40.193349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-84383f10-05fe-4b79-917b-dd964cdbe346 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:35:40.194440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 101/201] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:40.200404 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092456b-e567-42e3-a257-e4dfc5f438e1 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:40.209748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092456b-e567-42e3-a257-e4dfc5f438e1 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:40.213962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685b0a-b441-4379-a8d0-ec58f536f85d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sxL4Ilx_RDqBXBWoNWY4lw, audit_chain_id=['sxL4Ilx_RDqBXBWoNWY4lw']) at 0x7fe09e14a0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:40.214509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685b0a-b441-4379-a8d0-ec58f536f85d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:40.214827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685b0a-b441-4379-a8d0-ec58f536f85d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:40.215134 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685b0a-b441-4379-a8d0-ec58f536f85d admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:40.215865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685b0a-b441-4379-a8d0-ec58f536f85d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:40.216171 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685b0a-b441-4379-a8d0-ec58f536f85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:40.218503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685b0a-b441-4379-a8d0-ec58f536f85d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:40.227321 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 101/202] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:40.232823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84383f10-05fe-4b79-917b-dd964cdbe346 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:40.242227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84383f10-05fe-4b79-917b-dd964cdbe346 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:40.246226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ddfdc-23d5-432f-ad53-d57105fa7897 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sxL4Ilx_RDqBXBWoNWY4lw, audit_chain_id=['sxL4Ilx_RDqBXBWoNWY4lw']) at 0x7fe09e1a76a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:40.247012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ddfdc-23d5-432f-ad53-d57105fa7897 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:40.247336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ddfdc-23d5-432f-ad53-d57105fa7897 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:40.247621 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ddfdc-23d5-432f-ad53-d57105fa7897 admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:40.248748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ddfdc-23d5-432f-ad53-d57105fa7897 admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:40.250553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ddfdc-23d5-432f-ad53-d57105fa7897 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:40.252048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 102/203] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:40 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:40.257254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685b0a-b441-4379-a8d0-ec58f536f85d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:40.267062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685b0a-b441-4379-a8d0-ec58f536f85d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:40.271072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5f755-526d-4b4b-8a6a-421fcef7e130 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sxL4Ilx_RDqBXBWoNWY4lw, audit_chain_id=['sxL4Ilx_RDqBXBWoNWY4lw']) at 0x7fe09e14a430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:40.271686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f755-526d-4b4b-8a6a-421fcef7e130 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:40.271981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f755-526d-4b4b-8a6a-421fcef7e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:40.272269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f755-526d-4b4b-8a6a-421fcef7e130 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:40.280689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5f755-526d-4b4b-8a6a-421fcef7e130 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:40.282435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5f755-526d-4b4b-8a6a-421fcef7e130 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:40.291176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 102/204] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:40 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:35:40.296730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ddfdc-23d5-432f-ad53-d57105fa7897 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:40.305996 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ddfdc-23d5-432f-ad53-d57105fa7897 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:40.310068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe4c67-2427-43f5-bc6b-7f6779877348 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sxL4Ilx_RDqBXBWoNWY4lw, audit_chain_id=['sxL4Ilx_RDqBXBWoNWY4lw']) at 0x7fe09e1a7490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:40.310841 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe4c67-2427-43f5-bc6b-7f6779877348 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:40.311181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe4c67-2427-43f5-bc6b-7f6779877348 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:40.311494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe4c67-2427-43f5-bc6b-7f6779877348 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:40.312550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe4c67-2427-43f5-bc6b-7f6779877348 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:40.314642 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe4c67-2427-43f5-bc6b-7f6779877348 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:40.316178 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 103/205] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:40 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:40.321556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5f755-526d-4b4b-8a6a-421fcef7e130 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:40.330538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5f755-526d-4b4b-8a6a-421fcef7e130 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:40.334607 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a436a9-cb46-4a64-b2a3-03137b927314 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sxL4Ilx_RDqBXBWoNWY4lw, audit_chain_id=['sxL4Ilx_RDqBXBWoNWY4lw']) at 0x7fe09e183190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:40.335213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a436a9-cb46-4a64-b2a3-03137b927314 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:40.335508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a436a9-cb46-4a64-b2a3-03137b927314 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:40.335792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a436a9-cb46-4a64-b2a3-03137b927314 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:40.336589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a436a9-cb46-4a64-b2a3-03137b927314 admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=957d6be248554f84b1624d5a66f21ae1, user.id=6ab015dd8bfa4c7bab33bb2ae75070c3) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:40.336893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a436a9-cb46-4a64-b2a3-03137b927314 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:40.338697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a436a9-cb46-4a64-b2a3-03137b927314 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:40.344850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 103/206] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:40 2022] GET /identity/v3/role_assignments?user.id=6ab015dd8bfa4c7bab33bb2ae75070c3&scope.project.id=957d6be248554f84b1624d5a66f21ae1&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:42.610305 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743dee5-0934-4a96-9cd9-b5f8004dbe20 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:42.610827 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743dee5-0934-4a96-9cd9-b5f8004dbe20 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:42.610942 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743dee5-0934-4a96-9cd9-b5f8004dbe20 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:42.612564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 104/207] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:42.617879 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02a7a-cfce-48cd-ac47-6e5efbe86e91 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:42.618302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02a7a-cfce-48cd-ac47-6e5efbe86e91 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:42.618435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02a7a-cfce-48cd-ac47-6e5efbe86e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:42.645322 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a3b02a7a-cfce-48cd-ac47-6e5efbe86e91 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:42.646497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a3b02a7a-cfce-48cd-ac47-6e5efbe86e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:42.653379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 104/208] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:42 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:42.678179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743dee5-0934-4a96-9cd9-b5f8004dbe20 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:42.691251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743dee5-0934-4a96-9cd9-b5f8004dbe20 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:42.695572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851e7ca-31a3-4f85-b67b-76e08e6bff07 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x8fGwRgTpCklrO0WHDLog, audit_chain_id=['7x8fGwRgTpCklrO0WHDLog']) at 0x7fe09e1f39a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:42.696322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851e7ca-31a3-4f85-b67b-76e08e6bff07 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:42.696612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851e7ca-31a3-4f85-b67b-76e08e6bff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:42.696894 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851e7ca-31a3-4f85-b67b-76e08e6bff07 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:42.712802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851e7ca-31a3-4f85-b67b-76e08e6bff07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:42.720108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-e851e7ca-31a3-4f85-b67b-76e08e6bff07 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:35:42.721490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 105/209] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:35:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:42.727619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b02a7a-cfce-48cd-ac47-6e5efbe86e91 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:42.739481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b02a7a-cfce-48cd-ac47-6e5efbe86e91 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:42.743560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe8a34-02c1-41ec-93e8-8cd451a45777 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x8fGwRgTpCklrO0WHDLog, audit_chain_id=['7x8fGwRgTpCklrO0WHDLog']) at 0x7fe09e143610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:42.744160 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8a34-02c1-41ec-93e8-8cd451a45777 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:42.744453 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8a34-02c1-41ec-93e8-8cd451a45777 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:42.744738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8a34-02c1-41ec-93e8-8cd451a45777 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:42.745443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe8a34-02c1-41ec-93e8-8cd451a45777 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:42.745747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe8a34-02c1-41ec-93e8-8cd451a45777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:42.747390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe8a34-02c1-41ec-93e8-8cd451a45777 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:42.756736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 105/210] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:35:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:42.762261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851e7ca-31a3-4f85-b67b-76e08e6bff07 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:42.772802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851e7ca-31a3-4f85-b67b-76e08e6bff07 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:42.776835 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d9adf-905b-4708-b89b-4781b52d17e6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x8fGwRgTpCklrO0WHDLog, audit_chain_id=['7x8fGwRgTpCklrO0WHDLog']) at 0x7fe09e1d7a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:42.777645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d9adf-905b-4708-b89b-4781b52d17e6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:42.777932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d9adf-905b-4708-b89b-4781b52d17e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:42.778220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d9adf-905b-4708-b89b-4781b52d17e6 admin admin] PATH_INFO: `/v3/users/fa368b61f4ec43809f98dee2899427d4` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:42.779368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d9adf-905b-4708-b89b-4781b52d17e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=fa368b61f4ec43809f98dee2899427d4)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:42.782585 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d9adf-905b-4708-b89b-4781b52d17e6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:42.784176 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 106/211] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:42 2022] GET /identity/v3/users/fa368b61f4ec43809f98dee2899427d4 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:42.789527 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe8a34-02c1-41ec-93e8-8cd451a45777 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:42.799356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe8a34-02c1-41ec-93e8-8cd451a45777 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:42.803320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91860323-51f2-493b-b909-f29db84b8c04 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x8fGwRgTpCklrO0WHDLog, audit_chain_id=['7x8fGwRgTpCklrO0WHDLog']) at 0x7fe09e14af10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:42.803894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860323-51f2-493b-b909-f29db84b8c04 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:42.804185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860323-51f2-493b-b909-f29db84b8c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:42.804474 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860323-51f2-493b-b909-f29db84b8c04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:42.812189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91860323-51f2-493b-b909-f29db84b8c04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:42.814026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91860323-51f2-493b-b909-f29db84b8c04 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:42.822351 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 106/212] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:42 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:35:42.828121 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d9adf-905b-4708-b89b-4781b52d17e6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:42.837515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d9adf-905b-4708-b89b-4781b52d17e6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:42.841619 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f7c8-19de-49b6-be19-4080ac6f5a9e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x8fGwRgTpCklrO0WHDLog, audit_chain_id=['7x8fGwRgTpCklrO0WHDLog']) at 0x7fe09e2040a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:42.842955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f7c8-19de-49b6-be19-4080ac6f5a9e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:42.843283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f7c8-19de-49b6-be19-4080ac6f5a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:42.843569 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f7c8-19de-49b6-be19-4080ac6f5a9e admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:42.844696 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355f7c8-19de-49b6-be19-4080ac6f5a9e admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:42.847001 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355f7c8-19de-49b6-be19-4080ac6f5a9e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:42.848546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 107/213] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:42 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:42.854049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91860323-51f2-493b-b909-f29db84b8c04 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:42.863258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91860323-51f2-493b-b909-f29db84b8c04 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:42.867277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb95a1e-0e4a-4803-8e5a-bb79c7040cd1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x8fGwRgTpCklrO0WHDLog, audit_chain_id=['7x8fGwRgTpCklrO0WHDLog']) at 0x7fe09e21b7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:42.867850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb95a1e-0e4a-4803-8e5a-bb79c7040cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:42.868140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb95a1e-0e4a-4803-8e5a-bb79c7040cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:42.868422 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb95a1e-0e4a-4803-8e5a-bb79c7040cd1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:42.869180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb95a1e-0e4a-4803-8e5a-bb79c7040cd1 admin admin] RBAC: Adding query filter params (role.id=5fae8096df3e470085794883a1631067, scope.project.id=957d6be248554f84b1624d5a66f21ae1, user.id=fa368b61f4ec43809f98dee2899427d4) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:42.869485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb95a1e-0e4a-4803-8e5a-bb79c7040cd1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:42.871323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb95a1e-0e4a-4803-8e5a-bb79c7040cd1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:42.876601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 107/214] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:42 2022] GET /identity/v3/role_assignments?user.id=fa368b61f4ec43809f98dee2899427d4&scope.project.id=957d6be248554f84b1624d5a66f21ae1&role.id=5fae8096df3e470085794883a1631067 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:45.064376 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9734-619f-4be7-ab45-fc8e1da08f7a None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:45.064931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9734-619f-4be7-ab45-fc8e1da08f7a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:45.064931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9734-619f-4be7-ab45-fc8e1da08f7a None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:45.081934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 108/215] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:45.082021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f027668-e3f6-455e-8d5b-1e5838596e0d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:45.082021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f027668-e3f6-455e-8d5b-1e5838596e0d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:45.082021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f027668-e3f6-455e-8d5b-1e5838596e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:45.094581 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-0f027668-e3f6-455e-8d5b-1e5838596e0d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:45.096033 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0f027668-e3f6-455e-8d5b-1e5838596e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:45.102794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 108/216] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:45 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:45.126194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da9734-619f-4be7-ab45-fc8e1da08f7a None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:45.138080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da9734-619f-4be7-ab45-fc8e1da08f7a None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:45.142108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247a3e3-2abd-46f0-9116-9ea84fbf5c6b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z173mGavSwSkrBuI0dSeYQ, audit_chain_id=['Z173mGavSwSkrBuI0dSeYQ']) at 0x7fe09e204460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:45.142831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247a3e3-2abd-46f0-9116-9ea84fbf5c6b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:45.143157 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247a3e3-2abd-46f0-9116-9ea84fbf5c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:45.143422 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247a3e3-2abd-46f0-9116-9ea84fbf5c6b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:45.154362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247a3e3-2abd-46f0-9116-9ea84fbf5c6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:45.161691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-4247a3e3-2abd-46f0-9116-9ea84fbf5c6b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:35:45.162764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 109/217] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:35:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:45.168462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f027668-e3f6-455e-8d5b-1e5838596e0d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:45.177700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f027668-e3f6-455e-8d5b-1e5838596e0d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:45.181740 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462595a-52e7-487c-9c48-6dad8681451e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z173mGavSwSkrBuI0dSeYQ, audit_chain_id=['Z173mGavSwSkrBuI0dSeYQ']) at 0x7fe09e21e4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:45.182341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462595a-52e7-487c-9c48-6dad8681451e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:45.182630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462595a-52e7-487c-9c48-6dad8681451e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:45.182912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462595a-52e7-487c-9c48-6dad8681451e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:45.183656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462595a-52e7-487c-9c48-6dad8681451e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:45.183962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462595a-52e7-487c-9c48-6dad8681451e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:45.185545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462595a-52e7-487c-9c48-6dad8681451e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:45.194147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 109/218] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:35:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:45.199497 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247a3e3-2abd-46f0-9116-9ea84fbf5c6b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:45.209407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247a3e3-2abd-46f0-9116-9ea84fbf5c6b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:45.213670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319287c-ce8d-4ac5-b221-99cc5555489d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z173mGavSwSkrBuI0dSeYQ, audit_chain_id=['Z173mGavSwSkrBuI0dSeYQ']) at 0x7fe09e1d7a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:45.214465 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319287c-ce8d-4ac5-b221-99cc5555489d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:45.214751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319287c-ce8d-4ac5-b221-99cc5555489d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:45.215029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319287c-ce8d-4ac5-b221-99cc5555489d admin admin] PATH_INFO: `/v3/users/fa368b61f4ec43809f98dee2899427d4` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:45.216161 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319287c-ce8d-4ac5-b221-99cc5555489d admin admin] RBAC: Authorizing `identity:get_user(user_id=fa368b61f4ec43809f98dee2899427d4)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:45.218847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319287c-ce8d-4ac5-b221-99cc5555489d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:45.220317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 110/219] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:45 2022] GET /identity/v3/users/fa368b61f4ec43809f98dee2899427d4 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:45.225814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462595a-52e7-487c-9c48-6dad8681451e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:45.235712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462595a-52e7-487c-9c48-6dad8681451e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:45.239748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc39e-29b2-4815-96e5-96f101d5096e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z173mGavSwSkrBuI0dSeYQ, audit_chain_id=['Z173mGavSwSkrBuI0dSeYQ']) at 0x7fe09e21e8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:45.240525 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc39e-29b2-4815-96e5-96f101d5096e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:45.240817 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc39e-29b2-4815-96e5-96f101d5096e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:45.241142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc39e-29b2-4815-96e5-96f101d5096e admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:45.242205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dc39e-29b2-4815-96e5-96f101d5096e admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:45.244264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dc39e-29b2-4815-96e5-96f101d5096e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:45.245767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 110/220] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:45 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:45.251171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319287c-ce8d-4ac5-b221-99cc5555489d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:45.260371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319287c-ce8d-4ac5-b221-99cc5555489d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:45.264484 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e5852-066b-4b5a-aba4-206305283b4b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z173mGavSwSkrBuI0dSeYQ, audit_chain_id=['Z173mGavSwSkrBuI0dSeYQ']) at 0x7fe09e1d7b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:45.265274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e5852-066b-4b5a-aba4-206305283b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:45.265561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e5852-066b-4b5a-aba4-206305283b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:45.265841 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e5852-066b-4b5a-aba4-206305283b4b admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1/users/fa368b61f4ec43809f98dee2899427d4/roles/5fae8096df3e470085794883a1631067` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:45.267836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e5852-066b-4b5a-aba4-206305283b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=957d6be248554f84b1624d5a66f21ae1, user_id=fa368b61f4ec43809f98dee2899427d4, role_id=5fae8096df3e470085794883a1631067)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:45.270407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e5852-066b-4b5a-aba4-206305283b4b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:45.356868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 111/221] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:35:45 2022] PUT /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1/users/fa368b61f4ec43809f98dee2899427d4/roles/5fae8096df3e470085794883a1631067 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:35:47.472614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96bd03-e241-4281-bb98-853808181589 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:47.473138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96bd03-e241-4281-bb98-853808181589 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:47.473229 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96bd03-e241-4281-bb98-853808181589 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:47.474913 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 111/222] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:47.480053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0317ed8-b028-4e34-b293-a86a51b7b0ae None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:47.480440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0317ed8-b028-4e34-b293-a86a51b7b0ae None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:47.480583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0317ed8-b028-4e34-b293-a86a51b7b0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:47.502936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b0317ed8-b028-4e34-b293-a86a51b7b0ae None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:47.504118 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b0317ed8-b028-4e34-b293-a86a51b7b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:47.571560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 112/223] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:47 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:47.594955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96bd03-e241-4281-bb98-853808181589 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:47.607372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96bd03-e241-4281-bb98-853808181589 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:47.612300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848ec06-f900-4f92-874a-eec53bcd2f08 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FHTkoqGBQaCWg5d4WSKxpg, audit_chain_id=['FHTkoqGBQaCWg5d4WSKxpg']) at 0x7fe09e21e490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:47.613037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ec06-f900-4f92-874a-eec53bcd2f08 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:47.613327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ec06-f900-4f92-874a-eec53bcd2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:47.613612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ec06-f900-4f92-874a-eec53bcd2f08 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:47.625418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848ec06-f900-4f92-874a-eec53bcd2f08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:47.632181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-5848ec06-f900-4f92-874a-eec53bcd2f08 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:35:47.633285 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 112/224] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:35:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:47.639815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0317ed8-b028-4e34-b293-a86a51b7b0ae None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:47.648494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0317ed8-b028-4e34-b293-a86a51b7b0ae None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:47.652749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cd74b-954c-4b59-b52c-c8ce40c9cd24 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FHTkoqGBQaCWg5d4WSKxpg, audit_chain_id=['FHTkoqGBQaCWg5d4WSKxpg']) at 0x7fe09e1a7f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:47.653342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cd74b-954c-4b59-b52c-c8ce40c9cd24 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:47.653632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cd74b-954c-4b59-b52c-c8ce40c9cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:47.653945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cd74b-954c-4b59-b52c-c8ce40c9cd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:47.655499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cd74b-954c-4b59-b52c-c8ce40c9cd24 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:47.655797 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cd74b-954c-4b59-b52c-c8ce40c9cd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:47.657556 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cd74b-954c-4b59-b52c-c8ce40c9cd24 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:47.666181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 113/225] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:35:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:47.671673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848ec06-f900-4f92-874a-eec53bcd2f08 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:47.680875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848ec06-f900-4f92-874a-eec53bcd2f08 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:47.684876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33273a1-24e6-419b-9afc-81ae00a39c28 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FHTkoqGBQaCWg5d4WSKxpg, audit_chain_id=['FHTkoqGBQaCWg5d4WSKxpg']) at 0x7fe09e14ac40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:47.685747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33273a1-24e6-419b-9afc-81ae00a39c28 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:47.686038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33273a1-24e6-419b-9afc-81ae00a39c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:47.686324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33273a1-24e6-419b-9afc-81ae00a39c28 admin admin] PATH_INFO: `/v3/users/fa368b61f4ec43809f98dee2899427d4` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:47.687468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33273a1-24e6-419b-9afc-81ae00a39c28 admin admin] RBAC: Authorizing `identity:get_user(user_id=fa368b61f4ec43809f98dee2899427d4)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:47.689561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33273a1-24e6-419b-9afc-81ae00a39c28 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:47.690993 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 113/226] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:35:47 2022] GET /identity/v3/users/fa368b61f4ec43809f98dee2899427d4 => generated 283 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:47.696369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cd74b-954c-4b59-b52c-c8ce40c9cd24 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:47.706043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cd74b-954c-4b59-b52c-c8ce40c9cd24 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:47.710028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343b84b-f772-4a57-8e6c-6c299fc8e489 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FHTkoqGBQaCWg5d4WSKxpg, audit_chain_id=['FHTkoqGBQaCWg5d4WSKxpg']) at 0x7fe09e1a7a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:47.710590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343b84b-f772-4a57-8e6c-6c299fc8e489 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:47.710878 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343b84b-f772-4a57-8e6c-6c299fc8e489 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:47.711189 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343b84b-f772-4a57-8e6c-6c299fc8e489 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:47.719390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343b84b-f772-4a57-8e6c-6c299fc8e489 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:47.721389 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343b84b-f772-4a57-8e6c-6c299fc8e489 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:47.729796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 114/227] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:47 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:35:47.735057 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33273a1-24e6-419b-9afc-81ae00a39c28 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:47.744160 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33273a1-24e6-419b-9afc-81ae00a39c28 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:47.748187 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dace5-3b58-4eaf-9802-c530f61ce192 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FHTkoqGBQaCWg5d4WSKxpg, audit_chain_id=['FHTkoqGBQaCWg5d4WSKxpg']) at 0x7fe09e14a7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:47.748999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dace5-3b58-4eaf-9802-c530f61ce192 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:47.749285 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dace5-3b58-4eaf-9802-c530f61ce192 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:47.749564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dace5-3b58-4eaf-9802-c530f61ce192 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:47.750656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dace5-3b58-4eaf-9802-c530f61ce192 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:47.752701 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dace5-3b58-4eaf-9802-c530f61ce192 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:47.754211 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 114/228] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:47 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:47.760026 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343b84b-f772-4a57-8e6c-6c299fc8e489 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:47.769216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343b84b-f772-4a57-8e6c-6c299fc8e489 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:47.773279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b5268-8fbb-4018-b576-2035b2e7269a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FHTkoqGBQaCWg5d4WSKxpg, audit_chain_id=['FHTkoqGBQaCWg5d4WSKxpg']) at 0x7fe09e1d7700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:47.773852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b5268-8fbb-4018-b576-2035b2e7269a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:47.774141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b5268-8fbb-4018-b576-2035b2e7269a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:47.774424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b5268-8fbb-4018-b576-2035b2e7269a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:47.775224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b5268-8fbb-4018-b576-2035b2e7269a admin admin] RBAC: Adding query filter params (role.id=5fae8096df3e470085794883a1631067, scope.project.id=957d6be248554f84b1624d5a66f21ae1, user.id=fa368b61f4ec43809f98dee2899427d4) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:47.775529 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b5268-8fbb-4018-b576-2035b2e7269a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:47.777354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b5268-8fbb-4018-b576-2035b2e7269a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:47.783615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 115/229] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:35:47 2022] GET /identity/v3/role_assignments?user.id=fa368b61f4ec43809f98dee2899427d4&scope.project.id=957d6be248554f84b1624d5a66f21ae1&role.id=5fae8096df3e470085794883a1631067 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:35:49.933568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c282-ff8a-4d6d-8b5f-06732c388c16 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:49.934143 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c282-ff8a-4d6d-8b5f-06732c388c16 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:49.934143 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c282-ff8a-4d6d-8b5f-06732c388c16 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:49.936509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 115/230] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:49.941726 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dcf43-d301-4cd9-878d-0b6e85c13178 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:49.942166 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dcf43-d301-4cd9-878d-0b6e85c13178 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:49.942292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dcf43-d301-4cd9-878d-0b6e85c13178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:49.964377 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f41dcf43-d301-4cd9-878d-0b6e85c13178 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:49.965497 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f41dcf43-d301-4cd9-878d-0b6e85c13178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:49.972815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 116/231] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:49.996232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295c282-ff8a-4d6d-8b5f-06732c388c16 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:50.008418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295c282-ff8a-4d6d-8b5f-06732c388c16 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:50.012484 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be4f38-4e1a-49dd-921b-1acde3e34cb0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xShbQH-ATlG9w8NpIEIKtg, audit_chain_id=['xShbQH-ATlG9w8NpIEIKtg']) at 0x7fe09e21e250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:50.013190 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be4f38-4e1a-49dd-921b-1acde3e34cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:50.013478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be4f38-4e1a-49dd-921b-1acde3e34cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:50.013902 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be4f38-4e1a-49dd-921b-1acde3e34cb0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:50.015139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be4f38-4e1a-49dd-921b-1acde3e34cb0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:50.016820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be4f38-4e1a-49dd-921b-1acde3e34cb0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:50.018270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 116/232] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:35:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:50.023884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dcf43-d301-4cd9-878d-0b6e85c13178 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:50.032738 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dcf43-d301-4cd9-878d-0b6e85c13178 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:50.036796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eefe1-655d-4fd0-8a8b-a075168e4495 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xShbQH-ATlG9w8NpIEIKtg, audit_chain_id=['xShbQH-ATlG9w8NpIEIKtg']) at 0x7fe09e204e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:50.037382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eefe1-655d-4fd0-8a8b-a075168e4495 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:50.037667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eefe1-655d-4fd0-8a8b-a075168e4495 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:50.037947 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eefe1-655d-4fd0-8a8b-a075168e4495 admin admin] PATH_INFO: `/v3/groups` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:50.038630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eefe1-655d-4fd0-8a8b-a075168e4495 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:50.039674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-6d4eefe1-655d-4fd0-8a8b-a075168e4495 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:35:50.039674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:35:50.039674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:35:50.040894 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eefe1-655d-4fd0-8a8b-a075168e4495 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:50.129122 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 117/233] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Feb 28 18:35:50 2022] POST /identity/v3/groups => generated 229 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:35:52.270504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe0cd3-1260-45b2-b208-85c3a543c0bf None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:52.271038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe0cd3-1260-45b2-b208-85c3a543c0bf None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:52.271038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe0cd3-1260-45b2-b208-85c3a543c0bf None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:52.272688 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 117/234] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:52.277949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e20f-91da-472c-a7a0-e4624056425b None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:52.278350 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e20f-91da-472c-a7a0-e4624056425b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:52.278526 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e20f-91da-472c-a7a0-e4624056425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:52.309347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b3e8e20f-91da-472c-a7a0-e4624056425b None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:52.310584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b3e8e20f-91da-472c-a7a0-e4624056425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:52.318013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 118/235] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:52 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:52.341661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe0cd3-1260-45b2-b208-85c3a543c0bf None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:52.355135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe0cd3-1260-45b2-b208-85c3a543c0bf None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:52.359323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b556106-5930-4d7b-999b-2d5c550ab35f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5R_MHtqEQuO8r4xxf5CCIw, audit_chain_id=['5R_MHtqEQuO8r4xxf5CCIw']) at 0x7fe09e21ec10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:52.360098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556106-5930-4d7b-999b-2d5c550ab35f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:52.360429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556106-5930-4d7b-999b-2d5c550ab35f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:52.360697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556106-5930-4d7b-999b-2d5c550ab35f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:52.361846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b556106-5930-4d7b-999b-2d5c550ab35f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:52.363575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b556106-5930-4d7b-999b-2d5c550ab35f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:52.365046 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 118/236] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:35:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:52.370822 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8e20f-91da-472c-a7a0-e4624056425b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:52.380146 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8e20f-91da-472c-a7a0-e4624056425b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:52.384336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53b41-0371-4265-bde1-631c601d44e2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5R_MHtqEQuO8r4xxf5CCIw, audit_chain_id=['5R_MHtqEQuO8r4xxf5CCIw']) at 0x7fe09e3bf820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:52.384934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53b41-0371-4265-bde1-631c601d44e2 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:52.385227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53b41-0371-4265-bde1-631c601d44e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:52.385513 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53b41-0371-4265-bde1-631c601d44e2 admin admin] PATH_INFO: `/v3/groups` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:52.386162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd53b41-0371-4265-bde1-631c601d44e2 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:52.388107 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd53b41-0371-4265-bde1-631c601d44e2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:52.488256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 119/237] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Feb 28 18:35:52 2022] POST /identity/v3/groups => generated 226 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:35:54.740249 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b063-4560-462a-913a-9c9019fa8b82 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:54.740816 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b063-4560-462a-913a-9c9019fa8b82 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:54.740816 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b063-4560-462a-913a-9c9019fa8b82 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:54.742484 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 119/238] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:54.747826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaaf13-e513-4f4c-97c0-3e4c8cbb7db9 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:54.748782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaaf13-e513-4f4c-97c0-3e4c8cbb7db9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:54.748875 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaaf13-e513-4f4c-97c0-3e4c8cbb7db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:54.771382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-ffaaaf13-e513-4f4c-97c0-3e4c8cbb7db9 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:54.772535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ffaaaf13-e513-4f4c-97c0-3e4c8cbb7db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:54.779545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 120/239] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:54 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:54.803310 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905b063-4560-462a-913a-9c9019fa8b82 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:54.815697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905b063-4560-462a-913a-9c9019fa8b82 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:54.819763 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36572820-2b10-4def-8ed2-08d1609b9bfe admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oJPRWbshQ_mIkQTF77Htjg, audit_chain_id=['oJPRWbshQ_mIkQTF77Htjg']) at 0x7fe09e143dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:54.820485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572820-2b10-4def-8ed2-08d1609b9bfe admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:54.820773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572820-2b10-4def-8ed2-08d1609b9bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:54.821054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572820-2b10-4def-8ed2-08d1609b9bfe admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:54.833475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36572820-2b10-4def-8ed2-08d1609b9bfe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:54.839819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-36572820-2b10-4def-8ed2-08d1609b9bfe admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:35:54.840939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 120/240] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:54.847465 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaaf13-e513-4f4c-97c0-3e4c8cbb7db9 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:54.856291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaaf13-e513-4f4c-97c0-3e4c8cbb7db9 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:54.861976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c19dc6-99a1-4e97-bbef-14e46c46b7c7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oJPRWbshQ_mIkQTF77Htjg, audit_chain_id=['oJPRWbshQ_mIkQTF77Htjg']) at 0x7fe09e1c28e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:54.862902 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c19dc6-99a1-4e97-bbef-14e46c46b7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:54.863419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c19dc6-99a1-4e97-bbef-14e46c46b7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:54.863849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c19dc6-99a1-4e97-bbef-14e46c46b7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:54.864913 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c19dc6-99a1-4e97-bbef-14e46c46b7c7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:54.865396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c19dc6-99a1-4e97-bbef-14e46c46b7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:54.868060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c19dc6-99a1-4e97-bbef-14e46c46b7c7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:54.878732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 121/241] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:35:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:35:54.885313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36572820-2b10-4def-8ed2-08d1609b9bfe admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:54.895333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36572820-2b10-4def-8ed2-08d1609b9bfe admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:54.899397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976571f-6a7d-468d-8d16-9f6c6ef8106a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oJPRWbshQ_mIkQTF77Htjg, audit_chain_id=['oJPRWbshQ_mIkQTF77Htjg']) at 0x7fe09e14a070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:54.899970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976571f-6a7d-468d-8d16-9f6c6ef8106a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:54.900247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976571f-6a7d-468d-8d16-9f6c6ef8106a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:54.900534 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976571f-6a7d-468d-8d16-9f6c6ef8106a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:54.908665 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976571f-6a7d-468d-8d16-9f6c6ef8106a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:54.910440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976571f-6a7d-468d-8d16-9f6c6ef8106a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:54.920257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 121/242] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:54 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:35:54.926112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c19dc6-99a1-4e97-bbef-14e46c46b7c7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:54.937156 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c19dc6-99a1-4e97-bbef-14e46c46b7c7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:54.941502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9ed79-521f-4500-a4d7-27268f96e1c2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oJPRWbshQ_mIkQTF77Htjg, audit_chain_id=['oJPRWbshQ_mIkQTF77Htjg']) at 0x7fe09e1c2310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:54.942367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9ed79-521f-4500-a4d7-27268f96e1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:54.942717 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9ed79-521f-4500-a4d7-27268f96e1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:54.943083 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9ed79-521f-4500-a4d7-27268f96e1c2 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:54.944224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9ed79-521f-4500-a4d7-27268f96e1c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:54.946254 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9ed79-521f-4500-a4d7-27268f96e1c2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:54.947877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 122/243] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:54 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:54.954317 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976571f-6a7d-468d-8d16-9f6c6ef8106a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:54.963297 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976571f-6a7d-468d-8d16-9f6c6ef8106a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:54.967575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddcb5f-7d8d-48c1-9c0c-cc9e514d326a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oJPRWbshQ_mIkQTF77Htjg, audit_chain_id=['oJPRWbshQ_mIkQTF77Htjg']) at 0x7fe09e21e8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:54.968498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddcb5f-7d8d-48c1-9c0c-cc9e514d326a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:54.968783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddcb5f-7d8d-48c1-9c0c-cc9e514d326a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:54.969063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddcb5f-7d8d-48c1-9c0c-cc9e514d326a admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:54.974716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddcb5f-7d8d-48c1-9c0c-cc9e514d326a admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:54.975851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-efddcb5f-7d8d-48c1-9c0c-cc9e514d326a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:35:54.975851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:35:54.975851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:35:54.977106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddcb5f-7d8d-48c1-9c0c-cc9e514d326a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:54.978618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 122/244] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:35:54 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:35:54.984988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9ed79-521f-4500-a4d7-27268f96e1c2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:54.994638 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9ed79-521f-4500-a4d7-27268f96e1c2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:54.999514 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603809b8-3670-468b-b126-7c88e0d7a959 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oJPRWbshQ_mIkQTF77Htjg, audit_chain_id=['oJPRWbshQ_mIkQTF77Htjg']) at 0x7fe09e14aa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:55.000088 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603809b8-3670-468b-b126-7c88e0d7a959 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:55.000377 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603809b8-3670-468b-b126-7c88e0d7a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:55.000664 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603809b8-3670-468b-b126-7c88e0d7a959 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:55.001438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603809b8-3670-468b-b126-7c88e0d7a959 admin admin] RBAC: Adding query filter params (group.id=184ad7b9c43c4141a32aba9a290f5a84, role.id=ddd473dfc0884753855419d1711fd868, scope.project.id=536234568c1a477aaa466a4b57b0731f) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:55.001743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603809b8-3670-468b-b126-7c88e0d7a959 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:55.003609 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603809b8-3670-468b-b126-7c88e0d7a959 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:55.009010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 123/245] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Feb 28 18:35:54 2022] GET /identity/v3/role_assignments?group.id=184ad7b9c43c4141a32aba9a290f5a84&scope.project.id=536234568c1a477aaa466a4b57b0731f&role.id=ddd473dfc0884753855419d1711fd868 => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:57.121240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a0c5c-7d09-4c68-b1a0-f17f38120ff9 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:57.121752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a0c5c-7d09-4c68-b1a0-f17f38120ff9 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:57.121836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a0c5c-7d09-4c68-b1a0-f17f38120ff9 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:57.123619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 123/246] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:57.128726 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4daa-84ad-4478-903c-93cc53601fd6 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:57.129098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4daa-84ad-4478-903c-93cc53601fd6 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:57.129285 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4daa-84ad-4478-903c-93cc53601fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:57.151062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-943f4daa-84ad-4478-903c-93cc53601fd6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:57.152241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-943f4daa-84ad-4478-903c-93cc53601fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:57.159945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 124/247] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:57 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:57.182673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a0c5c-7d09-4c68-b1a0-f17f38120ff9 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:57.194783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a0c5c-7d09-4c68-b1a0-f17f38120ff9 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:57.198770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c9ac4-0702-41a4-a216-217db528ca07 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SQs5bPGERpG1PRaD9hkB9w, audit_chain_id=['SQs5bPGERpG1PRaD9hkB9w']) at 0x7fe09e21e2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:57.199523 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c9ac4-0702-41a4-a216-217db528ca07 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:57.199815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c9ac4-0702-41a4-a216-217db528ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:57.200100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c9ac4-0702-41a4-a216-217db528ca07 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:57.211245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c9ac4-0702-41a4-a216-217db528ca07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:57.218219 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-1d3c9ac4-0702-41a4-a216-217db528ca07 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:35:57.219335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 124/248] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:57.225254 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f4daa-84ad-4478-903c-93cc53601fd6 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:57.236310 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f4daa-84ad-4478-903c-93cc53601fd6 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:57.240391 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcfe92-7509-4843-9686-9c025d920380 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SQs5bPGERpG1PRaD9hkB9w, audit_chain_id=['SQs5bPGERpG1PRaD9hkB9w']) at 0x7fe09e198430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:57.240986 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcfe92-7509-4843-9686-9c025d920380 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:57.241271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcfe92-7509-4843-9686-9c025d920380 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:57.241550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcfe92-7509-4843-9686-9c025d920380 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:57.242260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcfe92-7509-4843-9686-9c025d920380 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:57.242557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcfe92-7509-4843-9686-9c025d920380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:57.244177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcfe92-7509-4843-9686-9c025d920380 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:57.253094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 125/249] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:35:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:57.258882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c9ac4-0702-41a4-a216-217db528ca07 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:57.268774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c9ac4-0702-41a4-a216-217db528ca07 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:57.272758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20f756-87f4-447b-95b5-6b13dd000863 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SQs5bPGERpG1PRaD9hkB9w, audit_chain_id=['SQs5bPGERpG1PRaD9hkB9w']) at 0x7fe09e150c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:57.273529 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f756-87f4-447b-95b5-6b13dd000863 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:57.273815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f756-87f4-447b-95b5-6b13dd000863 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:57.274092 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20f756-87f4-447b-95b5-6b13dd000863 admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:57.275195 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20f756-87f4-447b-95b5-6b13dd000863 admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:57.277077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20f756-87f4-447b-95b5-6b13dd000863 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:57.278493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 125/250] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:35:57 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:57.284899 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcfe92-7509-4843-9686-9c025d920380 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:57.294179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcfe92-7509-4843-9686-9c025d920380 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:57.299662 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a467b-fcac-4db5-89ea-70aeccf890b3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SQs5bPGERpG1PRaD9hkB9w, audit_chain_id=['SQs5bPGERpG1PRaD9hkB9w']) at 0x7fe09e1988b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:57.300450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a467b-fcac-4db5-89ea-70aeccf890b3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:57.300741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a467b-fcac-4db5-89ea-70aeccf890b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:57.301074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a467b-fcac-4db5-89ea-70aeccf890b3 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:57.302213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a467b-fcac-4db5-89ea-70aeccf890b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:57.304310 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a467b-fcac-4db5-89ea-70aeccf890b3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:57.305870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 126/251] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:57 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:57.311959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20f756-87f4-447b-95b5-6b13dd000863 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:57.321703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20f756-87f4-447b-95b5-6b13dd000863 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:57.325747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e20fa0-7fad-43f3-a5cc-92c1c831700d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SQs5bPGERpG1PRaD9hkB9w, audit_chain_id=['SQs5bPGERpG1PRaD9hkB9w']) at 0x7fe09e150610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:57.326605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e20fa0-7fad-43f3-a5cc-92c1c831700d admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:57.327000 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e20fa0-7fad-43f3-a5cc-92c1c831700d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:57.327418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e20fa0-7fad-43f3-a5cc-92c1c831700d admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f/groups/184ad7b9c43c4141a32aba9a290f5a84/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:57.329214 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e20fa0-7fad-43f3-a5cc-92c1c831700d admin admin] RBAC: Authorizing `identity:create_grant(project_id=536234568c1a477aaa466a4b57b0731f, group_id=184ad7b9c43c4141a32aba9a290f5a84, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:57.331886 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e20fa0-7fad-43f3-a5cc-92c1c831700d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:57.408930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 126/252] 10.222.0.21 () {58 vars in 1463 bytes} [Mon Feb 28 18:35:57 2022] PUT /identity/v3/projects/536234568c1a477aaa466a4b57b0731f/groups/184ad7b9c43c4141a32aba9a290f5a84/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:35:59.548839 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eabf3-fc9d-4590-aadb-46b89549cf8f None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:59.549374 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eabf3-fc9d-4590-aadb-46b89549cf8f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:59.549477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eabf3-fc9d-4590-aadb-46b89549cf8f None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:59.551138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 127/253] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:35:59.556808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cecf2b-5b39-4a24-bbee-d9065119195c None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:59.557247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cecf2b-5b39-4a24-bbee-d9065119195c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:59.557373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cecf2b-5b39-4a24-bbee-d9065119195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:59.580381 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-27cecf2b-5b39-4a24-bbee-d9065119195c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:35:59.581525 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-27cecf2b-5b39-4a24-bbee-d9065119195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:35:59.645573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 127/254] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:35:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:35:59.669304 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eabf3-fc9d-4590-aadb-46b89549cf8f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:59.682010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eabf3-fc9d-4590-aadb-46b89549cf8f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:59.686796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b635329-525f-479b-92d7-f5757b3916d6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=beIuI240T6ivKTvA4GFnDQ, audit_chain_id=['beIuI240T6ivKTvA4GFnDQ']) at 0x7fe09e198e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:59.687639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b635329-525f-479b-92d7-f5757b3916d6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:59.687931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b635329-525f-479b-92d7-f5757b3916d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:59.688215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b635329-525f-479b-92d7-f5757b3916d6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:59.699882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b635329-525f-479b-92d7-f5757b3916d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:35:59.706284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-7b635329-525f-479b-92d7-f5757b3916d6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:35:59.707431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 128/255] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:35:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:35:59.713487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cecf2b-5b39-4a24-bbee-d9065119195c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:59.722925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cecf2b-5b39-4a24-bbee-d9065119195c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:59.727058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3bc8a-c16d-4062-8e55-4576bffcfd28 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=beIuI240T6ivKTvA4GFnDQ, audit_chain_id=['beIuI240T6ivKTvA4GFnDQ']) at 0x7fe09e194c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:59.727684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3bc8a-c16d-4062-8e55-4576bffcfd28 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:59.727976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3bc8a-c16d-4062-8e55-4576bffcfd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:59.728260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3bc8a-c16d-4062-8e55-4576bffcfd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:59.728968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3bc8a-c16d-4062-8e55-4576bffcfd28 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:59.729270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3bc8a-c16d-4062-8e55-4576bffcfd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:59.730902 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3bc8a-c16d-4062-8e55-4576bffcfd28 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:59.740942 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 128/256] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:35:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:59.746406 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b635329-525f-479b-92d7-f5757b3916d6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:59.756341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b635329-525f-479b-92d7-f5757b3916d6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:59.760442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912db3ab-2daf-4f67-a024-bf72c5e266a3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=beIuI240T6ivKTvA4GFnDQ, audit_chain_id=['beIuI240T6ivKTvA4GFnDQ']) at 0x7fe09e1b0a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:59.761020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912db3ab-2daf-4f67-a024-bf72c5e266a3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:59.761308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912db3ab-2daf-4f67-a024-bf72c5e266a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:59.761590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912db3ab-2daf-4f67-a024-bf72c5e266a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:59.770094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912db3ab-2daf-4f67-a024-bf72c5e266a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:59.771889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912db3ab-2daf-4f67-a024-bf72c5e266a3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:59.781333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 129/257] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:35:59 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:35:59.787140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3bc8a-c16d-4062-8e55-4576bffcfd28 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:59.797084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3bc8a-c16d-4062-8e55-4576bffcfd28 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:59.801156 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61036346-b071-43e1-ba84-3cd366c12d88 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=beIuI240T6ivKTvA4GFnDQ, audit_chain_id=['beIuI240T6ivKTvA4GFnDQ']) at 0x7fe09e1942e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:59.801865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036346-b071-43e1-ba84-3cd366c12d88 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:59.802151 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036346-b071-43e1-ba84-3cd366c12d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:59.802431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036346-b071-43e1-ba84-3cd366c12d88 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:59.803546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61036346-b071-43e1-ba84-3cd366c12d88 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:59.805557 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61036346-b071-43e1-ba84-3cd366c12d88 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:59.807056 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 129/258] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:35:59 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:59.813275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912db3ab-2daf-4f67-a024-bf72c5e266a3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:59.821857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912db3ab-2daf-4f67-a024-bf72c5e266a3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:59.825864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86802fb-1031-45a4-b243-5ea350830ea2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=beIuI240T6ivKTvA4GFnDQ, audit_chain_id=['beIuI240T6ivKTvA4GFnDQ']) at 0x7fe09e1b05e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:59.826662 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86802fb-1031-45a4-b243-5ea350830ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:59.827372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86802fb-1031-45a4-b243-5ea350830ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:59.827372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86802fb-1031-45a4-b243-5ea350830ea2 admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:59.828513 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86802fb-1031-45a4-b243-5ea350830ea2 admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:59.829681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-f86802fb-1031-45a4-b243-5ea350830ea2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:35:59.829681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:35:59.829681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:35:59.830837 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86802fb-1031-45a4-b243-5ea350830ea2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:59.832320 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 130/259] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:35:59 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:35:59.837851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61036346-b071-43e1-ba84-3cd366c12d88 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:35:59.847564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61036346-b071-43e1-ba84-3cd366c12d88 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:35:59.851565 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c778f0-a54b-4791-8b1b-259011124aed admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=beIuI240T6ivKTvA4GFnDQ, audit_chain_id=['beIuI240T6ivKTvA4GFnDQ']) at 0x7fe09e194430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:35:59.852217 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c778f0-a54b-4791-8b1b-259011124aed admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:35:59.852435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c778f0-a54b-4791-8b1b-259011124aed admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:35:59.856250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c778f0-a54b-4791-8b1b-259011124aed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:35:59.856250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c778f0-a54b-4791-8b1b-259011124aed admin admin] RBAC: Adding query filter params (group.id=184ad7b9c43c4141a32aba9a290f5a84, role.id=ddd473dfc0884753855419d1711fd868, scope.project.id=536234568c1a477aaa466a4b57b0731f) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:35:59.856250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c778f0-a54b-4791-8b1b-259011124aed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:35:59.856250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c778f0-a54b-4791-8b1b-259011124aed admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:35:59.861832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 130/260] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Feb 28 18:35:59 2022] GET /identity/v3/role_assignments?group.id=184ad7b9c43c4141a32aba9a290f5a84&scope.project.id=536234568c1a477aaa466a4b57b0731f&role.id=ddd473dfc0884753855419d1711fd868 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:02.099518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040eed-11d6-4a69-b157-7250b25fd7d2 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:02.100031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040eed-11d6-4a69-b157-7250b25fd7d2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:02.100116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040eed-11d6-4a69-b157-7250b25fd7d2 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:02.101752 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 131/261] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:36:02.106954 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd607b-b5c2-419e-b2c7-bad411604c9f None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:02.107406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd607b-b5c2-419e-b2c7-bad411604c9f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:02.107560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd607b-b5c2-419e-b2c7-bad411604c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:02.129543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a3bd607b-b5c2-419e-b2c7-bad411604c9f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:02.130690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a3bd607b-b5c2-419e-b2c7-bad411604c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:02.137625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 131/262] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:02 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:02.162112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040eed-11d6-4a69-b157-7250b25fd7d2 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:02.174008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040eed-11d6-4a69-b157-7250b25fd7d2 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:02.178008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1ca83-b857-4897-994d-b6ebee4ba12c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EEtGCwRhSHu8jAqlPOqUrA, audit_chain_id=['EEtGCwRhSHu8jAqlPOqUrA']) at 0x7fe09e1b0940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:02.178736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1ca83-b857-4897-994d-b6ebee4ba12c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:02.179024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1ca83-b857-4897-994d-b6ebee4ba12c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:02.179333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1ca83-b857-4897-994d-b6ebee4ba12c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:02.190449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1ca83-b857-4897-994d-b6ebee4ba12c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:02.197163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-83d1ca83-b857-4897-994d-b6ebee4ba12c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:36:02.198264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 132/263] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:36:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:02.204898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd607b-b5c2-419e-b2c7-bad411604c9f None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:02.213543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd607b-b5c2-419e-b2c7-bad411604c9f None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:02.218201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ce0a7-11b7-494c-a277-86545325712a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EEtGCwRhSHu8jAqlPOqUrA, audit_chain_id=['EEtGCwRhSHu8jAqlPOqUrA']) at 0x7fe09e150700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:02.218948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ce0a7-11b7-494c-a277-86545325712a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:02.219278 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ce0a7-11b7-494c-a277-86545325712a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:02.219566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ce0a7-11b7-494c-a277-86545325712a admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:02.220544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ce0a7-11b7-494c-a277-86545325712a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:02.220844 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ce0a7-11b7-494c-a277-86545325712a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:02.222428 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ce0a7-11b7-494c-a277-86545325712a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:02.230802 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 132/264] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:02.236556 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1ca83-b857-4897-994d-b6ebee4ba12c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:02.247234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1ca83-b857-4897-994d-b6ebee4ba12c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:02.251896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774375-cf4c-449d-a9a1-e8f053fc1fcb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EEtGCwRhSHu8jAqlPOqUrA, audit_chain_id=['EEtGCwRhSHu8jAqlPOqUrA']) at 0x7fe09e17faf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:02.252475 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774375-cf4c-449d-a9a1-e8f053fc1fcb admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:02.252764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774375-cf4c-449d-a9a1-e8f053fc1fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:02.253047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774375-cf4c-449d-a9a1-e8f053fc1fcb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:02.261346 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b774375-cf4c-449d-a9a1-e8f053fc1fcb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:02.263091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b774375-cf4c-449d-a9a1-e8f053fc1fcb admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:02.272412 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 133/265] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:02 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:02.278120 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ce0a7-11b7-494c-a277-86545325712a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:02.287696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ce0a7-11b7-494c-a277-86545325712a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:02.291793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5856af-2517-4db5-83d7-7a1cf0d87e2b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EEtGCwRhSHu8jAqlPOqUrA, audit_chain_id=['EEtGCwRhSHu8jAqlPOqUrA']) at 0x7fe09e150d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:02.292574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5856af-2517-4db5-83d7-7a1cf0d87e2b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:02.292865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5856af-2517-4db5-83d7-7a1cf0d87e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:02.293151 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5856af-2517-4db5-83d7-7a1cf0d87e2b admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:02.294244 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5856af-2517-4db5-83d7-7a1cf0d87e2b admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:02.296452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5856af-2517-4db5-83d7-7a1cf0d87e2b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:02.297985 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 133/266] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:02 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:02.303372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774375-cf4c-449d-a9a1-e8f053fc1fcb admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:02.312752 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774375-cf4c-449d-a9a1-e8f053fc1fcb admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:02.316910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050996f2-c432-4d72-ac97-625b83a9dc12 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EEtGCwRhSHu8jAqlPOqUrA, audit_chain_id=['EEtGCwRhSHu8jAqlPOqUrA']) at 0x7fe09e17fc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:02.317691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050996f2-c432-4d72-ac97-625b83a9dc12 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:02.317980 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050996f2-c432-4d72-ac97-625b83a9dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:02.318264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050996f2-c432-4d72-ac97-625b83a9dc12 admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:02.319378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050996f2-c432-4d72-ac97-625b83a9dc12 admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:02.321269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050996f2-c432-4d72-ac97-625b83a9dc12 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:02.322714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 134/267] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:02 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:02.329774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5856af-2517-4db5-83d7-7a1cf0d87e2b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:02.339856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5856af-2517-4db5-83d7-7a1cf0d87e2b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:02.345242 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7edc4f-9307-4493-b001-13cc147c7696 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EEtGCwRhSHu8jAqlPOqUrA, audit_chain_id=['EEtGCwRhSHu8jAqlPOqUrA']) at 0x7fe09e150be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:02.345821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edc4f-9307-4493-b001-13cc147c7696 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:02.346115 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edc4f-9307-4493-b001-13cc147c7696 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:02.346402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edc4f-9307-4493-b001-13cc147c7696 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:02.347210 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7edc4f-9307-4493-b001-13cc147c7696 admin admin] RBAC: Adding query filter params (group.id=184ad7b9c43c4141a32aba9a290f5a84, role.id=5fae8096df3e470085794883a1631067, scope.project.id=536234568c1a477aaa466a4b57b0731f) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:02.347518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7edc4f-9307-4493-b001-13cc147c7696 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:02.349391 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7edc4f-9307-4493-b001-13cc147c7696 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:02.354718 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 134/268] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Feb 28 18:36:02 2022] GET /identity/v3/role_assignments?group.id=184ad7b9c43c4141a32aba9a290f5a84&scope.project.id=536234568c1a477aaa466a4b57b0731f&role.id=5fae8096df3e470085794883a1631067 => generated 260 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:04.493245 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900570a4-d8a5-4efe-84c9-1648c316fd7f None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:04.493891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900570a4-d8a5-4efe-84c9-1648c316fd7f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:04.493891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900570a4-d8a5-4efe-84c9-1648c316fd7f None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:04.495599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 135/269] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:04.502152 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519718a-4200-4931-a811-c1b0f62f7df4 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:04.502713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519718a-4200-4931-a811-c1b0f62f7df4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:04.502713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519718a-4200-4931-a811-c1b0f62f7df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:04.525621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3519718a-4200-4931-a811-c1b0f62f7df4 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:04.526789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3519718a-4200-4931-a811-c1b0f62f7df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:04.534631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 135/270] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:04 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:04.558425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900570a4-d8a5-4efe-84c9-1648c316fd7f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:04.571064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900570a4-d8a5-4efe-84c9-1648c316fd7f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:04.575136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078142e8-d91b-4253-b4a4-7d5fcc9acd82 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nFb0xViQQD-7kOcupMSBDA, audit_chain_id=['nFb0xViQQD-7kOcupMSBDA']) at 0x7fe09e17ff70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:04.575901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078142e8-d91b-4253-b4a4-7d5fcc9acd82 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:04.576189 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078142e8-d91b-4253-b4a4-7d5fcc9acd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:04.576500 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078142e8-d91b-4253-b4a4-7d5fcc9acd82 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:04.588819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078142e8-d91b-4253-b4a4-7d5fcc9acd82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:04.596896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-078142e8-d91b-4253-b4a4-7d5fcc9acd82 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:36:04.598091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 136/271] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:36:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:04.604144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519718a-4200-4931-a811-c1b0f62f7df4 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:04.613794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519718a-4200-4931-a811-c1b0f62f7df4 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:04.617950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a107b-a17d-41e9-adb6-bc509e04fad6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nFb0xViQQD-7kOcupMSBDA, audit_chain_id=['nFb0xViQQD-7kOcupMSBDA']) at 0x7fe09e1e67f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:04.618567 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a107b-a17d-41e9-adb6-bc509e04fad6 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:04.618931 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a107b-a17d-41e9-adb6-bc509e04fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:04.619433 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a107b-a17d-41e9-adb6-bc509e04fad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:04.620174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a107b-a17d-41e9-adb6-bc509e04fad6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:04.620702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a107b-a17d-41e9-adb6-bc509e04fad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:04.622339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a107b-a17d-41e9-adb6-bc509e04fad6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:04.631538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 136/272] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:04.637230 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078142e8-d91b-4253-b4a4-7d5fcc9acd82 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:04.647614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078142e8-d91b-4253-b4a4-7d5fcc9acd82 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:04.651733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63f37c-9c58-41c7-b0eb-fa77a3cd0dc7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nFb0xViQQD-7kOcupMSBDA, audit_chain_id=['nFb0xViQQD-7kOcupMSBDA']) at 0x7fe09e1c21c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:04.652529 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63f37c-9c58-41c7-b0eb-fa77a3cd0dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:04.652817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63f37c-9c58-41c7-b0eb-fa77a3cd0dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:04.653097 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63f37c-9c58-41c7-b0eb-fa77a3cd0dc7 admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:04.654185 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63f37c-9c58-41c7-b0eb-fa77a3cd0dc7 admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:04.656788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63f37c-9c58-41c7-b0eb-fa77a3cd0dc7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:04.658309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 137/273] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:04 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:04.664063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a107b-a17d-41e9-adb6-bc509e04fad6 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:04.674329 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a107b-a17d-41e9-adb6-bc509e04fad6 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:04.678372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d08d2-5d67-4e43-b80e-c4ca70e2b4d3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nFb0xViQQD-7kOcupMSBDA, audit_chain_id=['nFb0xViQQD-7kOcupMSBDA']) at 0x7fe09e1e6ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:04.679207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d08d2-5d67-4e43-b80e-c4ca70e2b4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:04.679500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d08d2-5d67-4e43-b80e-c4ca70e2b4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:04.679782 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d08d2-5d67-4e43-b80e-c4ca70e2b4d3 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:04.680898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d08d2-5d67-4e43-b80e-c4ca70e2b4d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:04.682971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d08d2-5d67-4e43-b80e-c4ca70e2b4d3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:04.684617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 137/274] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:04 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:04.691711 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63f37c-9c58-41c7-b0eb-fa77a3cd0dc7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:04.702204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63f37c-9c58-41c7-b0eb-fa77a3cd0dc7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:04.707210 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02319da-b768-4c28-bc08-c06ec0e5fbfd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nFb0xViQQD-7kOcupMSBDA, audit_chain_id=['nFb0xViQQD-7kOcupMSBDA']) at 0x7fe09e1c2880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:04.708044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02319da-b768-4c28-bc08-c06ec0e5fbfd admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:04.708331 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02319da-b768-4c28-bc08-c06ec0e5fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:04.708611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02319da-b768-4c28-bc08-c06ec0e5fbfd admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f/groups/184ad7b9c43c4141a32aba9a290f5a84/roles/5fae8096df3e470085794883a1631067` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:04.710700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02319da-b768-4c28-bc08-c06ec0e5fbfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=536234568c1a477aaa466a4b57b0731f, group_id=184ad7b9c43c4141a32aba9a290f5a84, role_id=5fae8096df3e470085794883a1631067)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:04.713422 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02319da-b768-4c28-bc08-c06ec0e5fbfd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:04.770174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 138/275] 10.222.0.21 () {58 vars in 1463 bytes} [Mon Feb 28 18:36:04 2022] PUT /identity/v3/projects/536234568c1a477aaa466a4b57b0731f/groups/184ad7b9c43c4141a32aba9a290f5a84/roles/5fae8096df3e470085794883a1631067 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:36:06.928347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7455329-9832-4368-8100-8eb414890815 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:06.928896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7455329-9832-4368-8100-8eb414890815 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:06.928896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7455329-9832-4368-8100-8eb414890815 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:06.930639 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 138/276] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:06.936743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b36954-fe27-4bb2-9ba1-617d25b377b3 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:06.937273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b36954-fe27-4bb2-9ba1-617d25b377b3 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:06.937375 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b36954-fe27-4bb2-9ba1-617d25b377b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:06.962458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e4b36954-fe27-4bb2-9ba1-617d25b377b3 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:06.963712 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e4b36954-fe27-4bb2-9ba1-617d25b377b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:07.034755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 139/277] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:06 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:07.061572 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7455329-9832-4368-8100-8eb414890815 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:07.074464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7455329-9832-4368-8100-8eb414890815 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:07.079381 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b9a6a-ac0a-4938-9ce1-023b38ce2c6a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YSm3FjQHROK4IRIknuE4Yw, audit_chain_id=['YSm3FjQHROK4IRIknuE4Yw']) at 0x7fe09e1e6430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:07.080143 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b9a6a-ac0a-4938-9ce1-023b38ce2c6a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:07.080416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b9a6a-ac0a-4938-9ce1-023b38ce2c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:07.080721 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b9a6a-ac0a-4938-9ce1-023b38ce2c6a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:07.093904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b9a6a-ac0a-4938-9ce1-023b38ce2c6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:07.105122 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-876b9a6a-ac0a-4938-9ce1-023b38ce2c6a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:36:07.106328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 139/278] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:36:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:07.113542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b36954-fe27-4bb2-9ba1-617d25b377b3 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:07.122915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b36954-fe27-4bb2-9ba1-617d25b377b3 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:07.128023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f39e06-e903-4a28-be87-dcedc558b220 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YSm3FjQHROK4IRIknuE4Yw, audit_chain_id=['YSm3FjQHROK4IRIknuE4Yw']) at 0x7fe09e1c2700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:07.128638 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f39e06-e903-4a28-be87-dcedc558b220 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:07.128929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f39e06-e903-4a28-be87-dcedc558b220 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:07.129216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f39e06-e903-4a28-be87-dcedc558b220 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:07.129976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f39e06-e903-4a28-be87-dcedc558b220 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:07.130276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f39e06-e903-4a28-be87-dcedc558b220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:07.131951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f39e06-e903-4a28-be87-dcedc558b220 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:07.141194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 140/279] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:07.146999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b9a6a-ac0a-4938-9ce1-023b38ce2c6a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:07.157162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b9a6a-ac0a-4938-9ce1-023b38ce2c6a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:07.161493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f4ac6-201f-445c-8ab7-d3a7d9a42b1d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YSm3FjQHROK4IRIknuE4Yw, audit_chain_id=['YSm3FjQHROK4IRIknuE4Yw']) at 0x7fe09e143c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:07.162086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4ac6-201f-445c-8ab7-d3a7d9a42b1d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:07.162379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4ac6-201f-445c-8ab7-d3a7d9a42b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:07.162664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4ac6-201f-445c-8ab7-d3a7d9a42b1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:07.171695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f4ac6-201f-445c-8ab7-d3a7d9a42b1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:07.173462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f4ac6-201f-445c-8ab7-d3a7d9a42b1d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:07.182645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 140/280] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:07 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:07.189207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f39e06-e903-4a28-be87-dcedc558b220 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:07.198889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f39e06-e903-4a28-be87-dcedc558b220 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:07.203918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc9d3-a443-42d4-b6c0-84f70bda221e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YSm3FjQHROK4IRIknuE4Yw, audit_chain_id=['YSm3FjQHROK4IRIknuE4Yw']) at 0x7fe09e1b0550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:07.205367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc9d3-a443-42d4-b6c0-84f70bda221e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:07.205367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc9d3-a443-42d4-b6c0-84f70bda221e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:07.205367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc9d3-a443-42d4-b6c0-84f70bda221e admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:07.206405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fc9d3-a443-42d4-b6c0-84f70bda221e admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:07.208487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fc9d3-a443-42d4-b6c0-84f70bda221e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:07.210061 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 141/281] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:07 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:07.215821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f4ac6-201f-445c-8ab7-d3a7d9a42b1d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:07.225137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f4ac6-201f-445c-8ab7-d3a7d9a42b1d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:07.229623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274a0b4-f327-47ff-bd50-85a9026dcba7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YSm3FjQHROK4IRIknuE4Yw, audit_chain_id=['YSm3FjQHROK4IRIknuE4Yw']) at 0x7fe09e1e6bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:07.230464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a0b4-f327-47ff-bd50-85a9026dcba7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:07.230733 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a0b4-f327-47ff-bd50-85a9026dcba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:07.231065 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a0b4-f327-47ff-bd50-85a9026dcba7 admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:07.232200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274a0b4-f327-47ff-bd50-85a9026dcba7 admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:07.234821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274a0b4-f327-47ff-bd50-85a9026dcba7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:07.236381 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 141/282] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:07 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:07.242497 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc9d3-a443-42d4-b6c0-84f70bda221e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:07.253753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc9d3-a443-42d4-b6c0-84f70bda221e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:07.258120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166890d4-e124-4bae-a1f6-f6ee51f87a10 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YSm3FjQHROK4IRIknuE4Yw, audit_chain_id=['YSm3FjQHROK4IRIknuE4Yw']) at 0x7fe09e1b0ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:07.258705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166890d4-e124-4bae-a1f6-f6ee51f87a10 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:07.259005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166890d4-e124-4bae-a1f6-f6ee51f87a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:07.259316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166890d4-e124-4bae-a1f6-f6ee51f87a10 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:07.260107 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166890d4-e124-4bae-a1f6-f6ee51f87a10 admin admin] RBAC: Adding query filter params (group.id=184ad7b9c43c4141a32aba9a290f5a84, role.id=5fae8096df3e470085794883a1631067, scope.project.id=536234568c1a477aaa466a4b57b0731f) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:07.260450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166890d4-e124-4bae-a1f6-f6ee51f87a10 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:07.262298 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166890d4-e124-4bae-a1f6-f6ee51f87a10 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:07.269107 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 142/283] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Feb 28 18:36:07 2022] GET /identity/v3/role_assignments?group.id=184ad7b9c43c4141a32aba9a290f5a84&scope.project.id=536234568c1a477aaa466a4b57b0731f&role.id=5fae8096df3e470085794883a1631067 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:09.527061 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc417a-7797-4733-8343-8876b8385875 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:09.527636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc417a-7797-4733-8343-8876b8385875 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:09.527636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc417a-7797-4733-8343-8876b8385875 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:09.529402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 142/284] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:09.534797 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae1d3c-ad0b-4a19-a6d9-0142346bf382 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:09.535274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae1d3c-ad0b-4a19-a6d9-0142346bf382 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:09.535396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae1d3c-ad0b-4a19-a6d9-0142346bf382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:09.557610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-9dae1d3c-ad0b-4a19-a6d9-0142346bf382 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:09.558743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9dae1d3c-ad0b-4a19-a6d9-0142346bf382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:09.566179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 143/285] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:09 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:09.589033 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc417a-7797-4733-8343-8876b8385875 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:09.601112 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc417a-7797-4733-8343-8876b8385875 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:09.605037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff034b-60bd-4fdf-8f09-3673cd3cf85a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xEQRRFgySemCaJ4OKrO1mA, audit_chain_id=['xEQRRFgySemCaJ4OKrO1mA']) at 0x7fe09e1e6f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:09.605879 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff034b-60bd-4fdf-8f09-3673cd3cf85a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:09.606167 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff034b-60bd-4fdf-8f09-3673cd3cf85a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:09.606446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff034b-60bd-4fdf-8f09-3673cd3cf85a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:09.618309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff034b-60bd-4fdf-8f09-3673cd3cf85a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:09.625319 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-18ff034b-60bd-4fdf-8f09-3673cd3cf85a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:36:09.626428 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 143/286] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:09.632256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae1d3c-ad0b-4a19-a6d9-0142346bf382 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:09.643730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae1d3c-ad0b-4a19-a6d9-0142346bf382 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:09.647826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa73a6-1961-48fc-9e82-9a9529ed5214 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xEQRRFgySemCaJ4OKrO1mA, audit_chain_id=['xEQRRFgySemCaJ4OKrO1mA']) at 0x7fe09e1a7820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:09.648416 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa73a6-1961-48fc-9e82-9a9529ed5214 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:09.648702 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa73a6-1961-48fc-9e82-9a9529ed5214 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:09.648982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa73a6-1961-48fc-9e82-9a9529ed5214 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:09.649694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa73a6-1961-48fc-9e82-9a9529ed5214 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:09.649995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa73a6-1961-48fc-9e82-9a9529ed5214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:09.651628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa73a6-1961-48fc-9e82-9a9529ed5214 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:09.660271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 144/287] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:36:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:09.665725 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff034b-60bd-4fdf-8f09-3673cd3cf85a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:09.676087 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff034b-60bd-4fdf-8f09-3673cd3cf85a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:09.680111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f21d2-7975-4d7d-a572-2a2b7a05d127 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xEQRRFgySemCaJ4OKrO1mA, audit_chain_id=['xEQRRFgySemCaJ4OKrO1mA']) at 0x7fe09e1dd970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:09.680683 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f21d2-7975-4d7d-a572-2a2b7a05d127 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:09.680977 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f21d2-7975-4d7d-a572-2a2b7a05d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:09.681262 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f21d2-7975-4d7d-a572-2a2b7a05d127 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:09.690916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f21d2-7975-4d7d-a572-2a2b7a05d127 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:09.692685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f21d2-7975-4d7d-a572-2a2b7a05d127 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:09.701187 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 144/288] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:09 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:09.706654 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa73a6-1961-48fc-9e82-9a9529ed5214 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:09.715903 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa73a6-1961-48fc-9e82-9a9529ed5214 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:09.720256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ea997-d03e-47fa-b3a5-b2d6586e82f8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xEQRRFgySemCaJ4OKrO1mA, audit_chain_id=['xEQRRFgySemCaJ4OKrO1mA']) at 0x7fe09e1cc280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:09.721030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea997-d03e-47fa-b3a5-b2d6586e82f8 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:09.721315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea997-d03e-47fa-b3a5-b2d6586e82f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:09.721595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea997-d03e-47fa-b3a5-b2d6586e82f8 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:09.722670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ea997-d03e-47fa-b3a5-b2d6586e82f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:09.724747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ea997-d03e-47fa-b3a5-b2d6586e82f8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:09.726251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 145/289] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:09 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:09.731687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f21d2-7975-4d7d-a572-2a2b7a05d127 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:09.740566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f21d2-7975-4d7d-a572-2a2b7a05d127 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:09.744568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3aa88-eaaa-4b7f-b110-b0db322ee951 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xEQRRFgySemCaJ4OKrO1mA, audit_chain_id=['xEQRRFgySemCaJ4OKrO1mA']) at 0x7fe09e194100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:09.745336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3aa88-eaaa-4b7f-b110-b0db322ee951 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:09.745624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3aa88-eaaa-4b7f-b110-b0db322ee951 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:09.745905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3aa88-eaaa-4b7f-b110-b0db322ee951 admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:09.746969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3aa88-eaaa-4b7f-b110-b0db322ee951 admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:09.749592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3aa88-eaaa-4b7f-b110-b0db322ee951 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:09.751026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 145/290] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:09 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:09.756494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ea997-d03e-47fa-b3a5-b2d6586e82f8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:09.766021 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ea997-d03e-47fa-b3a5-b2d6586e82f8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:09.770013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce5945-9cca-42aa-b86d-c818e25c1df9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xEQRRFgySemCaJ4OKrO1mA, audit_chain_id=['xEQRRFgySemCaJ4OKrO1mA']) at 0x7fe09e1ccbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:09.770584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5945-9cca-42aa-b86d-c818e25c1df9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:09.770873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5945-9cca-42aa-b86d-c818e25c1df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:09.771183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5945-9cca-42aa-b86d-c818e25c1df9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:09.771982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce5945-9cca-42aa-b86d-c818e25c1df9 admin admin] RBAC: Adding query filter params (group.id=184ad7b9c43c4141a32aba9a290f5a84, role.id=ddd473dfc0884753855419d1711fd868, scope.project.id=957d6be248554f84b1624d5a66f21ae1) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:09.772287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce5945-9cca-42aa-b86d-c818e25c1df9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:09.774121 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce5945-9cca-42aa-b86d-c818e25c1df9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:09.780123 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 146/291] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Feb 28 18:36:09 2022] GET /identity/v3/role_assignments?group.id=184ad7b9c43c4141a32aba9a290f5a84&scope.project.id=957d6be248554f84b1624d5a66f21ae1&role.id=ddd473dfc0884753855419d1711fd868 => generated 260 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:11.877981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7db4a9-e84c-4522-8e4b-2ad093894ddc None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:11.878543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7db4a9-e84c-4522-8e4b-2ad093894ddc None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:11.878543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7db4a9-e84c-4522-8e4b-2ad093894ddc None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:11.880253 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 146/292] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:11.885538 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b12eb-ced1-4bac-a24b-ba2d683602b9 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:11.885954 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b12eb-ced1-4bac-a24b-ba2d683602b9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:11.886110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b12eb-ced1-4bac-a24b-ba2d683602b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:11.908984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-bb1b12eb-ced1-4bac-a24b-ba2d683602b9 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:11.910132 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-bb1b12eb-ced1-4bac-a24b-ba2d683602b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:11.917286 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 147/293] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:36:11.940094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7db4a9-e84c-4522-8e4b-2ad093894ddc None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:11.952647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7db4a9-e84c-4522-8e4b-2ad093894ddc None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:11.956566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f09f5-1505-4cd8-afc0-f32753ab6a07 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WCUCRsrvQkegjn5mwEFlTw, audit_chain_id=['WCUCRsrvQkegjn5mwEFlTw']) at 0x7fe09e194970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:11.957284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f09f5-1505-4cd8-afc0-f32753ab6a07 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:11.957571 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f09f5-1505-4cd8-afc0-f32753ab6a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:11.957849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f09f5-1505-4cd8-afc0-f32753ab6a07 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:11.970215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f09f5-1505-4cd8-afc0-f32753ab6a07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:11.976586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-346f09f5-1505-4cd8-afc0-f32753ab6a07 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:36:11.977690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 147/294] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:11.983576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b12eb-ced1-4bac-a24b-ba2d683602b9 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:11.992165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b12eb-ced1-4bac-a24b-ba2d683602b9 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:11.996967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61b8ef-f203-4164-bdc7-9aa83c5b41d6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WCUCRsrvQkegjn5mwEFlTw, audit_chain_id=['WCUCRsrvQkegjn5mwEFlTw']) at 0x7fe09e1e5400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:11.997555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61b8ef-f203-4164-bdc7-9aa83c5b41d6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:11.997838 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61b8ef-f203-4164-bdc7-9aa83c5b41d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:11.998650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61b8ef-f203-4164-bdc7-9aa83c5b41d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:11.999498 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61b8ef-f203-4164-bdc7-9aa83c5b41d6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:11.999798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61b8ef-f203-4164-bdc7-9aa83c5b41d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:12.001423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61b8ef-f203-4164-bdc7-9aa83c5b41d6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:12.010138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 148/295] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:36:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:12.016266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f09f5-1505-4cd8-afc0-f32753ab6a07 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:12.025925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f09f5-1505-4cd8-afc0-f32753ab6a07 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:12.030129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29208244-48bb-4d52-90a6-b0baf0fe82da admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WCUCRsrvQkegjn5mwEFlTw, audit_chain_id=['WCUCRsrvQkegjn5mwEFlTw']) at 0x7fe09e143a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:12.030894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29208244-48bb-4d52-90a6-b0baf0fe82da admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:12.031215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29208244-48bb-4d52-90a6-b0baf0fe82da admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:12.031504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29208244-48bb-4d52-90a6-b0baf0fe82da admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:12.032570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29208244-48bb-4d52-90a6-b0baf0fe82da admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:12.034438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29208244-48bb-4d52-90a6-b0baf0fe82da admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:12.035902 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 148/296] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:12 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:12.041164 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61b8ef-f203-4164-bdc7-9aa83c5b41d6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:12.050304 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61b8ef-f203-4164-bdc7-9aa83c5b41d6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:12.054288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1ae0e-fddf-4d43-b449-b0af3afdf503 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WCUCRsrvQkegjn5mwEFlTw, audit_chain_id=['WCUCRsrvQkegjn5mwEFlTw']) at 0x7fe09e1e5b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:12.055054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1ae0e-fddf-4d43-b449-b0af3afdf503 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:12.055371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1ae0e-fddf-4d43-b449-b0af3afdf503 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:12.055652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1ae0e-fddf-4d43-b449-b0af3afdf503 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:12.056721 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1ae0e-fddf-4d43-b449-b0af3afdf503 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:12.058762 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1ae0e-fddf-4d43-b449-b0af3afdf503 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:12.060296 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 149/297] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:12 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:12.066367 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29208244-48bb-4d52-90a6-b0baf0fe82da admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:12.075634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29208244-48bb-4d52-90a6-b0baf0fe82da admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:12.080365 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c5109-ca9a-46d6-b4e8-c72dcc6f425c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WCUCRsrvQkegjn5mwEFlTw, audit_chain_id=['WCUCRsrvQkegjn5mwEFlTw']) at 0x7fe09e143250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:12.081162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c5109-ca9a-46d6-b4e8-c72dcc6f425c admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:12.081451 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c5109-ca9a-46d6-b4e8-c72dcc6f425c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:12.081736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c5109-ca9a-46d6-b4e8-c72dcc6f425c admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1/groups/184ad7b9c43c4141a32aba9a290f5a84/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:12.083535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c5109-ca9a-46d6-b4e8-c72dcc6f425c admin admin] RBAC: Authorizing `identity:create_grant(project_id=957d6be248554f84b1624d5a66f21ae1, group_id=184ad7b9c43c4141a32aba9a290f5a84, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:12.086121 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c5109-ca9a-46d6-b4e8-c72dcc6f425c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:12.202856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 149/298] 10.222.0.21 () {58 vars in 1463 bytes} [Mon Feb 28 18:36:12 2022] PUT /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1/groups/184ad7b9c43c4141a32aba9a290f5a84/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:36:14.310351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f4354-db5e-4a22-bfb6-79ad73fa695e None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.310910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f4354-db5e-4a22-bfb6-79ad73fa695e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.310910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f4354-db5e-4a22-bfb6-79ad73fa695e None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.312541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 150/299] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:14.318004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b986ae9-4377-40ba-af0e-76632913b0e0 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.318432 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b986ae9-4377-40ba-af0e-76632913b0e0 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.318574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b986ae9-4377-40ba-af0e-76632913b0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.340502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-6b986ae9-4377-40ba-af0e-76632913b0e0 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:14.341654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6b986ae9-4377-40ba-af0e-76632913b0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:14.405532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 150/300] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:14.429138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f4354-db5e-4a22-bfb6-79ad73fa695e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:14.440905 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f4354-db5e-4a22-bfb6-79ad73fa695e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:14.444873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce4cc4-b0f4-46aa-9aef-7560f2044e1a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4Md5x2beTs6ZXLP3-tulxA, audit_chain_id=['4Md5x2beTs6ZXLP3-tulxA']) at 0x7fe09e1e5070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:14.445593 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce4cc4-b0f4-46aa-9aef-7560f2044e1a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.445879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce4cc4-b0f4-46aa-9aef-7560f2044e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.446162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce4cc4-b0f4-46aa-9aef-7560f2044e1a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.457455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce4cc4-b0f4-46aa-9aef-7560f2044e1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:14.463865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-16ce4cc4-b0f4-46aa-9aef-7560f2044e1a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:36:14.464945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 151/301] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:14.471839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b986ae9-4377-40ba-af0e-76632913b0e0 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:14.480464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b986ae9-4377-40ba-af0e-76632913b0e0 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:14.485246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f60cf4-84a3-4758-9a42-e013d528db78 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4Md5x2beTs6ZXLP3-tulxA, audit_chain_id=['4Md5x2beTs6ZXLP3-tulxA']) at 0x7fe09e1500d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:14.485839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f60cf4-84a3-4758-9a42-e013d528db78 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.486126 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f60cf4-84a3-4758-9a42-e013d528db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.486404 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f60cf4-84a3-4758-9a42-e013d528db78 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.487138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f60cf4-84a3-4758-9a42-e013d528db78 admin admin] RBAC: Adding query filter params (name=member) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:14.487434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f60cf4-84a3-4758-9a42-e013d528db78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:14.489029 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f60cf4-84a3-4758-9a42-e013d528db78 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:14.497538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 151/302] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:36:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:14.503330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce4cc4-b0f4-46aa-9aef-7560f2044e1a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:14.512698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce4cc4-b0f4-46aa-9aef-7560f2044e1a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:14.517116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1748d-7635-41b5-a8ab-7c07d089a893 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4Md5x2beTs6ZXLP3-tulxA, audit_chain_id=['4Md5x2beTs6ZXLP3-tulxA']) at 0x7fe09e198580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:14.517689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1748d-7635-41b5-a8ab-7c07d089a893 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.517975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1748d-7635-41b5-a8ab-7c07d089a893 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.518259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1748d-7635-41b5-a8ab-7c07d089a893 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.525932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1748d-7635-41b5-a8ab-7c07d089a893 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:14.527714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1748d-7635-41b5-a8ab-7c07d089a893 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:14.536652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 152/303] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:14 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:14.542202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f60cf4-84a3-4758-9a42-e013d528db78 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:14.551995 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f60cf4-84a3-4758-9a42-e013d528db78 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:14.555930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5098cd7-092a-4949-9370-96fc25ca2455 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4Md5x2beTs6ZXLP3-tulxA, audit_chain_id=['4Md5x2beTs6ZXLP3-tulxA']) at 0x7fe09e1e6b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:14.556709 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5098cd7-092a-4949-9370-96fc25ca2455 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.556996 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5098cd7-092a-4949-9370-96fc25ca2455 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.557277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5098cd7-092a-4949-9370-96fc25ca2455 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.558344 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5098cd7-092a-4949-9370-96fc25ca2455 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:14.560544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5098cd7-092a-4949-9370-96fc25ca2455 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:14.562059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 152/304] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:14 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:14.567376 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1748d-7635-41b5-a8ab-7c07d089a893 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:14.576074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1748d-7635-41b5-a8ab-7c07d089a893 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:14.580738 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088f15b-cc26-408f-a1f1-1d6656e861f0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4Md5x2beTs6ZXLP3-tulxA, audit_chain_id=['4Md5x2beTs6ZXLP3-tulxA']) at 0x7fe09e198d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:14.581514 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f15b-cc26-408f-a1f1-1d6656e861f0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.581807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f15b-cc26-408f-a1f1-1d6656e861f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.582095 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f15b-cc26-408f-a1f1-1d6656e861f0 admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.583198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088f15b-cc26-408f-a1f1-1d6656e861f0 admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:14.585082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088f15b-cc26-408f-a1f1-1d6656e861f0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:14.586516 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 153/305] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:14 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:14.592575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5098cd7-092a-4949-9370-96fc25ca2455 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:14.601954 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5098cd7-092a-4949-9370-96fc25ca2455 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:14.605904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bab1eb-d05a-4f60-981a-8c9d6e6372e7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4Md5x2beTs6ZXLP3-tulxA, audit_chain_id=['4Md5x2beTs6ZXLP3-tulxA']) at 0x7fe09e1e60d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:14.606480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bab1eb-d05a-4f60-981a-8c9d6e6372e7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.606771 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bab1eb-d05a-4f60-981a-8c9d6e6372e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.607053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bab1eb-d05a-4f60-981a-8c9d6e6372e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.608460 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bab1eb-d05a-4f60-981a-8c9d6e6372e7 admin admin] RBAC: Adding query filter params (group.id=184ad7b9c43c4141a32aba9a290f5a84, role.id=ddd473dfc0884753855419d1711fd868, scope.project.id=957d6be248554f84b1624d5a66f21ae1) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:14.608759 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bab1eb-d05a-4f60-981a-8c9d6e6372e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:14.610552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bab1eb-d05a-4f60-981a-8c9d6e6372e7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:14.616127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 153/306] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Feb 28 18:36:14 2022] GET /identity/v3/role_assignments?group.id=184ad7b9c43c4141a32aba9a290f5a84&scope.project.id=957d6be248554f84b1624d5a66f21ae1&role.id=ddd473dfc0884753855419d1711fd868 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:16.847089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b33475-8eb3-4612-bf59-77d242c94542 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:16.847659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b33475-8eb3-4612-bf59-77d242c94542 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:16.847763 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b33475-8eb3-4612-bf59-77d242c94542 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:16.849347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 154/307] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:16.854528 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2489b4-be45-44ac-9466-79adcce73b78 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:16.854964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2489b4-be45-44ac-9466-79adcce73b78 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:16.855098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2489b4-be45-44ac-9466-79adcce73b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:16.879245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3f2489b4-be45-44ac-9466-79adcce73b78 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:16.880393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3f2489b4-be45-44ac-9466-79adcce73b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:16.887334 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 154/308] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:16 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:16.911504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b33475-8eb3-4612-bf59-77d242c94542 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:16.924026 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b33475-8eb3-4612-bf59-77d242c94542 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:16.927959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe390b6-2e2a-4313-bc92-9460fcd98c2e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wXJkjlt9QiK_r4-1-WNtAg, audit_chain_id=['wXJkjlt9QiK_r4-1-WNtAg']) at 0x7fe09e1e5550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:16.928688 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe390b6-2e2a-4313-bc92-9460fcd98c2e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:16.928972 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe390b6-2e2a-4313-bc92-9460fcd98c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:16.929252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe390b6-2e2a-4313-bc92-9460fcd98c2e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:16.941815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe390b6-2e2a-4313-bc92-9460fcd98c2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:16.948484 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-afe390b6-2e2a-4313-bc92-9460fcd98c2e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:36:16.949604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 155/309] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:36:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:16.955619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2489b4-be45-44ac-9466-79adcce73b78 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:16.964374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2489b4-be45-44ac-9466-79adcce73b78 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:16.968898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b05b92-bd0a-40f7-98d0-10200dff9ee4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wXJkjlt9QiK_r4-1-WNtAg, audit_chain_id=['wXJkjlt9QiK_r4-1-WNtAg']) at 0x7fe09e1dd700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:16.969749 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b05b92-bd0a-40f7-98d0-10200dff9ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:16.970040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b05b92-bd0a-40f7-98d0-10200dff9ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:16.970321 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b05b92-bd0a-40f7-98d0-10200dff9ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:16.971040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b05b92-bd0a-40f7-98d0-10200dff9ee4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:16.971370 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b05b92-bd0a-40f7-98d0-10200dff9ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:16.972961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b05b92-bd0a-40f7-98d0-10200dff9ee4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:16.981265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 155/310] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:16.987904 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe390b6-2e2a-4313-bc92-9460fcd98c2e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.000593 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe390b6-2e2a-4313-bc92-9460fcd98c2e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.004672 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e87dc-8d1d-48a2-82af-be8e1acd54a5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wXJkjlt9QiK_r4-1-WNtAg, audit_chain_id=['wXJkjlt9QiK_r4-1-WNtAg']) at 0x7fe09e159a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.005269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e87dc-8d1d-48a2-82af-be8e1acd54a5 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.005560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e87dc-8d1d-48a2-82af-be8e1acd54a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.005865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e87dc-8d1d-48a2-82af-be8e1acd54a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.014118 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e87dc-8d1d-48a2-82af-be8e1acd54a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.015922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e87dc-8d1d-48a2-82af-be8e1acd54a5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:17.024437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 156/311] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:16 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:17.030053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b05b92-bd0a-40f7-98d0-10200dff9ee4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.039343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b05b92-bd0a-40f7-98d0-10200dff9ee4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.043276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e9b75-f14c-4457-a1ad-1c4ef4993973 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wXJkjlt9QiK_r4-1-WNtAg, audit_chain_id=['wXJkjlt9QiK_r4-1-WNtAg']) at 0x7fe09e1ddb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.044053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9b75-f14c-4457-a1ad-1c4ef4993973 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.044338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9b75-f14c-4457-a1ad-1c4ef4993973 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.044619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9b75-f14c-4457-a1ad-1c4ef4993973 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.046514 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e9b75-f14c-4457-a1ad-1c4ef4993973 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.048600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e9b75-f14c-4457-a1ad-1c4ef4993973 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:17.050111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 156/312] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:17.055586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e87dc-8d1d-48a2-82af-be8e1acd54a5 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.064811 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e87dc-8d1d-48a2-82af-be8e1acd54a5 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.068977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb608e5e-6fdb-484d-8077-1044481c6da0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wXJkjlt9QiK_r4-1-WNtAg, audit_chain_id=['wXJkjlt9QiK_r4-1-WNtAg']) at 0x7fe09e1591f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.069745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608e5e-6fdb-484d-8077-1044481c6da0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.070027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608e5e-6fdb-484d-8077-1044481c6da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.070302 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608e5e-6fdb-484d-8077-1044481c6da0 admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.071391 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb608e5e-6fdb-484d-8077-1044481c6da0 admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.073320 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb608e5e-6fdb-484d-8077-1044481c6da0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:17.074759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 157/313] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:17.080566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e9b75-f14c-4457-a1ad-1c4ef4993973 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.090011 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e9b75-f14c-4457-a1ad-1c4ef4993973 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.094654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf94861-ef6c-4b9b-ba7b-6639ed4bdffd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wXJkjlt9QiK_r4-1-WNtAg, audit_chain_id=['wXJkjlt9QiK_r4-1-WNtAg']) at 0x7fe09e212310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.095277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf94861-ef6c-4b9b-ba7b-6639ed4bdffd admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.095569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf94861-ef6c-4b9b-ba7b-6639ed4bdffd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.095855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf94861-ef6c-4b9b-ba7b-6639ed4bdffd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.096635 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf94861-ef6c-4b9b-ba7b-6639ed4bdffd admin admin] RBAC: Adding query filter params (group.id=184ad7b9c43c4141a32aba9a290f5a84, role.id=5fae8096df3e470085794883a1631067, scope.project.id=957d6be248554f84b1624d5a66f21ae1) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:17.096942 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf94861-ef6c-4b9b-ba7b-6639ed4bdffd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.098824 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf94861-ef6c-4b9b-ba7b-6639ed4bdffd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:17.104368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 157/314] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/role_assignments?group.id=184ad7b9c43c4141a32aba9a290f5a84&scope.project.id=957d6be248554f84b1624d5a66f21ae1&role.id=5fae8096df3e470085794883a1631067 => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:19.264334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52cd3-d7c1-4826-a790-0026f6438efd None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:19.264911 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52cd3-d7c1-4826-a790-0026f6438efd None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:19.264911 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52cd3-d7c1-4826-a790-0026f6438efd None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:19.266449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 158/315] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:19.271661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a4528-59dc-46cd-97b8-e2dc330e9bfb None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:19.272060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a4528-59dc-46cd-97b8-e2dc330e9bfb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:19.272231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a4528-59dc-46cd-97b8-e2dc330e9bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:19.294450 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-cb9a4528-59dc-46cd-97b8-e2dc330e9bfb None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:19.295825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-cb9a4528-59dc-46cd-97b8-e2dc330e9bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:19.302526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 158/316] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:19 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:19.329866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d52cd3-d7c1-4826-a790-0026f6438efd None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:19.342941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d52cd3-d7c1-4826-a790-0026f6438efd None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:19.347200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865276f-474a-4894-95fd-dac80c481ff9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CKO-GA9iQiePFc23-VsEYg, audit_chain_id=['CKO-GA9iQiePFc23-VsEYg']) at 0x7fe09e159b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:19.347926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865276f-474a-4894-95fd-dac80c481ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:19.348215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865276f-474a-4894-95fd-dac80c481ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:19.348495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865276f-474a-4894-95fd-dac80c481ff9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:19.359989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865276f-474a-4894-95fd-dac80c481ff9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:19.366701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-f865276f-474a-4894-95fd-dac80c481ff9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:36:19.367792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 159/317] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:36:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:19.373608 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a4528-59dc-46cd-97b8-e2dc330e9bfb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:19.382039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a4528-59dc-46cd-97b8-e2dc330e9bfb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:19.386026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947fcdc-c7bf-49b3-906f-a963554c26ab admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CKO-GA9iQiePFc23-VsEYg, audit_chain_id=['CKO-GA9iQiePFc23-VsEYg']) at 0x7fe09e1555e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:19.386616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947fcdc-c7bf-49b3-906f-a963554c26ab admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:19.386907 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947fcdc-c7bf-49b3-906f-a963554c26ab admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:19.387222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947fcdc-c7bf-49b3-906f-a963554c26ab admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:19.387929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947fcdc-c7bf-49b3-906f-a963554c26ab admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:19.388229 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947fcdc-c7bf-49b3-906f-a963554c26ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:19.390329 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947fcdc-c7bf-49b3-906f-a963554c26ab admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:19.398426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 159/318] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:19.403842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865276f-474a-4894-95fd-dac80c481ff9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:19.414168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865276f-474a-4894-95fd-dac80c481ff9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:19.418159 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094be66-62f1-44dd-8dcd-dae887ca79b4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CKO-GA9iQiePFc23-VsEYg, audit_chain_id=['CKO-GA9iQiePFc23-VsEYg']) at 0x7fe09e143be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:19.418917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094be66-62f1-44dd-8dcd-dae887ca79b4 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:19.419236 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094be66-62f1-44dd-8dcd-dae887ca79b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:19.419518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094be66-62f1-44dd-8dcd-dae887ca79b4 admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:19.420681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094be66-62f1-44dd-8dcd-dae887ca79b4 admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:19.422544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094be66-62f1-44dd-8dcd-dae887ca79b4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:19.424013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 160/319] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:19 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:19.429192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947fcdc-c7bf-49b3-906f-a963554c26ab admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:19.438589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947fcdc-c7bf-49b3-906f-a963554c26ab admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:19.442520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e3e49-f249-4977-8d17-77c9b1495322 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CKO-GA9iQiePFc23-VsEYg, audit_chain_id=['CKO-GA9iQiePFc23-VsEYg']) at 0x7fe09e14ec70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:19.443315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e3e49-f249-4977-8d17-77c9b1495322 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:19.443607 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e3e49-f249-4977-8d17-77c9b1495322 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:19.443889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e3e49-f249-4977-8d17-77c9b1495322 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:19.444971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e3e49-f249-4977-8d17-77c9b1495322 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:19.446973 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e3e49-f249-4977-8d17-77c9b1495322 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:19.448503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 160/320] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:19 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:19.454536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094be66-62f1-44dd-8dcd-dae887ca79b4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:19.463681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094be66-62f1-44dd-8dcd-dae887ca79b4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:19.468307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb9dc6-d08f-4c80-b07e-58ac510c5d41 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CKO-GA9iQiePFc23-VsEYg, audit_chain_id=['CKO-GA9iQiePFc23-VsEYg']) at 0x7fe09e143ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:19.469101 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9dc6-d08f-4c80-b07e-58ac510c5d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:19.469653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9dc6-d08f-4c80-b07e-58ac510c5d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:19.469934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9dc6-d08f-4c80-b07e-58ac510c5d41 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1/groups/184ad7b9c43c4141a32aba9a290f5a84/roles/5fae8096df3e470085794883a1631067` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:19.471956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb9dc6-d08f-4c80-b07e-58ac510c5d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957d6be248554f84b1624d5a66f21ae1, group_id=184ad7b9c43c4141a32aba9a290f5a84, role_id=5fae8096df3e470085794883a1631067)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:19.474539 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb9dc6-d08f-4c80-b07e-58ac510c5d41 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:19.618754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 161/321] 10.222.0.21 () {58 vars in 1463 bytes} [Mon Feb 28 18:36:19 2022] PUT /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1/groups/184ad7b9c43c4141a32aba9a290f5a84/roles/5fae8096df3e470085794883a1631067 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:36:21.735537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f302ef-d1d1-4d0a-b10f-7e74a64f3c9c None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:21.736099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f302ef-d1d1-4d0a-b10f-7e74a64f3c9c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:21.736099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f302ef-d1d1-4d0a-b10f-7e74a64f3c9c None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:21.737778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 161/322] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:21.743020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f6b6-baf3-4750-a374-fb7206bced09 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:21.743509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f6b6-baf3-4750-a374-fb7206bced09 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:21.743604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f6b6-baf3-4750-a374-fb7206bced09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:21.766737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-6e38f6b6-baf3-4750-a374-fb7206bced09 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:21.767921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-6e38f6b6-baf3-4750-a374-fb7206bced09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:21.832500 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 162/323] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:21 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:21.855162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f302ef-d1d1-4d0a-b10f-7e74a64f3c9c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:21.866714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f302ef-d1d1-4d0a-b10f-7e74a64f3c9c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:21.870632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025dc7f-686a-4af0-8d6f-1807941459ff admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lb1KYclOTGaFTS3_9YBSUw, audit_chain_id=['lb1KYclOTGaFTS3_9YBSUw']) at 0x7fe09e14eee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:21.871394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025dc7f-686a-4af0-8d6f-1807941459ff admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:21.871687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025dc7f-686a-4af0-8d6f-1807941459ff admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:21.871970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025dc7f-686a-4af0-8d6f-1807941459ff admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:21.885039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025dc7f-686a-4af0-8d6f-1807941459ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:21.892369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-2025dc7f-686a-4af0-8d6f-1807941459ff admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:36:21.893466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 162/324] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:36:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:21.899509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f6b6-baf3-4750-a374-fb7206bced09 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:21.908530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f6b6-baf3-4750-a374-fb7206bced09 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:21.912694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93e284-95f6-4171-bf36-9b22ac8c9ea8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lb1KYclOTGaFTS3_9YBSUw, audit_chain_id=['lb1KYclOTGaFTS3_9YBSUw']) at 0x7fe09e1c2700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:21.913294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93e284-95f6-4171-bf36-9b22ac8c9ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:21.913585 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93e284-95f6-4171-bf36-9b22ac8c9ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:21.913870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93e284-95f6-4171-bf36-9b22ac8c9ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:21.914584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93e284-95f6-4171-bf36-9b22ac8c9ea8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:21.914881 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93e284-95f6-4171-bf36-9b22ac8c9ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:21.916524 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93e284-95f6-4171-bf36-9b22ac8c9ea8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:21.925105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 163/325] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:21.930464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025dc7f-686a-4af0-8d6f-1807941459ff admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:21.940309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025dc7f-686a-4af0-8d6f-1807941459ff admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:21.944401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fca5f0-7b92-486e-ba92-e566eb7b391d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lb1KYclOTGaFTS3_9YBSUw, audit_chain_id=['lb1KYclOTGaFTS3_9YBSUw']) at 0x7fe09e1559a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:21.944979 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fca5f0-7b92-486e-ba92-e566eb7b391d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:21.945268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fca5f0-7b92-486e-ba92-e566eb7b391d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:21.945553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fca5f0-7b92-486e-ba92-e566eb7b391d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:21.954162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fca5f0-7b92-486e-ba92-e566eb7b391d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:21.955950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fca5f0-7b92-486e-ba92-e566eb7b391d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:21.964485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 163/326] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:21 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:21.970541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93e284-95f6-4171-bf36-9b22ac8c9ea8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:21.980003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93e284-95f6-4171-bf36-9b22ac8c9ea8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:21.987323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd9bc4-deb6-49ca-b3f3-b5935a928d53 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lb1KYclOTGaFTS3_9YBSUw, audit_chain_id=['lb1KYclOTGaFTS3_9YBSUw']) at 0x7fe09e1b8d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:21.988560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd9bc4-deb6-49ca-b3f3-b5935a928d53 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:21.989042 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd9bc4-deb6-49ca-b3f3-b5935a928d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:21.989530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd9bc4-deb6-49ca-b3f3-b5935a928d53 admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:21.991362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd9bc4-deb6-49ca-b3f3-b5935a928d53 admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:21.993415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd9bc4-deb6-49ca-b3f3-b5935a928d53 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:21.994981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 164/327] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:21 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:22.004361 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fca5f0-7b92-486e-ba92-e566eb7b391d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:22.013964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fca5f0-7b92-486e-ba92-e566eb7b391d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:22.018382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c97ffa-c5e0-4d39-9fbf-6b682f1d3153 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lb1KYclOTGaFTS3_9YBSUw, audit_chain_id=['lb1KYclOTGaFTS3_9YBSUw']) at 0x7fe09e155dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:22.019496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c97ffa-c5e0-4d39-9fbf-6b682f1d3153 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:22.019788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c97ffa-c5e0-4d39-9fbf-6b682f1d3153 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:22.020070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c97ffa-c5e0-4d39-9fbf-6b682f1d3153 admin admin] PATH_INFO: `/v3/groups/184ad7b9c43c4141a32aba9a290f5a84` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:22.021184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c97ffa-c5e0-4d39-9fbf-6b682f1d3153 admin admin] RBAC: Authorizing `identity:get_group(group_id=184ad7b9c43c4141a32aba9a290f5a84)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:22.023062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c97ffa-c5e0-4d39-9fbf-6b682f1d3153 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:22.024545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 164/328] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:22 2022] GET /identity/v3/groups/184ad7b9c43c4141a32aba9a290f5a84 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:22.035135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd9bc4-deb6-49ca-b3f3-b5935a928d53 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:22.045042 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd9bc4-deb6-49ca-b3f3-b5935a928d53 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:22.049273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391708fc-8981-4e8b-8974-e6b718e3089e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lb1KYclOTGaFTS3_9YBSUw, audit_chain_id=['lb1KYclOTGaFTS3_9YBSUw']) at 0x7fe09e1fb700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:22.049847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391708fc-8981-4e8b-8974-e6b718e3089e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:22.050135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391708fc-8981-4e8b-8974-e6b718e3089e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:22.050419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391708fc-8981-4e8b-8974-e6b718e3089e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:22.051226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391708fc-8981-4e8b-8974-e6b718e3089e admin admin] RBAC: Adding query filter params (group.id=184ad7b9c43c4141a32aba9a290f5a84, role.id=5fae8096df3e470085794883a1631067, scope.project.id=957d6be248554f84b1624d5a66f21ae1) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:22.051535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391708fc-8981-4e8b-8974-e6b718e3089e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:22.053357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391708fc-8981-4e8b-8974-e6b718e3089e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:22.064252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 165/329] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Feb 28 18:36:22 2022] GET /identity/v3/role_assignments?group.id=184ad7b9c43c4141a32aba9a290f5a84&scope.project.id=957d6be248554f84b1624d5a66f21ae1&role.id=5fae8096df3e470085794883a1631067 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:24.288659 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddc7e7-4905-44d7-b2d3-98655d3c2cbb None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:24.289181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddc7e7-4905-44d7-b2d3-98655d3c2cbb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:24.289181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddc7e7-4905-44d7-b2d3-98655d3c2cbb None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:24.290792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 165/330] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:24.296571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f90d-76f0-4407-a629-51d99e7d8221 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:24.297003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f90d-76f0-4407-a629-51d99e7d8221 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:24.297136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f90d-76f0-4407-a629-51d99e7d8221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:24.318847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-8c96f90d-76f0-4407-a629-51d99e7d8221 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:24.320017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8c96f90d-76f0-4407-a629-51d99e7d8221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:24.326792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 166/331] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:24 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:24.349897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddc7e7-4905-44d7-b2d3-98655d3c2cbb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:24.362573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddc7e7-4905-44d7-b2d3-98655d3c2cbb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:24.366550 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbf109-7d3e-403a-b908-fd8f79b43dee admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SYnkX2bIS1mO0BaKQCVi4A, audit_chain_id=['SYnkX2bIS1mO0BaKQCVi4A']) at 0x7fe09e155cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:24.367308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbf109-7d3e-403a-b908-fd8f79b43dee admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:24.367602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbf109-7d3e-403a-b908-fd8f79b43dee admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:24.367893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbf109-7d3e-403a-b908-fd8f79b43dee admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:24.379319 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbf109-7d3e-403a-b908-fd8f79b43dee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:24.385673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-62cbf109-7d3e-403a-b908-fd8f79b43dee admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:36:24.386743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 166/332] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:24.392805 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96f90d-76f0-4407-a629-51d99e7d8221 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:24.401271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96f90d-76f0-4407-a629-51d99e7d8221 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:24.405912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97f010-e231-4392-9549-f57b815c9273 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SYnkX2bIS1mO0BaKQCVi4A, audit_chain_id=['SYnkX2bIS1mO0BaKQCVi4A']) at 0x7fe09e143eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:24.406502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97f010-e231-4392-9549-f57b815c9273 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:24.406789 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97f010-e231-4392-9549-f57b815c9273 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:24.407070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97f010-e231-4392-9549-f57b815c9273 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:24.407804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97f010-e231-4392-9549-f57b815c9273 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:24.408106 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97f010-e231-4392-9549-f57b815c9273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:24.409677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97f010-e231-4392-9549-f57b815c9273 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:24.418003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 167/333] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:24.423957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbf109-7d3e-403a-b908-fd8f79b43dee admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:24.433663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbf109-7d3e-403a-b908-fd8f79b43dee admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:24.438372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73753140-0fc0-4d7b-a9d6-2b7bbe2a8233 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SYnkX2bIS1mO0BaKQCVi4A, audit_chain_id=['SYnkX2bIS1mO0BaKQCVi4A']) at 0x7fe09e14eee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:24.438937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753140-0fc0-4d7b-a9d6-2b7bbe2a8233 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:24.439282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753140-0fc0-4d7b-a9d6-2b7bbe2a8233 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:24.439571 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753140-0fc0-4d7b-a9d6-2b7bbe2a8233 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:24.447100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73753140-0fc0-4d7b-a9d6-2b7bbe2a8233 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:24.448849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73753140-0fc0-4d7b-a9d6-2b7bbe2a8233 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:24.458098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 167/334] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:24 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:24.463289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97f010-e231-4392-9549-f57b815c9273 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:24.473751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97f010-e231-4392-9549-f57b815c9273 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:24.477969 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48565b-b6ab-42e6-8904-8709f23eb632 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SYnkX2bIS1mO0BaKQCVi4A, audit_chain_id=['SYnkX2bIS1mO0BaKQCVi4A']) at 0x7fe09e14a7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:24.478743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48565b-b6ab-42e6-8904-8709f23eb632 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:24.479038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48565b-b6ab-42e6-8904-8709f23eb632 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:24.479348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48565b-b6ab-42e6-8904-8709f23eb632 admin admin] PATH_INFO: `/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:24.480430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48565b-b6ab-42e6-8904-8709f23eb632 admin admin] RBAC: Authorizing `identity:get_project(project_id=17d9ce9af82b4fd68fac993b9e9f37e5)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:24.482490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48565b-b6ab-42e6-8904-8709f23eb632 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:24.484039 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 168/335] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:24 2022] GET /identity/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:24.489605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73753140-0fc0-4d7b-a9d6-2b7bbe2a8233 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:24.498317 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73753140-0fc0-4d7b-a9d6-2b7bbe2a8233 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:24.502407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80105cc0-03c0-4197-a7ee-811e4fbac3fd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SYnkX2bIS1mO0BaKQCVi4A, audit_chain_id=['SYnkX2bIS1mO0BaKQCVi4A']) at 0x7fe09e1837c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:24.503215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80105cc0-03c0-4197-a7ee-811e4fbac3fd admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:24.503507 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80105cc0-03c0-4197-a7ee-811e4fbac3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:24.503789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80105cc0-03c0-4197-a7ee-811e4fbac3fd admin admin] PATH_INFO: `/v3/groups/1934d812a2a346f58e85f65014afb5e0` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:24.508402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80105cc0-03c0-4197-a7ee-811e4fbac3fd admin admin] RBAC: Authorizing `identity:get_group(group_id=1934d812a2a346f58e85f65014afb5e0)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:24.510266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80105cc0-03c0-4197-a7ee-811e4fbac3fd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:24.511739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 168/336] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:24 2022] GET /identity/v3/groups/1934d812a2a346f58e85f65014afb5e0 => generated 229 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:24.517921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48565b-b6ab-42e6-8904-8709f23eb632 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:24.527157 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48565b-b6ab-42e6-8904-8709f23eb632 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:24.532017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a057c08-0773-4af5-8b60-3dbc75059fe6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SYnkX2bIS1mO0BaKQCVi4A, audit_chain_id=['SYnkX2bIS1mO0BaKQCVi4A']) at 0x7fe09e143070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:24.532587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057c08-0773-4af5-8b60-3dbc75059fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:24.532874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057c08-0773-4af5-8b60-3dbc75059fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:24.533158 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057c08-0773-4af5-8b60-3dbc75059fe6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:24.533929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a057c08-0773-4af5-8b60-3dbc75059fe6 admin admin] RBAC: Adding query filter params (group.id=1934d812a2a346f58e85f65014afb5e0, role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=17d9ce9af82b4fd68fac993b9e9f37e5) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:24.534263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a057c08-0773-4af5-8b60-3dbc75059fe6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:24.536120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a057c08-0773-4af5-8b60-3dbc75059fe6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:24.541369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 169/337] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Feb 28 18:36:24 2022] GET /identity/v3/role_assignments?group.id=1934d812a2a346f58e85f65014afb5e0&scope.project.id=17d9ce9af82b4fd68fac993b9e9f37e5&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:26.639606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f087f9e-d4f0-4ac8-a4aa-426445377bf5 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.640172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f087f9e-d4f0-4ac8-a4aa-426445377bf5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.640172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f087f9e-d4f0-4ac8-a4aa-426445377bf5 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.641834 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 169/338] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:26.646943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9455b9-01b4-4a82-9d77-58beccc8ea9b None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.647391 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9455b9-01b4-4a82-9d77-58beccc8ea9b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.647541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9455b9-01b4-4a82-9d77-58beccc8ea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.670256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-8f9455b9-01b4-4a82-9d77-58beccc8ea9b None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:26.671428 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8f9455b9-01b4-4a82-9d77-58beccc8ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:26.678284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 170/339] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:26 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:26.702521 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f087f9e-d4f0-4ac8-a4aa-426445377bf5 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.714295 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f087f9e-d4f0-4ac8-a4aa-426445377bf5 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.718783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ebb8c-f371-4c25-9225-9d0a608abe60 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AVq9a4hEQRWDMsUz-eDVhg, audit_chain_id=['AVq9a4hEQRWDMsUz-eDVhg']) at 0x7fe09e1834f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.719785 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ebb8c-f371-4c25-9225-9d0a608abe60 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.720075 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ebb8c-f371-4c25-9225-9d0a608abe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.720355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ebb8c-f371-4c25-9225-9d0a608abe60 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.731378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ebb8c-f371-4c25-9225-9d0a608abe60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:26.738737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-d24ebb8c-f371-4c25-9225-9d0a608abe60 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:36:26.739851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 170/340] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:26.745379 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9455b9-01b4-4a82-9d77-58beccc8ea9b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.755226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9455b9-01b4-4a82-9d77-58beccc8ea9b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.759325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce80a4-2f90-4bab-b88d-970226071abc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AVq9a4hEQRWDMsUz-eDVhg, audit_chain_id=['AVq9a4hEQRWDMsUz-eDVhg']) at 0x7fe09e198790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.759916 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce80a4-2f90-4bab-b88d-970226071abc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.760202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce80a4-2f90-4bab-b88d-970226071abc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.760481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce80a4-2f90-4bab-b88d-970226071abc admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.761184 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce80a4-2f90-4bab-b88d-970226071abc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:26.761482 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce80a4-2f90-4bab-b88d-970226071abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.763076 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce80a4-2f90-4bab-b88d-970226071abc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:26.771609 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 171/341] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:26.777007 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ebb8c-f371-4c25-9225-9d0a608abe60 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.786759 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ebb8c-f371-4c25-9225-9d0a608abe60 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.790830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a5308-b966-48ca-92a7-cb8d39bdc9f1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AVq9a4hEQRWDMsUz-eDVhg, audit_chain_id=['AVq9a4hEQRWDMsUz-eDVhg']) at 0x7fe09e21ba60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.791651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5308-b966-48ca-92a7-cb8d39bdc9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.791936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5308-b966-48ca-92a7-cb8d39bdc9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.792217 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5308-b966-48ca-92a7-cb8d39bdc9f1 admin admin] PATH_INFO: `/v3/groups/1934d812a2a346f58e85f65014afb5e0` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.793315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a5308-b966-48ca-92a7-cb8d39bdc9f1 admin admin] RBAC: Authorizing `identity:get_group(group_id=1934d812a2a346f58e85f65014afb5e0)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.795764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a5308-b966-48ca-92a7-cb8d39bdc9f1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:26.797202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 171/342] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/groups/1934d812a2a346f58e85f65014afb5e0 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:26.802685 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce80a4-2f90-4bab-b88d-970226071abc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.813312 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce80a4-2f90-4bab-b88d-970226071abc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.817445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc38bb6-d4d7-4eb3-a7f6-cf1f19db5b9b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AVq9a4hEQRWDMsUz-eDVhg, audit_chain_id=['AVq9a4hEQRWDMsUz-eDVhg']) at 0x7fe09e198820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.818229 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38bb6-d4d7-4eb3-a7f6-cf1f19db5b9b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.818520 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38bb6-d4d7-4eb3-a7f6-cf1f19db5b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.818807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38bb6-d4d7-4eb3-a7f6-cf1f19db5b9b admin admin] PATH_INFO: `/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.819937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc38bb6-d4d7-4eb3-a7f6-cf1f19db5b9b admin admin] RBAC: Authorizing `identity:get_project(project_id=17d9ce9af82b4fd68fac993b9e9f37e5)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.821738 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc38bb6-d4d7-4eb3-a7f6-cf1f19db5b9b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:26.823274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 172/343] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:26.829553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a5308-b966-48ca-92a7-cb8d39bdc9f1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.838640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a5308-b966-48ca-92a7-cb8d39bdc9f1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.843888 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce8e1b-7325-4b3b-8184-7eff73c8e586 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AVq9a4hEQRWDMsUz-eDVhg, audit_chain_id=['AVq9a4hEQRWDMsUz-eDVhg']) at 0x7fe09e14e4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.844941 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce8e1b-7325-4b3b-8184-7eff73c8e586 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.845226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce8e1b-7325-4b3b-8184-7eff73c8e586 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.845506 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce8e1b-7325-4b3b-8184-7eff73c8e586 admin admin] PATH_INFO: `/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5/groups/1934d812a2a346f58e85f65014afb5e0/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.847279 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce8e1b-7325-4b3b-8184-7eff73c8e586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d9ce9af82b4fd68fac993b9e9f37e5, group_id=1934d812a2a346f58e85f65014afb5e0, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.849836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce8e1b-7325-4b3b-8184-7eff73c8e586 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:26.922221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 172/344] 10.222.0.21 () {58 vars in 1463 bytes} [Mon Feb 28 18:36:26 2022] PUT /identity/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5/groups/1934d812a2a346f58e85f65014afb5e0/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:36:29.025480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9820d9-6937-4fda-9929-67ad75d934fc None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.026035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9820d9-6937-4fda-9929-67ad75d934fc None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.026035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9820d9-6937-4fda-9929-67ad75d934fc None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.027746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 173/345] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:29.033855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147cb2-6792-484f-a327-f97e4ee88f2b None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.034262 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147cb2-6792-484f-a327-f97e4ee88f2b None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.034423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147cb2-6792-484f-a327-f97e4ee88f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.055889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-b0147cb2-6792-484f-a327-f97e4ee88f2b None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:29.057038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b0147cb2-6792-484f-a327-f97e4ee88f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:29.120752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 173/346] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:36:29.143924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9820d9-6937-4fda-9929-67ad75d934fc None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.156316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9820d9-6937-4fda-9929-67ad75d934fc None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.160259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf082e7-bd2d-41c3-bd47-3d6d334c52ad admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=POCZ2EJZQ7axY1FgwlJ_kQ, audit_chain_id=['POCZ2EJZQ7axY1FgwlJ_kQ']) at 0x7fe09e1983a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.160994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf082e7-bd2d-41c3-bd47-3d6d334c52ad admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.161280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf082e7-bd2d-41c3-bd47-3d6d334c52ad admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.161561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf082e7-bd2d-41c3-bd47-3d6d334c52ad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.172874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf082e7-bd2d-41c3-bd47-3d6d334c52ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:29.179160 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-4bf082e7-bd2d-41c3-bd47-3d6d334c52ad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:36:29.180223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 174/347] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:29.185795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0147cb2-6792-484f-a327-f97e4ee88f2b None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.194167 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0147cb2-6792-484f-a327-f97e4ee88f2b None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.198138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651094bc-e9bc-4cc6-b9a1-347700d2e04d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=POCZ2EJZQ7axY1FgwlJ_kQ, audit_chain_id=['POCZ2EJZQ7axY1FgwlJ_kQ']) at 0x7fe09e14e4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.198734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651094bc-e9bc-4cc6-b9a1-347700d2e04d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.199023 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651094bc-e9bc-4cc6-b9a1-347700d2e04d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.199337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651094bc-e9bc-4cc6-b9a1-347700d2e04d admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.200041 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651094bc-e9bc-4cc6-b9a1-347700d2e04d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:29.200337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651094bc-e9bc-4cc6-b9a1-347700d2e04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.202497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651094bc-e9bc-4cc6-b9a1-347700d2e04d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:29.210961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 174/348] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:29.216013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf082e7-bd2d-41c3-bd47-3d6d334c52ad admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.226074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf082e7-bd2d-41c3-bd47-3d6d334c52ad admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.230112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729b65e-2eae-4333-a63b-637fdae577a1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=POCZ2EJZQ7axY1FgwlJ_kQ, audit_chain_id=['POCZ2EJZQ7axY1FgwlJ_kQ']) at 0x7fe09e1df700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.230677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b65e-2eae-4333-a63b-637fdae577a1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.230964 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b65e-2eae-4333-a63b-637fdae577a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.231289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b65e-2eae-4333-a63b-637fdae577a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.239413 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729b65e-2eae-4333-a63b-637fdae577a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.241158 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729b65e-2eae-4333-a63b-637fdae577a1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:29.250345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 175/349] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:29.255996 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651094bc-e9bc-4cc6-b9a1-347700d2e04d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.265937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651094bc-e9bc-4cc6-b9a1-347700d2e04d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.270000 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb94814-4096-4a30-b13e-e1d8dde1ed1c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=POCZ2EJZQ7axY1FgwlJ_kQ, audit_chain_id=['POCZ2EJZQ7axY1FgwlJ_kQ']) at 0x7fe09e14e2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.270785 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb94814-4096-4a30-b13e-e1d8dde1ed1c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.271075 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb94814-4096-4a30-b13e-e1d8dde1ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.271389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb94814-4096-4a30-b13e-e1d8dde1ed1c admin admin] PATH_INFO: `/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.272491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb94814-4096-4a30-b13e-e1d8dde1ed1c admin admin] RBAC: Authorizing `identity:get_project(project_id=17d9ce9af82b4fd68fac993b9e9f37e5)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.274242 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb94814-4096-4a30-b13e-e1d8dde1ed1c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:29.275773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 175/350] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:29.280939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729b65e-2eae-4333-a63b-637fdae577a1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.289450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729b65e-2eae-4333-a63b-637fdae577a1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.293544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef997a9a-1dbd-435f-ace2-1f90f120d2f9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=POCZ2EJZQ7axY1FgwlJ_kQ, audit_chain_id=['POCZ2EJZQ7axY1FgwlJ_kQ']) at 0x7fe09e1df6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.294354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef997a9a-1dbd-435f-ace2-1f90f120d2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.294636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef997a9a-1dbd-435f-ace2-1f90f120d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.294915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef997a9a-1dbd-435f-ace2-1f90f120d2f9 admin admin] PATH_INFO: `/v3/groups/1934d812a2a346f58e85f65014afb5e0` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.296034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef997a9a-1dbd-435f-ace2-1f90f120d2f9 admin admin] RBAC: Authorizing `identity:get_group(group_id=1934d812a2a346f58e85f65014afb5e0)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.297912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef997a9a-1dbd-435f-ace2-1f90f120d2f9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:29.299370 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 176/351] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/groups/1934d812a2a346f58e85f65014afb5e0 => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:29.304819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb94814-4096-4a30-b13e-e1d8dde1ed1c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.315087 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb94814-4096-4a30-b13e-e1d8dde1ed1c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.319486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82a83-24c4-4b02-9c09-cf3fd1b6a3f5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=POCZ2EJZQ7axY1FgwlJ_kQ, audit_chain_id=['POCZ2EJZQ7axY1FgwlJ_kQ']) at 0x7fe09e14e8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.320146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82a83-24c4-4b02-9c09-cf3fd1b6a3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.320438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82a83-24c4-4b02-9c09-cf3fd1b6a3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.320723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82a83-24c4-4b02-9c09-cf3fd1b6a3f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.321788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b82a83-24c4-4b02-9c09-cf3fd1b6a3f5 admin admin] RBAC: Adding query filter params (group.id=1934d812a2a346f58e85f65014afb5e0, role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=17d9ce9af82b4fd68fac993b9e9f37e5) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:29.322096 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b82a83-24c4-4b02-9c09-cf3fd1b6a3f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.323934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b82a83-24c4-4b02-9c09-cf3fd1b6a3f5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:29.330212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 176/352] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/role_assignments?group.id=1934d812a2a346f58e85f65014afb5e0&scope.project.id=17d9ce9af82b4fd68fac993b9e9f37e5&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:32.649610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91760f-a036-448b-a578-c4549207476a None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.650227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91760f-a036-448b-a578-c4549207476a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.650227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91760f-a036-448b-a578-c4549207476a None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.651863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 177/353] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:32.657705 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58e6d2-c42c-49fb-9f69-5569c758d593 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.658149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58e6d2-c42c-49fb-9f69-5569c758d593 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.658267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58e6d2-c42c-49fb-9f69-5569c758d593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.680207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-9f58e6d2-c42c-49fb-9f69-5569c758d593 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:32.681352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9f58e6d2-c42c-49fb-9f69-5569c758d593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:32.688146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 177/354] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:32.713199 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91760f-a036-448b-a578-c4549207476a None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.726704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91760f-a036-448b-a578-c4549207476a None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.736561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b453f-9003-4d8c-a585-0a0bc0e5854c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yhCE_MJYSSiEGbnwFmw2kg, audit_chain_id=['yhCE_MJYSSiEGbnwFmw2kg']) at 0x7fe09e1df700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.737314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b453f-9003-4d8c-a585-0a0bc0e5854c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.737603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b453f-9003-4d8c-a585-0a0bc0e5854c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.737879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b453f-9003-4d8c-a585-0a0bc0e5854c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.751235 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b453f-9003-4d8c-a585-0a0bc0e5854c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.753122 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b453f-9003-4d8c-a585-0a0bc0e5854c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:32.771680 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-992b453f-9003-4d8c-a585-0a0bc0e5854c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:32.772830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 178/355] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:32.779724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58e6d2-c42c-49fb-9f69-5569c758d593 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.788580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58e6d2-c42c-49fb-9f69-5569c758d593 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.792843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf7b2c-fa9c-425f-a965-a8fd46a1f93c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yhCE_MJYSSiEGbnwFmw2kg, audit_chain_id=['yhCE_MJYSSiEGbnwFmw2kg']) at 0x7fe09e1e6b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.793447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf7b2c-fa9c-425f-a965-a8fd46a1f93c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.793734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf7b2c-fa9c-425f-a965-a8fd46a1f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.794016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf7b2c-fa9c-425f-a965-a8fd46a1f93c admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.794726 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf7b2c-fa9c-425f-a965-a8fd46a1f93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:32.795022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf7b2c-fa9c-425f-a965-a8fd46a1f93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.796643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf7b2c-fa9c-425f-a965-a8fd46a1f93c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:32.809677 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 178/356] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:32.815377 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b453f-9003-4d8c-a585-0a0bc0e5854c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.824735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b453f-9003-4d8c-a585-0a0bc0e5854c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.829588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa85f32-2a3a-408a-b9bd-77a998ff7cca admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yhCE_MJYSSiEGbnwFmw2kg, audit_chain_id=['yhCE_MJYSSiEGbnwFmw2kg']) at 0x7fe09e1d7610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.830180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa85f32-2a3a-408a-b9bd-77a998ff7cca admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.830464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa85f32-2a3a-408a-b9bd-77a998ff7cca admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.830741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa85f32-2a3a-408a-b9bd-77a998ff7cca admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.831503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa85f32-2a3a-408a-b9bd-77a998ff7cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.832510 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-afa85f32-2a3a-408a-b9bd-77a998ff7cca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:32.832510 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:36:32.832510 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:36:32.833700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa85f32-2a3a-408a-b9bd-77a998ff7cca admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:32.955307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 179/357] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:36:32 2022] POST /identity/v3/users => generated 246 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:36:35.143218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc8d7-7fb8-4652-8f6a-6ce3895ac127 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.143773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc8d7-7fb8-4652-8f6a-6ce3895ac127 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.143773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc8d7-7fb8-4652-8f6a-6ce3895ac127 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.145619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 179/358] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:35.150968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc4fb4-591d-462f-b6f1-21fa4d4e77b2 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.151433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc4fb4-591d-462f-b6f1-21fa4d4e77b2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.151726 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc4fb4-591d-462f-b6f1-21fa4d4e77b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.175050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-aafc4fb4-591d-462f-b6f1-21fa4d4e77b2 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:35.176238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-aafc4fb4-591d-462f-b6f1-21fa4d4e77b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:35.183300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 180/359] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:35 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:35.206990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efc8d7-7fb8-4652-8f6a-6ce3895ac127 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.219447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efc8d7-7fb8-4652-8f6a-6ce3895ac127 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.223356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fa51b-064e-41ab-8806-9ab64d0e976c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e1a18b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.224085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa51b-064e-41ab-8806-9ab64d0e976c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.224377 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa51b-064e-41ab-8806-9ab64d0e976c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.224664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa51b-064e-41ab-8806-9ab64d0e976c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.237232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fa51b-064e-41ab-8806-9ab64d0e976c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:35.243707 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-036fa51b-064e-41ab-8806-9ab64d0e976c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:36:35.244847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 180/360] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:35.251991 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc4fb4-591d-462f-b6f1-21fa4d4e77b2 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.261041 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc4fb4-591d-462f-b6f1-21fa4d4e77b2 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.265961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf33e6-6ad1-45e3-aa90-c5aee4b30d86 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e1d7220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.266568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf33e6-6ad1-45e3-aa90-c5aee4b30d86 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.266858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf33e6-6ad1-45e3-aa90-c5aee4b30d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.267177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf33e6-6ad1-45e3-aa90-c5aee4b30d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.267941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf33e6-6ad1-45e3-aa90-c5aee4b30d86 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:35.268241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf33e6-6ad1-45e3-aa90-c5aee4b30d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:35.269872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf33e6-6ad1-45e3-aa90-c5aee4b30d86 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:35.279840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 181/361] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:35.284941 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fa51b-064e-41ab-8806-9ab64d0e976c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.295948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fa51b-064e-41ab-8806-9ab64d0e976c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.300116 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7acfe-4ea2-4e7b-8ba2-167f6daae489 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e1c0c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.300899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7acfe-4ea2-4e7b-8ba2-167f6daae489 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.301213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7acfe-4ea2-4e7b-8ba2-167f6daae489 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.301495 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7acfe-4ea2-4e7b-8ba2-167f6daae489 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.313937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7acfe-4ea2-4e7b-8ba2-167f6daae489 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:35.315812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7acfe-4ea2-4e7b-8ba2-167f6daae489 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:35.333840 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-a1f7acfe-4ea2-4e7b-8ba2-167f6daae489 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:35.334987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 181/362] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:35.340679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf33e6-6ad1-45e3-aa90-c5aee4b30d86 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.351243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf33e6-6ad1-45e3-aa90-c5aee4b30d86 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.355372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8a3ed-8dcc-4573-9bfa-1e7a8d727184 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e1d74f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.355971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a3ed-8dcc-4573-9bfa-1e7a8d727184 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.356260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a3ed-8dcc-4573-9bfa-1e7a8d727184 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.357149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8a3ed-8dcc-4573-9bfa-1e7a8d727184 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.358365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8a3ed-8dcc-4573-9bfa-1e7a8d727184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:35.358667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8a3ed-8dcc-4573-9bfa-1e7a8d727184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:35.359708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-f8a8a3ed-8dcc-4573-9bfa-1e7a8d727184 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:35.359708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:36:35.359708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:36:35.360584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8a3ed-8dcc-4573-9bfa-1e7a8d727184 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:35.374079 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 182/363] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:35.379600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7acfe-4ea2-4e7b-8ba2-167f6daae489 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.389724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7acfe-4ea2-4e7b-8ba2-167f6daae489 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.393856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dc34c-8677-4a63-8878-6b458362769e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e1e69a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.394579 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dc34c-8677-4a63-8878-6b458362769e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.394870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dc34c-8677-4a63-8878-6b458362769e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.395253 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dc34c-8677-4a63-8878-6b458362769e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.408037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dc34c-8677-4a63-8878-6b458362769e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:35.410035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dc34c-8677-4a63-8878-6b458362769e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:35.427669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-d99dc34c-8677-4a63-8878-6b458362769e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:36:35.428776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 182/364] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:35.434413 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8a3ed-8dcc-4573-9bfa-1e7a8d727184 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.445228 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8a3ed-8dcc-4573-9bfa-1e7a8d727184 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.449395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3fc03-7afc-4d97-9d53-f86d1b292dbd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e162a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.449997 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3fc03-7afc-4d97-9d53-f86d1b292dbd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.450367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3fc03-7afc-4d97-9d53-f86d1b292dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.451546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3fc03-7afc-4d97-9d53-f86d1b292dbd admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.452027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3fc03-7afc-4d97-9d53-f86d1b292dbd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:35.452329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3fc03-7afc-4d97-9d53-f86d1b292dbd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:35.453349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-25b3fc03-7afc-4d97-9d53-f86d1b292dbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:35.453349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:36:35.453349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:36:35.454483 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3fc03-7afc-4d97-9d53-f86d1b292dbd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:35.486299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 183/365] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:35.491899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dc34c-8677-4a63-8878-6b458362769e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.502250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dc34c-8677-4a63-8878-6b458362769e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.506300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d89748-d125-42bc-b4e7-1bca4b945030 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e1c0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.506879 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d89748-d125-42bc-b4e7-1bca4b945030 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.507210 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d89748-d125-42bc-b4e7-1bca4b945030 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.507499 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d89748-d125-42bc-b4e7-1bca4b945030 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.515990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d89748-d125-42bc-b4e7-1bca4b945030 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:35.517738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d89748-d125-42bc-b4e7-1bca4b945030 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:35.526209 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 183/366] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:35.531993 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3fc03-7afc-4d97-9d53-f86d1b292dbd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.541832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3fc03-7afc-4d97-9d53-f86d1b292dbd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.546138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c2d35-2a1c-49c4-b208-ead85156adf1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e204280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.546861 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c2d35-2a1c-49c4-b208-ead85156adf1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.547184 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c2d35-2a1c-49c4-b208-ead85156adf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.547468 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c2d35-2a1c-49c4-b208-ead85156adf1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.559346 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c2d35-2a1c-49c4-b208-ead85156adf1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:35.561743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c2d35-2a1c-49c4-b208-ead85156adf1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:35.581025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-c81c2d35-2a1c-49c4-b208-ead85156adf1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:35.582180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 184/367] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:36:35.587831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d89748-d125-42bc-b4e7-1bca4b945030 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.597472 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d89748-d125-42bc-b4e7-1bca4b945030 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.601728 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ac9f2-4177-49ac-bd44-3341916bc18c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e1c07f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.602323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ac9f2-4177-49ac-bd44-3341916bc18c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.602637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ac9f2-4177-49ac-bd44-3341916bc18c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.602924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ac9f2-4177-49ac-bd44-3341916bc18c admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.603651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ac9f2-4177-49ac-bd44-3341916bc18c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:35.603959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ac9f2-4177-49ac-bd44-3341916bc18c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:35.605592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ac9f2-4177-49ac-bd44-3341916bc18c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:35.620117 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 184/368] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:35.626428 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c2d35-2a1c-49c4-b208-ead85156adf1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.635985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c2d35-2a1c-49c4-b208-ead85156adf1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.640755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d88ff-b2f4-491d-9bbb-079134473ea2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e1fbb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.641478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d88ff-b2f4-491d-9bbb-079134473ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.641765 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d88ff-b2f4-491d-9bbb-079134473ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.642045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d88ff-b2f4-491d-9bbb-079134473ea2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.650739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d88ff-b2f4-491d-9bbb-079134473ea2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:35.652732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d88ff-b2f4-491d-9bbb-079134473ea2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:35.666661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-989d88ff-b2f4-491d-9bbb-079134473ea2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:35.667829 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 185/369] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:35.674382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ac9f2-4177-49ac-bd44-3341916bc18c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.683789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ac9f2-4177-49ac-bd44-3341916bc18c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.688539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a672a-2b92-46bc-b7b1-234ac6a5f38e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e444340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.689129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a672a-2b92-46bc-b7b1-234ac6a5f38e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.689414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a672a-2b92-46bc-b7b1-234ac6a5f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.689695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a672a-2b92-46bc-b7b1-234ac6a5f38e admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.690432 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a672a-2b92-46bc-b7b1-234ac6a5f38e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:35.690733 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a672a-2b92-46bc-b7b1-234ac6a5f38e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:35.691777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-fc3a672a-2b92-46bc-b7b1-234ac6a5f38e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:35.691777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:36:35.691777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:36:35.692893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a672a-2b92-46bc-b7b1-234ac6a5f38e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:35.707200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 185/370] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:35.713302 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d88ff-b2f4-491d-9bbb-079134473ea2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:35.723544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d88ff-b2f4-491d-9bbb-079134473ea2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:35.727637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778abbc8-7480-4cb3-8d76-78d6190f3eff admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TYD0wIkAQICLBKnfbtX-gg, audit_chain_id=['TYD0wIkAQICLBKnfbtX-gg']) at 0x7fe09e15b670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:35.728223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778abbc8-7480-4cb3-8d76-78d6190f3eff admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:35.728519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778abbc8-7480-4cb3-8d76-78d6190f3eff admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:35.728804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778abbc8-7480-4cb3-8d76-78d6190f3eff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:35.729587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778abbc8-7480-4cb3-8d76-78d6190f3eff admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=6d280e56dc8848eb92cbee073fd9fbc8) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:35.729888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778abbc8-7480-4cb3-8d76-78d6190f3eff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:35.732324 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778abbc8-7480-4cb3-8d76-78d6190f3eff admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:35.738084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 186/371] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:36:35 2022] GET /identity/v3/role_assignments?user.id=6d280e56dc8848eb92cbee073fd9fbc8&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:37.872851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7aa75-d460-402b-9422-33b98a663d93 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:37.873416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7aa75-d460-402b-9422-33b98a663d93 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:37.873416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7aa75-d460-402b-9422-33b98a663d93 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:37.875711 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 186/372] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:37.880778 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5844ce7-d6cc-418d-9409-187504eee91a None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:37.881204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5844ce7-d6cc-418d-9409-187504eee91a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:37.881345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5844ce7-d6cc-418d-9409-187504eee91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:37.903736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a5844ce7-d6cc-418d-9409-187504eee91a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:37.904893 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a5844ce7-d6cc-418d-9409-187504eee91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:37.911782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 187/373] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:37.935797 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7aa75-d460-402b-9422-33b98a663d93 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:37.948063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7aa75-d460-402b-9422-33b98a663d93 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:37.952370 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ba242-bd74-439f-b38a-f3f6cfba3868 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EBj-vO1nRVivtg5AGC4vYg, audit_chain_id=['EBj-vO1nRVivtg5AGC4vYg']) at 0x7fe09e2120a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:37.953090 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ba242-bd74-439f-b38a-f3f6cfba3868 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:37.953383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ba242-bd74-439f-b38a-f3f6cfba3868 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:37.953664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ba242-bd74-439f-b38a-f3f6cfba3868 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:37.964931 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ba242-bd74-439f-b38a-f3f6cfba3868 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:37.971778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-290ba242-bd74-439f-b38a-f3f6cfba3868 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:36:37.972907 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 187/374] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:36:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:37.978703 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5844ce7-d6cc-418d-9409-187504eee91a None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:37.987957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5844ce7-d6cc-418d-9409-187504eee91a None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:37.992104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55367876-225f-4fbc-aa64-7caa42c982e7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EBj-vO1nRVivtg5AGC4vYg, audit_chain_id=['EBj-vO1nRVivtg5AGC4vYg']) at 0x7fe09e1df1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:37.992693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55367876-225f-4fbc-aa64-7caa42c982e7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:37.992981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55367876-225f-4fbc-aa64-7caa42c982e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:37.993263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55367876-225f-4fbc-aa64-7caa42c982e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:37.993973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55367876-225f-4fbc-aa64-7caa42c982e7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:37.994271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55367876-225f-4fbc-aa64-7caa42c982e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:37.995897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55367876-225f-4fbc-aa64-7caa42c982e7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:38.004734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 188/375] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:36:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:38.010035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ba242-bd74-439f-b38a-f3f6cfba3868 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:38.020413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ba242-bd74-439f-b38a-f3f6cfba3868 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:38.024543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ba9dd-37ea-43f4-85d7-ecdbbe9d623d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EBj-vO1nRVivtg5AGC4vYg, audit_chain_id=['EBj-vO1nRVivtg5AGC4vYg']) at 0x7fe09e1c0670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:38.025257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ba9dd-37ea-43f4-85d7-ecdbbe9d623d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:38.025546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ba9dd-37ea-43f4-85d7-ecdbbe9d623d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:38.025828 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ba9dd-37ea-43f4-85d7-ecdbbe9d623d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:38.037189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ba9dd-37ea-43f4-85d7-ecdbbe9d623d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:38.039010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ba9dd-37ea-43f4-85d7-ecdbbe9d623d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:38.056537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-f29ba9dd-37ea-43f4-85d7-ecdbbe9d623d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:38.057628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 188/376] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:38.063977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55367876-225f-4fbc-aa64-7caa42c982e7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:38.073308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55367876-225f-4fbc-aa64-7caa42c982e7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:38.077450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce235c8e-1936-4f5f-b0a5-d4160ca749d3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EBj-vO1nRVivtg5AGC4vYg, audit_chain_id=['EBj-vO1nRVivtg5AGC4vYg']) at 0x7fe09e1f3610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:38.078029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce235c8e-1936-4f5f-b0a5-d4160ca749d3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:38.078316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce235c8e-1936-4f5f-b0a5-d4160ca749d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:38.078598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce235c8e-1936-4f5f-b0a5-d4160ca749d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:38.079318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce235c8e-1936-4f5f-b0a5-d4160ca749d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:38.079617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce235c8e-1936-4f5f-b0a5-d4160ca749d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:38.081209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce235c8e-1936-4f5f-b0a5-d4160ca749d3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:38.093541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 189/377] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:38.099077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ba9dd-37ea-43f4-85d7-ecdbbe9d623d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:38.109005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ba9dd-37ea-43f4-85d7-ecdbbe9d623d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:38.113123 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9636b-6e05-44ba-81b4-2ee7f67b68ba admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EBj-vO1nRVivtg5AGC4vYg, audit_chain_id=['EBj-vO1nRVivtg5AGC4vYg']) at 0x7fe09e150d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:38.113839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9636b-6e05-44ba-81b4-2ee7f67b68ba admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:38.114127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9636b-6e05-44ba-81b4-2ee7f67b68ba admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:38.114411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9636b-6e05-44ba-81b4-2ee7f67b68ba admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:38.127648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9636b-6e05-44ba-81b4-2ee7f67b68ba admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:38.129578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9636b-6e05-44ba-81b4-2ee7f67b68ba admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:38.146961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-2fa9636b-6e05-44ba-81b4-2ee7f67b68ba admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:36:38.148078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 189/378] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 18:36:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:38.153626 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce235c8e-1936-4f5f-b0a5-d4160ca749d3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:38.162999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce235c8e-1936-4f5f-b0a5-d4160ca749d3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:38.167139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9e68a-b60b-4529-a6b5-73c1332b172f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EBj-vO1nRVivtg5AGC4vYg, audit_chain_id=['EBj-vO1nRVivtg5AGC4vYg']) at 0x7fe09e198820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:38.167745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9e68a-b60b-4529-a6b5-73c1332b172f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:38.168030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9e68a-b60b-4529-a6b5-73c1332b172f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:38.168311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9e68a-b60b-4529-a6b5-73c1332b172f admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:38.169576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9e68a-b60b-4529-a6b5-73c1332b172f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:38.169871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9e68a-b60b-4529-a6b5-73c1332b172f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:38.171723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9e68a-b60b-4529-a6b5-73c1332b172f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:38.200654 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 190/379] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Feb 28 18:36:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:38.206021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9636b-6e05-44ba-81b4-2ee7f67b68ba admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:38.215403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9636b-6e05-44ba-81b4-2ee7f67b68ba admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:38.219920 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff12874-d3c0-4685-9db3-50b65bcf5d58 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EBj-vO1nRVivtg5AGC4vYg, audit_chain_id=['EBj-vO1nRVivtg5AGC4vYg']) at 0x7fe09e212160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:38.220633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff12874-d3c0-4685-9db3-50b65bcf5d58 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:38.220923 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff12874-d3c0-4685-9db3-50b65bcf5d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:38.221204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff12874-d3c0-4685-9db3-50b65bcf5d58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:38.233471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff12874-d3c0-4685-9db3-50b65bcf5d58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:38.235324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff12874-d3c0-4685-9db3-50b65bcf5d58 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:38.252497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-4ff12874-d3c0-4685-9db3-50b65bcf5d58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:38.253578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 190/380] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:38.259132 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9e68a-b60b-4529-a6b5-73c1332b172f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:38.268590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9e68a-b60b-4529-a6b5-73c1332b172f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:38.272804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7910b0-e896-43e3-8c58-c0341c0aa6f1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EBj-vO1nRVivtg5AGC4vYg, audit_chain_id=['EBj-vO1nRVivtg5AGC4vYg']) at 0x7fe09e1983d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:38.273404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7910b0-e896-43e3-8c58-c0341c0aa6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:38.273693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7910b0-e896-43e3-8c58-c0341c0aa6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:38.273973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7910b0-e896-43e3-8c58-c0341c0aa6f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:38.274657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7910b0-e896-43e3-8c58-c0341c0aa6f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:38.274960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7910b0-e896-43e3-8c58-c0341c0aa6f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:38.276585 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7910b0-e896-43e3-8c58-c0341c0aa6f1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:38.289450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 191/381] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:38.295656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff12874-d3c0-4685-9db3-50b65bcf5d58 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:38.305184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff12874-d3c0-4685-9db3-50b65bcf5d58 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:38.309225 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039177b-2450-4b95-b68c-2b9a88ae60ea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EBj-vO1nRVivtg5AGC4vYg, audit_chain_id=['EBj-vO1nRVivtg5AGC4vYg']) at 0x7fe09e4442e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:38.310561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039177b-2450-4b95-b68c-2b9a88ae60ea admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:38.310924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039177b-2450-4b95-b68c-2b9a88ae60ea admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:38.311245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039177b-2450-4b95-b68c-2b9a88ae60ea admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:38.319817 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039177b-2450-4b95-b68c-2b9a88ae60ea admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:38.321737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039177b-2450-4b95-b68c-2b9a88ae60ea admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:38.336006 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-4039177b-2450-4b95-b68c-2b9a88ae60ea admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:38.337118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 191/382] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:38.343399 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7910b0-e896-43e3-8c58-c0341c0aa6f1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:38.353229 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7910b0-e896-43e3-8c58-c0341c0aa6f1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:38.357962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a46b4d-fd59-4b5a-9038-5187c824a014 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EBj-vO1nRVivtg5AGC4vYg, audit_chain_id=['EBj-vO1nRVivtg5AGC4vYg']) at 0x7fe09e198910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:38.358543 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a46b4d-fd59-4b5a-9038-5187c824a014 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:38.358829 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a46b4d-fd59-4b5a-9038-5187c824a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:38.359124 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a46b4d-fd59-4b5a-9038-5187c824a014 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:38.359884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a46b4d-fd59-4b5a-9038-5187c824a014 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:38.360186 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a46b4d-fd59-4b5a-9038-5187c824a014 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:38.361196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-13a46b4d-fd59-4b5a-9038-5187c824a014 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:38.361196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:36:38.361196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:36:38.362322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a46b4d-fd59-4b5a-9038-5187c824a014 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:38.376230 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 192/383] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:38.382029 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039177b-2450-4b95-b68c-2b9a88ae60ea admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:38.391613 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039177b-2450-4b95-b68c-2b9a88ae60ea admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:38.395675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d0997-a6f2-4b84-949a-cbbaded205ec admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EBj-vO1nRVivtg5AGC4vYg, audit_chain_id=['EBj-vO1nRVivtg5AGC4vYg']) at 0x7fe09e1e6370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:38.396486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d0997-a6f2-4b84-949a-cbbaded205ec admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:38.396777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d0997-a6f2-4b84-949a-cbbaded205ec admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:38.397063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d0997-a6f2-4b84-949a-cbbaded205ec admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/6d280e56dc8848eb92cbee073fd9fbc8/roles/9a37fbff179849e58437f2fad75ce546` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:38.417132 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d0997-a6f2-4b84-949a-cbbaded205ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=6d280e56dc8848eb92cbee073fd9fbc8, role_id=9a37fbff179849e58437f2fad75ce546)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:38.419943 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d0997-a6f2-4b84-949a-cbbaded205ec admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:38.532918 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 192/384] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:36:38 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/6d280e56dc8848eb92cbee073fd9fbc8/roles/9a37fbff179849e58437f2fad75ce546 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:36:40.641120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cd2f7-ffde-4699-9d21-b07a3c01f860 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:40.641674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cd2f7-ffde-4699-9d21-b07a3c01f860 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:40.641674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cd2f7-ffde-4699-9d21-b07a3c01f860 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:40.643448 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 193/385] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:40.648608 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb540690-7eda-448b-951d-4122e41ae372 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:40.648997 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb540690-7eda-448b-951d-4122e41ae372 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:40.649181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb540690-7eda-448b-951d-4122e41ae372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:40.671243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-fb540690-7eda-448b-951d-4122e41ae372 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:40.672398 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-fb540690-7eda-448b-951d-4122e41ae372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:40.738224 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 193/386] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:40.765971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cd2f7-ffde-4699-9d21-b07a3c01f860 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:40.777725 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cd2f7-ffde-4699-9d21-b07a3c01f860 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:40.781677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ebd06-f481-43fa-9c3b-931eee0bdbcf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e2045b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:40.782387 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ebd06-f481-43fa-9c3b-931eee0bdbcf admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:40.782673 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ebd06-f481-43fa-9c3b-931eee0bdbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:40.782952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ebd06-f481-43fa-9c3b-931eee0bdbcf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:40.793995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ebd06-f481-43fa-9c3b-931eee0bdbcf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:40.800352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-134ebd06-f481-43fa-9c3b-931eee0bdbcf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:36:40.801427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 194/387] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:40.807382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb540690-7eda-448b-951d-4122e41ae372 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:40.816919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb540690-7eda-448b-951d-4122e41ae372 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:40.821008 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c44fb-8378-4aea-a91e-80a199c38e10 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e1e62b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:40.821604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c44fb-8378-4aea-a91e-80a199c38e10 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:40.821896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c44fb-8378-4aea-a91e-80a199c38e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:40.822180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c44fb-8378-4aea-a91e-80a199c38e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:40.822895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c44fb-8378-4aea-a91e-80a199c38e10 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:40.823265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c44fb-8378-4aea-a91e-80a199c38e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:40.824878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c44fb-8378-4aea-a91e-80a199c38e10 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:40.834164 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 194/388] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:40.839574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ebd06-f481-43fa-9c3b-931eee0bdbcf admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:40.849714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ebd06-f481-43fa-9c3b-931eee0bdbcf admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:40.853950 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349e1cd-8cf6-445d-95ae-64940e8cd599 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e17f970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:40.854658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349e1cd-8cf6-445d-95ae-64940e8cd599 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:40.854944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349e1cd-8cf6-445d-95ae-64940e8cd599 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:40.855265 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349e1cd-8cf6-445d-95ae-64940e8cd599 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:40.866917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349e1cd-8cf6-445d-95ae-64940e8cd599 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:40.868786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349e1cd-8cf6-445d-95ae-64940e8cd599 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:40.886021 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-e349e1cd-8cf6-445d-95ae-64940e8cd599 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:40.887084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 195/389] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:40.892894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c44fb-8378-4aea-a91e-80a199c38e10 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:40.902079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c44fb-8378-4aea-a91e-80a199c38e10 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:40.906467 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c6b57-8b72-4e20-ae9e-e41217d65908 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e183430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:40.907059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c6b57-8b72-4e20-ae9e-e41217d65908 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:40.907379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c6b57-8b72-4e20-ae9e-e41217d65908 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:40.907662 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c6b57-8b72-4e20-ae9e-e41217d65908 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:40.908348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c6b57-8b72-4e20-ae9e-e41217d65908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:40.908672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c6b57-8b72-4e20-ae9e-e41217d65908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:40.910266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c6b57-8b72-4e20-ae9e-e41217d65908 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:40.923740 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 195/390] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:40.929148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349e1cd-8cf6-445d-95ae-64940e8cd599 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:40.939536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349e1cd-8cf6-445d-95ae-64940e8cd599 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:40.943671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d09218-cc50-4a0b-be02-12a9374e1e01 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e159b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:40.944442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d09218-cc50-4a0b-be02-12a9374e1e01 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:40.944731 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d09218-cc50-4a0b-be02-12a9374e1e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:40.945008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d09218-cc50-4a0b-be02-12a9374e1e01 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:40.959860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d09218-cc50-4a0b-be02-12a9374e1e01 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:40.961908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d09218-cc50-4a0b-be02-12a9374e1e01 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:40.980214 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-07d09218-cc50-4a0b-be02-12a9374e1e01 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:36:40.981322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 196/391] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 18:36:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:36:40.986994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c6b57-8b72-4e20-ae9e-e41217d65908 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:40.996311 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c6b57-8b72-4e20-ae9e-e41217d65908 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:41.000548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e75405-002c-4cc0-b5e3-043577c53bfb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e15e580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:41.001139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e75405-002c-4cc0-b5e3-043577c53bfb admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.001424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e75405-002c-4cc0-b5e3-043577c53bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.001700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e75405-002c-4cc0-b5e3-043577c53bfb admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.002476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e75405-002c-4cc0-b5e3-043577c53bfb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:41.002775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e75405-002c-4cc0-b5e3-043577c53bfb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:41.003805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-51e75405-002c-4cc0-b5e3-043577c53bfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:41.003805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:36:41.003805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:36:41.004940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e75405-002c-4cc0-b5e3-043577c53bfb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:41.036192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 196/392] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Feb 28 18:36:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:41.041940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d09218-cc50-4a0b-be02-12a9374e1e01 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:41.051686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d09218-cc50-4a0b-be02-12a9374e1e01 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:41.055809 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99384184-d34a-43bb-a720-af4651310e18 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e16ed90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:41.056383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99384184-d34a-43bb-a720-af4651310e18 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.056673 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99384184-d34a-43bb-a720-af4651310e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.056958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99384184-d34a-43bb-a720-af4651310e18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.065045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99384184-d34a-43bb-a720-af4651310e18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:41.066803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99384184-d34a-43bb-a720-af4651310e18 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:41.075889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 197/393] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:41 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:41.081321 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e75405-002c-4cc0-b5e3-043577c53bfb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:41.090489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e75405-002c-4cc0-b5e3-043577c53bfb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:41.095817 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa0ba1-38ce-402c-9a82-ed53cecfe39d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e21eaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:41.096530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0ba1-38ce-402c-9a82-ed53cecfe39d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.096817 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0ba1-38ce-402c-9a82-ed53cecfe39d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.097096 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0ba1-38ce-402c-9a82-ed53cecfe39d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.108779 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa0ba1-38ce-402c-9a82-ed53cecfe39d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:41.110583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa0ba1-38ce-402c-9a82-ed53cecfe39d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:41.127012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-f9fa0ba1-38ce-402c-9a82-ed53cecfe39d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:41.128122 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 197/394] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:41.133535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99384184-d34a-43bb-a720-af4651310e18 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:41.142824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99384184-d34a-43bb-a720-af4651310e18 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:41.147080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aa603-9743-428a-afa3-0c41900e7c11 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e1593d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:41.147641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa603-9743-428a-afa3-0c41900e7c11 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.147930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa603-9743-428a-afa3-0c41900e7c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.148213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa603-9743-428a-afa3-0c41900e7c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.148891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aa603-9743-428a-afa3-0c41900e7c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:41.149192 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aa603-9743-428a-afa3-0c41900e7c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:41.150758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aa603-9743-428a-afa3-0c41900e7c11 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:41.165325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 198/395] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:41.171298 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa0ba1-38ce-402c-9a82-ed53cecfe39d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:41.185331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa0ba1-38ce-402c-9a82-ed53cecfe39d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:41.189413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cbc0a-a834-4230-9dba-fcc1cb8bba57 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e155fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:41.190121 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cbc0a-a834-4230-9dba-fcc1cb8bba57 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.190410 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cbc0a-a834-4230-9dba-fcc1cb8bba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.190690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cbc0a-a834-4230-9dba-fcc1cb8bba57 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.199180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cbc0a-a834-4230-9dba-fcc1cb8bba57 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:41.201707 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cbc0a-a834-4230-9dba-fcc1cb8bba57 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:41.215021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-a16cbc0a-a834-4230-9dba-fcc1cb8bba57 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:41.216781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 198/396] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:41.222681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aa603-9743-428a-afa3-0c41900e7c11 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:41.232174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aa603-9743-428a-afa3-0c41900e7c11 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:41.236262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66e19-f230-4f44-8322-f773c5b937fc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e16e2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:41.236849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66e19-f230-4f44-8322-f773c5b937fc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.237136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66e19-f230-4f44-8322-f773c5b937fc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.237419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66e19-f230-4f44-8322-f773c5b937fc admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.238163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce66e19-f230-4f44-8322-f773c5b937fc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:41.238465 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce66e19-f230-4f44-8322-f773c5b937fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:41.240351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce66e19-f230-4f44-8322-f773c5b937fc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:41.347748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 199/397] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:41.353695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cbc0a-a834-4230-9dba-fcc1cb8bba57 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:41.363892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cbc0a-a834-4230-9dba-fcc1cb8bba57 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:41.367910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb6009-0407-4bcf-988d-2fd1fe8974fc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WX6eKXDUQK-1gG162i_oFw, audit_chain_id=['WX6eKXDUQK-1gG162i_oFw']) at 0x7fe09e1839d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:41.368489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb6009-0407-4bcf-988d-2fd1fe8974fc admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.368777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb6009-0407-4bcf-988d-2fd1fe8974fc admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.369056 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb6009-0407-4bcf-988d-2fd1fe8974fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.369828 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb6009-0407-4bcf-988d-2fd1fe8974fc admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=6d280e56dc8848eb92cbee073fd9fbc8) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:41.370130 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb6009-0407-4bcf-988d-2fd1fe8974fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:41.372120 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb6009-0407-4bcf-988d-2fd1fe8974fc admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:41.378589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 199/398] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:36:41 2022] GET /identity/v3/role_assignments?user.id=6d280e56dc8848eb92cbee073fd9fbc8&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:43.550224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7cc7-7f70-4afe-8f5a-b460afeb5f35 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:43.550755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7cc7-7f70-4afe-8f5a-b460afeb5f35 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:43.550755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7cc7-7f70-4afe-8f5a-b460afeb5f35 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:43.552480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 200/399] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:43.557755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e367-4906-462a-a47e-4fb63281663a None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:43.558157 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e367-4906-462a-a47e-4fb63281663a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:43.558318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e367-4906-462a-a47e-4fb63281663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:43.581532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-b479e367-4906-462a-a47e-4fb63281663a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:43.582688 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b479e367-4906-462a-a47e-4fb63281663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:43.589648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 200/400] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:43 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:43.613513 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7cc7-7f70-4afe-8f5a-b460afeb5f35 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:43.625670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7cc7-7f70-4afe-8f5a-b460afeb5f35 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:43.629749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cff011-9e67-45a0-bc2c-049bc4e9274c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e3d50a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:43.630463 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff011-9e67-45a0-bc2c-049bc4e9274c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:43.630747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff011-9e67-45a0-bc2c-049bc4e9274c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:43.631025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff011-9e67-45a0-bc2c-049bc4e9274c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:43.642816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cff011-9e67-45a0-bc2c-049bc4e9274c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:43.649225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-72cff011-9e67-45a0-bc2c-049bc4e9274c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:36:43.650383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 201/401] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:43.656528 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479e367-4906-462a-a47e-4fb63281663a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:43.665193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479e367-4906-462a-a47e-4fb63281663a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:43.669521 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b837734-cc30-4393-82d3-b9b918e8296c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e1a1a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:43.670119 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837734-cc30-4393-82d3-b9b918e8296c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:43.670411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837734-cc30-4393-82d3-b9b918e8296c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:43.670696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837734-cc30-4393-82d3-b9b918e8296c admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:43.671445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b837734-cc30-4393-82d3-b9b918e8296c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:43.671748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b837734-cc30-4393-82d3-b9b918e8296c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:43.673335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b837734-cc30-4393-82d3-b9b918e8296c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:43.681944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 201/402] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:43.687856 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cff011-9e67-45a0-bc2c-049bc4e9274c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:43.697540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cff011-9e67-45a0-bc2c-049bc4e9274c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:43.701722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add990fc-5e17-4b85-bc34-a1ddc0c0c741 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e3e41f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:43.702425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add990fc-5e17-4b85-bc34-a1ddc0c0c741 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:43.702709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add990fc-5e17-4b85-bc34-a1ddc0c0c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:43.702992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add990fc-5e17-4b85-bc34-a1ddc0c0c741 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:43.714103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add990fc-5e17-4b85-bc34-a1ddc0c0c741 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:43.716729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add990fc-5e17-4b85-bc34-a1ddc0c0c741 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:43.734569 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-add990fc-5e17-4b85-bc34-a1ddc0c0c741 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:43.735664 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 202/403] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:43.741174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b837734-cc30-4393-82d3-b9b918e8296c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:43.750867 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b837734-cc30-4393-82d3-b9b918e8296c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:43.754914 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da332a4c-7218-4981-a1fc-6306cf47571b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e1a1cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:43.755539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da332a4c-7218-4981-a1fc-6306cf47571b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:43.755827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da332a4c-7218-4981-a1fc-6306cf47571b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:43.756113 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da332a4c-7218-4981-a1fc-6306cf47571b admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:43.756796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da332a4c-7218-4981-a1fc-6306cf47571b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:43.757099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da332a4c-7218-4981-a1fc-6306cf47571b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:43.758681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da332a4c-7218-4981-a1fc-6306cf47571b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:43.770992 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 202/404] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:43.776417 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add990fc-5e17-4b85-bc34-a1ddc0c0c741 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:43.786472 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add990fc-5e17-4b85-bc34-a1ddc0c0c741 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:43.790631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7449a6-fd22-48a4-85b8-0a70574b31d7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e3dce20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:43.791378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7449a6-fd22-48a4-85b8-0a70574b31d7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:43.791667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7449a6-fd22-48a4-85b8-0a70574b31d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:43.791947 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7449a6-fd22-48a4-85b8-0a70574b31d7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:43.805085 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7449a6-fd22-48a4-85b8-0a70574b31d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:43.807024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7449a6-fd22-48a4-85b8-0a70574b31d7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:43.825277 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-ee7449a6-fd22-48a4-85b8-0a70574b31d7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:36:43.826550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 203/405] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 18:36:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:43.832356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da332a4c-7218-4981-a1fc-6306cf47571b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:43.842195 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da332a4c-7218-4981-a1fc-6306cf47571b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:43.846524 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f2740-695a-4892-8edd-f2d99b21b8d6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e1a1e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:43.847131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f2740-695a-4892-8edd-f2d99b21b8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:43.847436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f2740-695a-4892-8edd-f2d99b21b8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:43.847717 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f2740-695a-4892-8edd-f2d99b21b8d6 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:43.848501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f2740-695a-4892-8edd-f2d99b21b8d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:43.848798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f2740-695a-4892-8edd-f2d99b21b8d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:43.850702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f2740-695a-4892-8edd-f2d99b21b8d6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:43.879734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 203/406] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Feb 28 18:36:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:43.885744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7449a6-fd22-48a4-85b8-0a70574b31d7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:43.896011 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7449a6-fd22-48a4-85b8-0a70574b31d7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:43.900098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b92c3-4f44-41e0-a9c2-c6347e98bb50 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e3e2490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:43.900667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b92c3-4f44-41e0-a9c2-c6347e98bb50 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:43.900955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b92c3-4f44-41e0-a9c2-c6347e98bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:43.901238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b92c3-4f44-41e0-a9c2-c6347e98bb50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:43.909727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b92c3-4f44-41e0-a9c2-c6347e98bb50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:43.911501 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b92c3-4f44-41e0-a9c2-c6347e98bb50 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:43.920199 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 204/407] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:43 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:43.925687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f2740-695a-4892-8edd-f2d99b21b8d6 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:43.935478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f2740-695a-4892-8edd-f2d99b21b8d6 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:43.939555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebd93-9b17-47cb-8ed6-d28ccc9f11f8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e14e910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:43.940274 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebd93-9b17-47cb-8ed6-d28ccc9f11f8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:43.940566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebd93-9b17-47cb-8ed6-d28ccc9f11f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:43.940850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebd93-9b17-47cb-8ed6-d28ccc9f11f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:43.953334 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ebd93-9b17-47cb-8ed6-d28ccc9f11f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:43.955180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ebd93-9b17-47cb-8ed6-d28ccc9f11f8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:43.973589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-546ebd93-9b17-47cb-8ed6-d28ccc9f11f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:43.974711 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 204/408] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:43.980277 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b92c3-4f44-41e0-a9c2-c6347e98bb50 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:43.989441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b92c3-4f44-41e0-a9c2-c6347e98bb50 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:43.993668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5360147-e765-40e4-9c65-8c95b684bcb2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e1598e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:43.994253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360147-e765-40e4-9c65-8c95b684bcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:43.994548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360147-e765-40e4-9c65-8c95b684bcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:43.994845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360147-e765-40e4-9c65-8c95b684bcb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:43.995558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5360147-e765-40e4-9c65-8c95b684bcb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:43.995863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5360147-e765-40e4-9c65-8c95b684bcb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:43.997987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5360147-e765-40e4-9c65-8c95b684bcb2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:44.010740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 205/409] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:44.016690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebd93-9b17-47cb-8ed6-d28ccc9f11f8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:44.025862 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebd93-9b17-47cb-8ed6-d28ccc9f11f8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:44.030583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69489de0-9b9e-4400-b896-5baba3de8d3f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e150400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:44.031408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69489de0-9b9e-4400-b896-5baba3de8d3f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:44.031694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69489de0-9b9e-4400-b896-5baba3de8d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:44.031977 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69489de0-9b9e-4400-b896-5baba3de8d3f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:44.040726 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69489de0-9b9e-4400-b896-5baba3de8d3f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:44.042693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69489de0-9b9e-4400-b896-5baba3de8d3f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:44.059448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-69489de0-9b9e-4400-b896-5baba3de8d3f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:44.060494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 205/410] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:44.066213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5360147-e765-40e4-9c65-8c95b684bcb2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:44.076338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5360147-e765-40e4-9c65-8c95b684bcb2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:44.080431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0a9b7-c388-4cc7-b8e2-c72952e8ecb7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e159370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:44.081016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a9b7-c388-4cc7-b8e2-c72952e8ecb7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:44.081306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a9b7-c388-4cc7-b8e2-c72952e8ecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:44.081590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a9b7-c388-4cc7-b8e2-c72952e8ecb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:44.082328 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0a9b7-c388-4cc7-b8e2-c72952e8ecb7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:44.082632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0a9b7-c388-4cc7-b8e2-c72952e8ecb7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:44.084506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0a9b7-c388-4cc7-b8e2-c72952e8ecb7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:44.098417 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 206/411] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:44.104230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69489de0-9b9e-4400-b896-5baba3de8d3f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:44.113620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69489de0-9b9e-4400-b896-5baba3de8d3f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:44.117722 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa4f70-bd1a-4f41-af14-618bf3fe615b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q8hTey8_TOGYJfCR8xmY7A, audit_chain_id=['q8hTey8_TOGYJfCR8xmY7A']) at 0x7fe09e1839d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:44.118302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa4f70-bd1a-4f41-af14-618bf3fe615b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:44.118592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa4f70-bd1a-4f41-af14-618bf3fe615b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:44.118875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa4f70-bd1a-4f41-af14-618bf3fe615b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:44.119678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa4f70-bd1a-4f41-af14-618bf3fe615b admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=6d280e56dc8848eb92cbee073fd9fbc8) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:44.119987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa4f70-bd1a-4f41-af14-618bf3fe615b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:44.121828 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa4f70-bd1a-4f41-af14-618bf3fe615b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:44.127097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 206/412] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:36:44 2022] GET /identity/v3/role_assignments?user.id=6d280e56dc8848eb92cbee073fd9fbc8&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:46.254215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658ac1-e091-44f8-87f0-02f30ed9d61e None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.254761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658ac1-e091-44f8-87f0-02f30ed9d61e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.254761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658ac1-e091-44f8-87f0-02f30ed9d61e None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.256397 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 207/413] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:46.261925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37efa2e-7c2a-4fa9-929e-4e0cbccdf1c5 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.262838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37efa2e-7c2a-4fa9-929e-4e0cbccdf1c5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.263045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37efa2e-7c2a-4fa9-929e-4e0cbccdf1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.289172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-c37efa2e-7c2a-4fa9-929e-4e0cbccdf1c5 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:46.290335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c37efa2e-7c2a-4fa9-929e-4e0cbccdf1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:46.298210 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 207/414] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:46 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:46.321432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22658ac1-e091-44f8-87f0-02f30ed9d61e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:46.336486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22658ac1-e091-44f8-87f0-02f30ed9d61e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:46.341684 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65801b7a-7e6e-447d-8961-eeae14d9739f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_gnG7iXaT_WLGlJthwocIQ, audit_chain_id=['_gnG7iXaT_WLGlJthwocIQ']) at 0x7fe09e3e48b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:46.342432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65801b7a-7e6e-447d-8961-eeae14d9739f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.342723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65801b7a-7e6e-447d-8961-eeae14d9739f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.343009 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65801b7a-7e6e-447d-8961-eeae14d9739f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.356050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65801b7a-7e6e-447d-8961-eeae14d9739f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:46.364628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-65801b7a-7e6e-447d-8961-eeae14d9739f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:36:46.366513 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 208/415] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:46.373093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37efa2e-7c2a-4fa9-929e-4e0cbccdf1c5 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:46.382127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37efa2e-7c2a-4fa9-929e-4e0cbccdf1c5 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:46.388604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d4a60-9970-402c-b9cc-8cfd27446e9a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_gnG7iXaT_WLGlJthwocIQ, audit_chain_id=['_gnG7iXaT_WLGlJthwocIQ']) at 0x7fe09e150460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:46.389199 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d4a60-9970-402c-b9cc-8cfd27446e9a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.389486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d4a60-9970-402c-b9cc-8cfd27446e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.389768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d4a60-9970-402c-b9cc-8cfd27446e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.390471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d4a60-9970-402c-b9cc-8cfd27446e9a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:46.390766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d4a60-9970-402c-b9cc-8cfd27446e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:46.392401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d4a60-9970-402c-b9cc-8cfd27446e9a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:46.402207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 208/416] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:46.411221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65801b7a-7e6e-447d-8961-eeae14d9739f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:46.422686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65801b7a-7e6e-447d-8961-eeae14d9739f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:46.427213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd879b1-f610-4b66-b1b8-f80a702d2f72 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_gnG7iXaT_WLGlJthwocIQ, audit_chain_id=['_gnG7iXaT_WLGlJthwocIQ']) at 0x7fe09e143be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:46.427934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd879b1-f610-4b66-b1b8-f80a702d2f72 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.428225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd879b1-f610-4b66-b1b8-f80a702d2f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.428511 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd879b1-f610-4b66-b1b8-f80a702d2f72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.442354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd879b1-f610-4b66-b1b8-f80a702d2f72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:46.444269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd879b1-f610-4b66-b1b8-f80a702d2f72 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:46.467405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-1cd879b1-f610-4b66-b1b8-f80a702d2f72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:46.468827 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 209/417] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:46.474708 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d4a60-9970-402c-b9cc-8cfd27446e9a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:46.485028 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d4a60-9970-402c-b9cc-8cfd27446e9a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:46.489155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6396d5-b702-48ee-8f14-35fb3b18f80e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_gnG7iXaT_WLGlJthwocIQ, audit_chain_id=['_gnG7iXaT_WLGlJthwocIQ']) at 0x7fe09e150dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:46.489779 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6396d5-b702-48ee-8f14-35fb3b18f80e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.490203 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6396d5-b702-48ee-8f14-35fb3b18f80e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.490488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6396d5-b702-48ee-8f14-35fb3b18f80e admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.491199 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6396d5-b702-48ee-8f14-35fb3b18f80e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:46.491500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6396d5-b702-48ee-8f14-35fb3b18f80e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:46.493089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6396d5-b702-48ee-8f14-35fb3b18f80e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:46.506579 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 209/418] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:46.512370 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd879b1-f610-4b66-b1b8-f80a702d2f72 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:46.522871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd879b1-f610-4b66-b1b8-f80a702d2f72 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:46.527161 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb53c9-f80c-4b76-9070-702181d85226 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_gnG7iXaT_WLGlJthwocIQ, audit_chain_id=['_gnG7iXaT_WLGlJthwocIQ']) at 0x7fe09e411d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:46.527913 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb53c9-f80c-4b76-9070-702181d85226 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.528251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb53c9-f80c-4b76-9070-702181d85226 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.528709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb53c9-f80c-4b76-9070-702181d85226 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.546574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb53c9-f80c-4b76-9070-702181d85226 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:46.548681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb53c9-f80c-4b76-9070-702181d85226 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:46.568311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-c6cb53c9-f80c-4b76-9070-702181d85226 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:36:46.569441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 210/419] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 18:36:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:46.575272 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6396d5-b702-48ee-8f14-35fb3b18f80e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:46.585503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6396d5-b702-48ee-8f14-35fb3b18f80e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:46.589696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83cf65-232c-41c9-b47d-a7f45daffc35 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_gnG7iXaT_WLGlJthwocIQ, audit_chain_id=['_gnG7iXaT_WLGlJthwocIQ']) at 0x7fe09e155460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:46.590291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83cf65-232c-41c9-b47d-a7f45daffc35 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.590936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83cf65-232c-41c9-b47d-a7f45daffc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.596060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83cf65-232c-41c9-b47d-a7f45daffc35 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.596843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83cf65-232c-41c9-b47d-a7f45daffc35 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:46.597152 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83cf65-232c-41c9-b47d-a7f45daffc35 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:46.599004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83cf65-232c-41c9-b47d-a7f45daffc35 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:46.630008 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 210/420] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Feb 28 18:36:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:46.635918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb53c9-f80c-4b76-9070-702181d85226 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:46.646216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb53c9-f80c-4b76-9070-702181d85226 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:46.650317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238307bb-1b95-40c2-b87d-331eb1fb77cc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_gnG7iXaT_WLGlJthwocIQ, audit_chain_id=['_gnG7iXaT_WLGlJthwocIQ']) at 0x7fe09e1b0fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:46.651030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238307bb-1b95-40c2-b87d-331eb1fb77cc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.651351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238307bb-1b95-40c2-b87d-331eb1fb77cc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.651627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238307bb-1b95-40c2-b87d-331eb1fb77cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.664638 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238307bb-1b95-40c2-b87d-331eb1fb77cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:46.666464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238307bb-1b95-40c2-b87d-331eb1fb77cc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:46.683334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-238307bb-1b95-40c2-b87d-331eb1fb77cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:46.684968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 211/421] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:46.690741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83cf65-232c-41c9-b47d-a7f45daffc35 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:46.701656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83cf65-232c-41c9-b47d-a7f45daffc35 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:46.705873 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650cc1d-cf38-4107-a709-1aefb1a583c8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_gnG7iXaT_WLGlJthwocIQ, audit_chain_id=['_gnG7iXaT_WLGlJthwocIQ']) at 0x7fe09e106430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:46.706469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650cc1d-cf38-4107-a709-1aefb1a583c8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.706762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650cc1d-cf38-4107-a709-1aefb1a583c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.707052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650cc1d-cf38-4107-a709-1aefb1a583c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.707776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650cc1d-cf38-4107-a709-1aefb1a583c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:46.708072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650cc1d-cf38-4107-a709-1aefb1a583c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:46.709666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650cc1d-cf38-4107-a709-1aefb1a583c8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:46.722199 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 211/422] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:46.727900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238307bb-1b95-40c2-b87d-331eb1fb77cc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:46.737464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238307bb-1b95-40c2-b87d-331eb1fb77cc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:46.741603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c207bf-2641-4af9-856d-d75d9711fb55 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_gnG7iXaT_WLGlJthwocIQ, audit_chain_id=['_gnG7iXaT_WLGlJthwocIQ']) at 0x7fe09e3dc3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:46.742297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c207bf-2641-4af9-856d-d75d9711fb55 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.742585 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c207bf-2641-4af9-856d-d75d9711fb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.742868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c207bf-2641-4af9-856d-d75d9711fb55 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.752121 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c207bf-2641-4af9-856d-d75d9711fb55 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:46.754073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c207bf-2641-4af9-856d-d75d9711fb55 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:46.768334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-74c207bf-2641-4af9-856d-d75d9711fb55 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:46.769357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 212/423] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:46.775314 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650cc1d-cf38-4107-a709-1aefb1a583c8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:46.785431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650cc1d-cf38-4107-a709-1aefb1a583c8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:46.789508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be0c0f-5719-48fb-923e-0f3219446d55 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_gnG7iXaT_WLGlJthwocIQ, audit_chain_id=['_gnG7iXaT_WLGlJthwocIQ']) at 0x7fe09e106910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:46.790098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0c0f-5719-48fb-923e-0f3219446d55 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.790387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0c0f-5719-48fb-923e-0f3219446d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.790666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0c0f-5719-48fb-923e-0f3219446d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.791456 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be0c0f-5719-48fb-923e-0f3219446d55 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:46.791756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be0c0f-5719-48fb-923e-0f3219446d55 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:46.793713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be0c0f-5719-48fb-923e-0f3219446d55 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:46.901200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 212/424] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:46.907201 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c207bf-2641-4af9-856d-d75d9711fb55 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:46.917046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c207bf-2641-4af9-856d-d75d9711fb55 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:46.921803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449259d-e377-48fa-8674-e55144456cff admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_gnG7iXaT_WLGlJthwocIQ, audit_chain_id=['_gnG7iXaT_WLGlJthwocIQ']) at 0x7fe09e159af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:46.922627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449259d-e377-48fa-8674-e55144456cff admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:46.922915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449259d-e377-48fa-8674-e55144456cff admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:46.923222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449259d-e377-48fa-8674-e55144456cff admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/6d280e56dc8848eb92cbee073fd9fbc8/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:46.925017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449259d-e377-48fa-8674-e55144456cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=6d280e56dc8848eb92cbee073fd9fbc8, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:46.927677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449259d-e377-48fa-8674-e55144456cff admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:47.047860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 213/425] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:36:46 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/6d280e56dc8848eb92cbee073fd9fbc8/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:36:49.181318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85663fa-80cb-472b-b25c-53dd68428486 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.181843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85663fa-80cb-472b-b25c-53dd68428486 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.181932 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85663fa-80cb-472b-b25c-53dd68428486 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.183621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 213/426] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:49.189347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53820-3878-4260-a469-8bf3c63a444e None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.189767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53820-3878-4260-a469-8bf3c63a444e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.189911 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53820-3878-4260-a469-8bf3c63a444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.213786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a0b53820-3878-4260-a469-8bf3c63a444e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:49.214871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a0b53820-3878-4260-a469-8bf3c63a444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:49.278721 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 214/427] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:49.301866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85663fa-80cb-472b-b25c-53dd68428486 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.314213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85663fa-80cb-472b-b25c-53dd68428486 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.318180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fba5d-8688-45be-b17f-dcd825259275 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e106670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.318897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fba5d-8688-45be-b17f-dcd825259275 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.319220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fba5d-8688-45be-b17f-dcd825259275 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.319509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fba5d-8688-45be-b17f-dcd825259275 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.331148 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fba5d-8688-45be-b17f-dcd825259275 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:36:49.337481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-e02fba5d-8688-45be-b17f-dcd825259275 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:36:49.338580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 214/428] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:49.345098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53820-3878-4260-a469-8bf3c63a444e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.353794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53820-3878-4260-a469-8bf3c63a444e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.358450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd6ba7-15b5-4ae4-831d-777687910592 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e4084f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.359037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd6ba7-15b5-4ae4-831d-777687910592 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.359348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd6ba7-15b5-4ae4-831d-777687910592 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.359631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd6ba7-15b5-4ae4-831d-777687910592 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.360347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd6ba7-15b5-4ae4-831d-777687910592 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:49.360808 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd6ba7-15b5-4ae4-831d-777687910592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:49.362393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd6ba7-15b5-4ae4-831d-777687910592 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:49.371299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 215/429] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:49.376825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fba5d-8688-45be-b17f-dcd825259275 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.386182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fba5d-8688-45be-b17f-dcd825259275 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.391062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49a10b-d2bf-4dc0-ae05-9aca207a8f02 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e106f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.391819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a10b-d2bf-4dc0-ae05-9aca207a8f02 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.392112 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a10b-d2bf-4dc0-ae05-9aca207a8f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.392401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49a10b-d2bf-4dc0-ae05-9aca207a8f02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.404823 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49a10b-d2bf-4dc0-ae05-9aca207a8f02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:49.406645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49a10b-d2bf-4dc0-ae05-9aca207a8f02 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:49.423390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-da49a10b-d2bf-4dc0-ae05-9aca207a8f02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:49.424481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 215/430] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:49.429989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd6ba7-15b5-4ae4-831d-777687910592 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.439844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd6ba7-15b5-4ae4-831d-777687910592 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.443932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43185c34-043c-46da-bdfc-936c3c23261f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e3c4760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.444515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43185c34-043c-46da-bdfc-936c3c23261f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.444802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43185c34-043c-46da-bdfc-936c3c23261f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.445084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43185c34-043c-46da-bdfc-936c3c23261f admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.445769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43185c34-043c-46da-bdfc-936c3c23261f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:49.446065 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43185c34-043c-46da-bdfc-936c3c23261f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:49.447678 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43185c34-043c-46da-bdfc-936c3c23261f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:49.460601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 216/431] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:49.466632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49a10b-d2bf-4dc0-ae05-9aca207a8f02 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.476834 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49a10b-d2bf-4dc0-ae05-9aca207a8f02 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.484289 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca434e-cfa3-42d2-8a94-4e58ff396226 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e25be50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.485033 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca434e-cfa3-42d2-8a94-4e58ff396226 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.485330 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca434e-cfa3-42d2-8a94-4e58ff396226 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.485616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca434e-cfa3-42d2-8a94-4e58ff396226 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.499247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca434e-cfa3-42d2-8a94-4e58ff396226 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:49.501281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca434e-cfa3-42d2-8a94-4e58ff396226 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:49.520073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-08ca434e-cfa3-42d2-8a94-4e58ff396226 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:36:49.521212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 216/432] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:49.526960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43185c34-043c-46da-bdfc-936c3c23261f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.536590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43185c34-043c-46da-bdfc-936c3c23261f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.540847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd19ab-a2e6-4f1a-961f-e126f13294cb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e1b0340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.541438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd19ab-a2e6-4f1a-961f-e126f13294cb admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.541729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd19ab-a2e6-4f1a-961f-e126f13294cb admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.542006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd19ab-a2e6-4f1a-961f-e126f13294cb admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.542783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd19ab-a2e6-4f1a-961f-e126f13294cb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:49.543080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd19ab-a2e6-4f1a-961f-e126f13294cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:49.545005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd19ab-a2e6-4f1a-961f-e126f13294cb admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:49.574230 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 217/433] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:49.580697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca434e-cfa3-42d2-8a94-4e58ff396226 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.590400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca434e-cfa3-42d2-8a94-4e58ff396226 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.595089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f48af-59cc-467e-92e0-608f1f87906d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e21e8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.595702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f48af-59cc-467e-92e0-608f1f87906d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.595996 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f48af-59cc-467e-92e0-608f1f87906d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.596281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f48af-59cc-467e-92e0-608f1f87906d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.604260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f48af-59cc-467e-92e0-608f1f87906d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:49.606177 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f48af-59cc-467e-92e0-608f1f87906d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:49.615376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 217/434] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:49.621008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd19ab-a2e6-4f1a-961f-e126f13294cb admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.631212 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd19ab-a2e6-4f1a-961f-e126f13294cb admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.635292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9e420-dde5-4ac2-a9d2-c19d9ae1214c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e716130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.636006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e420-dde5-4ac2-a9d2-c19d9ae1214c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.636291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e420-dde5-4ac2-a9d2-c19d9ae1214c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.636567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e420-dde5-4ac2-a9d2-c19d9ae1214c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.648859 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9e420-dde5-4ac2-a9d2-c19d9ae1214c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:49.650681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9e420-dde5-4ac2-a9d2-c19d9ae1214c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:49.667413 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-21a9e420-dde5-4ac2-a9d2-c19d9ae1214c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:49.668526 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 218/435] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:36:49.674155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f48af-59cc-467e-92e0-608f1f87906d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.682841 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f48af-59cc-467e-92e0-608f1f87906d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.687734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92cae5-6fa3-4ba7-9861-363b74a29279 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e106310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.688327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92cae5-6fa3-4ba7-9861-363b74a29279 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.688613 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92cae5-6fa3-4ba7-9861-363b74a29279 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.688892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92cae5-6fa3-4ba7-9861-363b74a29279 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.689573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92cae5-6fa3-4ba7-9861-363b74a29279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:49.689871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92cae5-6fa3-4ba7-9861-363b74a29279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:49.691491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92cae5-6fa3-4ba7-9861-363b74a29279 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:49.704304 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 218/436] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:49.709689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9e420-dde5-4ac2-a9d2-c19d9ae1214c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.720202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9e420-dde5-4ac2-a9d2-c19d9ae1214c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.724398 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833e551-136d-4eb4-92a5-64d78a9662a2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e16ef40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.725115 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e551-136d-4eb4-92a5-64d78a9662a2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.725408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e551-136d-4eb4-92a5-64d78a9662a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.725690 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e551-136d-4eb4-92a5-64d78a9662a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.735064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833e551-136d-4eb4-92a5-64d78a9662a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:49.737092 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833e551-136d-4eb4-92a5-64d78a9662a2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:49.751896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-9833e551-136d-4eb4-92a5-64d78a9662a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:49.753001 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 219/437] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:49.758779 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92cae5-6fa3-4ba7-9861-363b74a29279 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.769009 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92cae5-6fa3-4ba7-9861-363b74a29279 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.773216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a2a83-8de7-4087-ab34-008f52780e1d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e106160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.773812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a2a83-8de7-4087-ab34-008f52780e1d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.774105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a2a83-8de7-4087-ab34-008f52780e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.774395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a2a83-8de7-4087-ab34-008f52780e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.775193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a2a83-8de7-4087-ab34-008f52780e1d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:49.775507 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a2a83-8de7-4087-ab34-008f52780e1d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:49.777359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a2a83-8de7-4087-ab34-008f52780e1d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:49.790414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 219/438] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:49.797078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833e551-136d-4eb4-92a5-64d78a9662a2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:49.806729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833e551-136d-4eb4-92a5-64d78a9662a2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:49.812050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955011e-00eb-4961-b06e-89fd4d182ac6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBryVdveR_WuB1nOt-vt4Q, audit_chain_id=['zBryVdveR_WuB1nOt-vt4Q']) at 0x7fe09e411790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:49.812641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955011e-00eb-4961-b06e-89fd4d182ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:49.812931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955011e-00eb-4961-b06e-89fd4d182ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:49.813218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955011e-00eb-4961-b06e-89fd4d182ac6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:49.814067 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955011e-00eb-4961-b06e-89fd4d182ac6 admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=6d280e56dc8848eb92cbee073fd9fbc8) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:49.814423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955011e-00eb-4961-b06e-89fd4d182ac6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:49.816354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955011e-00eb-4961-b06e-89fd4d182ac6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:49.822535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 220/439] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:36:49 2022] GET /identity/v3/role_assignments?user.id=6d280e56dc8848eb92cbee073fd9fbc8&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:51.996986 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba489099-de22-42e4-8467-21bf6995d4b8 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:51.997556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba489099-de22-42e4-8467-21bf6995d4b8 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:51.997556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba489099-de22-42e4-8467-21bf6995d4b8 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:51.999232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 220/440] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:52.004520 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c9c86-d1cc-4f24-be41-5b2d38140a3d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:52.004923 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c9c86-d1cc-4f24-be41-5b2d38140a3d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:52.005096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c9c86-d1cc-4f24-be41-5b2d38140a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:52.029019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d77c9c86-d1cc-4f24-be41-5b2d38140a3d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:52.030226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d77c9c86-d1cc-4f24-be41-5b2d38140a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:52.037189 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 221/441] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:52 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:52.061130 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba489099-de22-42e4-8467-21bf6995d4b8 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:52.072827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba489099-de22-42e4-8467-21bf6995d4b8 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:52.078486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208ba89-ca63-4a7b-b6c3-e772da37bf69 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JOxW_89gQHuoF_IlppcJbg, audit_chain_id=['JOxW_89gQHuoF_IlppcJbg']) at 0x7fe09e106130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:52.079258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208ba89-ca63-4a7b-b6c3-e772da37bf69 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:52.079551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208ba89-ca63-4a7b-b6c3-e772da37bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:52.079834 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208ba89-ca63-4a7b-b6c3-e772da37bf69 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:52.080465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208ba89-ca63-4a7b-b6c3-e772da37bf69 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:52.081480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-d208ba89-ca63-4a7b-b6c3-e772da37bf69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:52.081480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:36:52.081480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:36:52.082354 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208ba89-ca63-4a7b-b6c3-e772da37bf69 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:52.094728 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-d208ba89-ca63-4a7b-b6c3-e772da37bf69 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 18:36:52.095842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 221/442] 10.222.0.21 () {56 vars in 1153 bytes} [Mon Feb 28 18:36:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:52.101631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c9c86-d1cc-4f24-be41-5b2d38140a3d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:52.110946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c9c86-d1cc-4f24-be41-5b2d38140a3d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:52.115139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f0e5c-9283-44b6-bdd9-f04b6ccdf7ce admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JOxW_89gQHuoF_IlppcJbg, audit_chain_id=['JOxW_89gQHuoF_IlppcJbg']) at 0x7fe09e3c4760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:52.115773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f0e5c-9283-44b6-bdd9-f04b6ccdf7ce admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:52.116064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f0e5c-9283-44b6-bdd9-f04b6ccdf7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:52.116349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f0e5c-9283-44b6-bdd9-f04b6ccdf7ce admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:52.117021 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f0e5c-9283-44b6-bdd9-f04b6ccdf7ce admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:52.117329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f0e5c-9283-44b6-bdd9-f04b6ccdf7ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:52.118348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-0a3f0e5c-9283-44b6-bdd9-f04b6ccdf7ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:52.118348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:36:52.118348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:36:52.119256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f0e5c-9283-44b6-bdd9-f04b6ccdf7ce admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:52.123689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 222/443] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Feb 28 18:36:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:52.128919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208ba89-ca63-4a7b-b6c3-e772da37bf69 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:52.138541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208ba89-ca63-4a7b-b6c3-e772da37bf69 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:52.142553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec943a08-67c7-409d-afc0-eacc546ee8b8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JOxW_89gQHuoF_IlppcJbg, audit_chain_id=['JOxW_89gQHuoF_IlppcJbg']) at 0x7fe09e21e5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:52.143167 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec943a08-67c7-409d-afc0-eacc546ee8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:52.143461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec943a08-67c7-409d-afc0-eacc546ee8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:52.143748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec943a08-67c7-409d-afc0-eacc546ee8b8 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:52.144420 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec943a08-67c7-409d-afc0-eacc546ee8b8 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:52.144721 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec943a08-67c7-409d-afc0-eacc546ee8b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:52.145717 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-ec943a08-67c7-409d-afc0-eacc546ee8b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:52.145717 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:36:52.145717 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:36:52.146589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec943a08-67c7-409d-afc0-eacc546ee8b8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:52.151019 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 222/444] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Feb 28 18:36:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:54.256104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa5ff-02f5-46ae-a33d-1ef688dd2e30 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:54.256620 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa5ff-02f5-46ae-a33d-1ef688dd2e30 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:54.256620 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa5ff-02f5-46ae-a33d-1ef688dd2e30 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:54.258385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 223/445] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:54.263712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fa318-091c-4c5d-b5bd-d2b148ff1e25 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:54.264208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fa318-091c-4c5d-b5bd-d2b148ff1e25 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:54.264305 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fa318-091c-4c5d-b5bd-d2b148ff1e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:54.287012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-483fa318-091c-4c5d-b5bd-d2b148ff1e25 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:54.288215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-483fa318-091c-4c5d-b5bd-d2b148ff1e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:54.295793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 223/446] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:54 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:54.318344 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fa5ff-02f5-46ae-a33d-1ef688dd2e30 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:54.330098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fa5ff-02f5-46ae-a33d-1ef688dd2e30 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:54.334111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78550d38-1dbf-4250-8301-2f6bcc3b6a2b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VUnfTbFQn67rYodtyIvzw, audit_chain_id=['6VUnfTbFQn67rYodtyIvzw']) at 0x7fe09e3d5b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:54.334696 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78550d38-1dbf-4250-8301-2f6bcc3b6a2b admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:54.334987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78550d38-1dbf-4250-8301-2f6bcc3b6a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:54.335305 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78550d38-1dbf-4250-8301-2f6bcc3b6a2b admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:54.336017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78550d38-1dbf-4250-8301-2f6bcc3b6a2b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:54.337068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-78550d38-1dbf-4250-8301-2f6bcc3b6a2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:54.337068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:36:54.337068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:36:54.337936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78550d38-1dbf-4250-8301-2f6bcc3b6a2b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:54.441373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 224/447] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:36:54 2022] POST /identity/v3/services => generated 269 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:36:56.576481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d376af-c14e-4809-992a-35f5605ae89e None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:56.577018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d376af-c14e-4809-992a-35f5605ae89e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:56.577018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d376af-c14e-4809-992a-35f5605ae89e None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:56.578872 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 224/448] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:56.584347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09081f2f-2e0d-40e9-88d3-958d245a2b28 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:56.584787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09081f2f-2e0d-40e9-88d3-958d245a2b28 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:56.584917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09081f2f-2e0d-40e9-88d3-958d245a2b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:56.608127 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-09081f2f-2e0d-40e9-88d3-958d245a2b28 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:56.609293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-09081f2f-2e0d-40e9-88d3-958d245a2b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:56.626684 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 225/449] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:56 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:56.650157 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d376af-c14e-4809-992a-35f5605ae89e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:56.662993 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d376af-c14e-4809-992a-35f5605ae89e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:56.667010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d0c5d-1cff-4509-8835-e3d9ae426ac4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gAM3XpynQ5ql6L7xATy8uQ, audit_chain_id=['gAM3XpynQ5ql6L7xATy8uQ']) at 0x7fe09e1a1430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:56.667788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d0c5d-1cff-4509-8835-e3d9ae426ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:56.668080 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d0c5d-1cff-4509-8835-e3d9ae426ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:56.668586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d0c5d-1cff-4509-8835-e3d9ae426ac4 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:56.669266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d0c5d-1cff-4509-8835-e3d9ae426ac4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:56.670856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d0c5d-1cff-4509-8835-e3d9ae426ac4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:56.681798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-621d0c5d-1cff-4509-8835-e3d9ae426ac4 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 18:36:56.682896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 225/450] 10.222.0.21 () {56 vars in 1153 bytes} [Mon Feb 28 18:36:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:56.689265 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09081f2f-2e0d-40e9-88d3-958d245a2b28 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:56.697956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09081f2f-2e0d-40e9-88d3-958d245a2b28 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:56.702879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e4d4a-81d0-4654-8da9-8fd875482a72 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gAM3XpynQ5ql6L7xATy8uQ, audit_chain_id=['gAM3XpynQ5ql6L7xATy8uQ']) at 0x7fe09e380100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:56.703532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e4d4a-81d0-4654-8da9-8fd875482a72 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:56.703825 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e4d4a-81d0-4654-8da9-8fd875482a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:56.704110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e4d4a-81d0-4654-8da9-8fd875482a72 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:56.704821 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e4d4a-81d0-4654-8da9-8fd875482a72 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:56.705124 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e4d4a-81d0-4654-8da9-8fd875482a72 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:56.706738 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e4d4a-81d0-4654-8da9-8fd875482a72 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:56.711282 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 226/451] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Feb 28 18:36:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:56.717776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d0c5d-1cff-4509-8835-e3d9ae426ac4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:56.727462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d0c5d-1cff-4509-8835-e3d9ae426ac4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:56.733095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54558b41-7371-4d5c-9a36-bdce1e25d00d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gAM3XpynQ5ql6L7xATy8uQ, audit_chain_id=['gAM3XpynQ5ql6L7xATy8uQ']) at 0x7fe09e1c0520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:56.733685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54558b41-7371-4d5c-9a36-bdce1e25d00d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:56.733979 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54558b41-7371-4d5c-9a36-bdce1e25d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:56.734264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54558b41-7371-4d5c-9a36-bdce1e25d00d admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:56.734933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54558b41-7371-4d5c-9a36-bdce1e25d00d admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:56.735263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54558b41-7371-4d5c-9a36-bdce1e25d00d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:56.736845 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54558b41-7371-4d5c-9a36-bdce1e25d00d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:56.741544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 226/452] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Feb 28 18:36:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:56.747433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e4d4a-81d0-4654-8da9-8fd875482a72 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:56.756747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e4d4a-81d0-4654-8da9-8fd875482a72 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:56.760931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5f8b3-17ca-4f44-ba85-d3d89ca9b11b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gAM3XpynQ5ql6L7xATy8uQ, audit_chain_id=['gAM3XpynQ5ql6L7xATy8uQ']) at 0x7fe09e159eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:56.761507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5f8b3-17ca-4f44-ba85-d3d89ca9b11b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:56.761796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5f8b3-17ca-4f44-ba85-d3d89ca9b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:56.762599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5f8b3-17ca-4f44-ba85-d3d89ca9b11b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:56.763382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5f8b3-17ca-4f44-ba85-d3d89ca9b11b admin admin] RBAC: Adding query filter params (interface=public, service_id=9a40f3d174b34bad9abb0f5f31fbac1a, region_id=RegionOne) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:56.763688 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5f8b3-17ca-4f44-ba85-d3d89ca9b11b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:56.764694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-7da5f8b3-17ca-4f44-ba85-d3d89ca9b11b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:56.764694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:36:56.764694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:36:56.765569 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5f8b3-17ca-4f44-ba85-d3d89ca9b11b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:56.771446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 227/453] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Feb 28 18:36:56 2022] GET /identity/v3/endpoints?service_id=9a40f3d174b34bad9abb0f5f31fbac1a&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:56.776715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54558b41-7371-4d5c-9a36-bdce1e25d00d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:56.786710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54558b41-7371-4d5c-9a36-bdce1e25d00d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:56.790749 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f29344-1638-44da-a465-410198333d6d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gAM3XpynQ5ql6L7xATy8uQ, audit_chain_id=['gAM3XpynQ5ql6L7xATy8uQ']) at 0x7fe09e1c0370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:56.791366 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29344-1638-44da-a465-410198333d6d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:56.791655 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29344-1638-44da-a465-410198333d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:56.791934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29344-1638-44da-a465-410198333d6d admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:56.792577 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f29344-1638-44da-a465-410198333d6d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:56.794446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f29344-1638-44da-a465-410198333d6d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:56.799122 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 227/454] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:36:56 2022] GET /identity/v3/services => generated 562 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:58.938356 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d109e5-39a4-4c4f-aac2-22e294b15743 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:58.938877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d109e5-39a4-4c4f-aac2-22e294b15743 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:58.938962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d109e5-39a4-4c4f-aac2-22e294b15743 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:58.940617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 228/455] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:58.946078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8447c9-3656-4dde-aa4c-54c5b280a765 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:58.946488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8447c9-3656-4dde-aa4c-54c5b280a765 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:58.946743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8447c9-3656-4dde-aa4c-54c5b280a765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:58.969265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-ba8447c9-3656-4dde-aa4c-54c5b280a765 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:58.970444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ba8447c9-3656-4dde-aa4c-54c5b280a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:58.977292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 228/456] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:58 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:59.001536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d109e5-39a4-4c4f-aac2-22e294b15743 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:59.013647 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d109e5-39a4-4c4f-aac2-22e294b15743 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:59.017782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8b429-15f1-4f6d-9c86-45b41862d581 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LyOg3o_0TZWQhehNXnsp3g, audit_chain_id=['LyOg3o_0TZWQhehNXnsp3g']) at 0x7fe09e1b0520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:59.018512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8b429-15f1-4f6d-9c86-45b41862d581 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:59.018802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8b429-15f1-4f6d-9c86-45b41862d581 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:59.019088 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8b429-15f1-4f6d-9c86-45b41862d581 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:59.019744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8b429-15f1-4f6d-9c86-45b41862d581 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:59.020754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-76a8b429-15f1-4f6d-9c86-45b41862d581 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:59.020754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:36:59.020754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:36:59.021644 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8b429-15f1-4f6d-9c86-45b41862d581 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:59.033175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-76a8b429-15f1-4f6d-9c86-45b41862d581 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 18:36:59.034250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 229/457] 10.222.0.21 () {56 vars in 1153 bytes} [Mon Feb 28 18:36:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:59.040045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8447c9-3656-4dde-aa4c-54c5b280a765 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:59.051484 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8447c9-3656-4dde-aa4c-54c5b280a765 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:59.055658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13712f66-94cf-49eb-9588-9a0ecb3f304d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LyOg3o_0TZWQhehNXnsp3g, audit_chain_id=['LyOg3o_0TZWQhehNXnsp3g']) at 0x7fe09e1e60d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:59.056251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13712f66-94cf-49eb-9588-9a0ecb3f304d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:59.056545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13712f66-94cf-49eb-9588-9a0ecb3f304d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:59.056829 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13712f66-94cf-49eb-9588-9a0ecb3f304d admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:59.057496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13712f66-94cf-49eb-9588-9a0ecb3f304d admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:59.057799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13712f66-94cf-49eb-9588-9a0ecb3f304d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:59.060792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13712f66-94cf-49eb-9588-9a0ecb3f304d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:59.065447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 229/458] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Feb 28 18:36:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:59.071340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8b429-15f1-4f6d-9c86-45b41862d581 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:59.080873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8b429-15f1-4f6d-9c86-45b41862d581 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:59.085040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98f23b-5e85-43b4-a4a0-437adddda363 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LyOg3o_0TZWQhehNXnsp3g, audit_chain_id=['LyOg3o_0TZWQhehNXnsp3g']) at 0x7fe09e3ed8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:59.085623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98f23b-5e85-43b4-a4a0-437adddda363 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:59.085917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98f23b-5e85-43b4-a4a0-437adddda363 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:59.086204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98f23b-5e85-43b4-a4a0-437adddda363 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:59.086864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98f23b-5e85-43b4-a4a0-437adddda363 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:36:59.087200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98f23b-5e85-43b4-a4a0-437adddda363 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:59.088812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98f23b-5e85-43b4-a4a0-437adddda363 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:59.093811 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 230/459] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Feb 28 18:36:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:59.099264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13712f66-94cf-49eb-9588-9a0ecb3f304d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:59.109700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13712f66-94cf-49eb-9588-9a0ecb3f304d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:59.113729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefe0b7-dfc6-4c61-916c-bc00e4ef717e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LyOg3o_0TZWQhehNXnsp3g, audit_chain_id=['LyOg3o_0TZWQhehNXnsp3g']) at 0x7fe09e1e6520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:59.114316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefe0b7-dfc6-4c61-916c-bc00e4ef717e admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:59.114604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefe0b7-dfc6-4c61-916c-bc00e4ef717e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:59.114881 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefe0b7-dfc6-4c61-916c-bc00e4ef717e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:59.115623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefe0b7-dfc6-4c61-916c-bc00e4ef717e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:59.116622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-5eefe0b7-dfc6-4c61-916c-bc00e4ef717e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:36:59.116622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:36:59.116622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:36:59.117496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefe0b7-dfc6-4c61-916c-bc00e4ef717e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:36:59.206264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 230/460] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Feb 28 18:36:59 2022] POST /identity/v3/endpoints => generated 347 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:37:01.353251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f709-2f4d-4cba-bca6-bb50f8f33001 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:01.353751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f709-2f4d-4cba-bca6-bb50f8f33001 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:01.353751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f709-2f4d-4cba-bca6-bb50f8f33001 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:01.355664 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 231/461] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:01.360994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc29a51-844e-4718-ab5d-c211dbbc53a8 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:01.361387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc29a51-844e-4718-ab5d-c211dbbc53a8 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:01.361555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc29a51-844e-4718-ab5d-c211dbbc53a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:01.383409 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-0cc29a51-844e-4718-ab5d-c211dbbc53a8 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:01.384590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0cc29a51-844e-4718-ab5d-c211dbbc53a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:01.406314 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 231/462] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:01 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:01.429292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548f709-2f4d-4cba-bca6-bb50f8f33001 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:01.441362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548f709-2f4d-4cba-bca6-bb50f8f33001 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:01.445480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d99f3-d4bc-4093-a0a5-c8eeb7423f14 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lXf5LjzgRxaygHLozJy7pw, audit_chain_id=['lXf5LjzgRxaygHLozJy7pw']) at 0x7fe09e3c4940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:01.446196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d99f3-d4bc-4093-a0a5-c8eeb7423f14 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:01.446487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d99f3-d4bc-4093-a0a5-c8eeb7423f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:01.446770 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d99f3-d4bc-4093-a0a5-c8eeb7423f14 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:01.447437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d99f3-d4bc-4093-a0a5-c8eeb7423f14 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:01.449035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d99f3-d4bc-4093-a0a5-c8eeb7423f14 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:01.459885 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-e41d99f3-d4bc-4093-a0a5-c8eeb7423f14 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 18:37:01.460951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 232/463] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:01.468362 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc29a51-844e-4718-ab5d-c211dbbc53a8 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:01.477010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc29a51-844e-4718-ab5d-c211dbbc53a8 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:01.481378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af29875-54cd-44b6-a656-ec97a322ab47 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lXf5LjzgRxaygHLozJy7pw, audit_chain_id=['lXf5LjzgRxaygHLozJy7pw']) at 0x7fe09eae6cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:01.481975 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29875-54cd-44b6-a656-ec97a322ab47 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:01.482265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29875-54cd-44b6-a656-ec97a322ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:01.482548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29875-54cd-44b6-a656-ec97a322ab47 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:01.483257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af29875-54cd-44b6-a656-ec97a322ab47 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:01.483563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af29875-54cd-44b6-a656-ec97a322ab47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:01.485150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af29875-54cd-44b6-a656-ec97a322ab47 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:01.489849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 232/464] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:37:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:01.495360 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d99f3-d4bc-4093-a0a5-c8eeb7423f14 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:01.506053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d99f3-d4bc-4093-a0a5-c8eeb7423f14 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:01.510338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c660c6-385b-4607-8149-f73c83638c7e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lXf5LjzgRxaygHLozJy7pw, audit_chain_id=['lXf5LjzgRxaygHLozJy7pw']) at 0x7fe09e1b86a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:01.510932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c660c6-385b-4607-8149-f73c83638c7e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:01.511262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c660c6-385b-4607-8149-f73c83638c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:01.511550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c660c6-385b-4607-8149-f73c83638c7e admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:01.513087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c660c6-385b-4607-8149-f73c83638c7e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:01.513398 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c660c6-385b-4607-8149-f73c83638c7e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:01.515013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c660c6-385b-4607-8149-f73c83638c7e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:01.519758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 233/465] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:37:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:03.666580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736950b-2a52-4b1b-9877-23af692fdb50 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:03.667166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736950b-2a52-4b1b-9877-23af692fdb50 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:03.667166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736950b-2a52-4b1b-9877-23af692fdb50 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:03.669624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 233/466] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:03.675180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc70f7-0d13-4f8e-b69a-4d678793708f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:03.675613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc70f7-0d13-4f8e-b69a-4d678793708f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:03.675749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc70f7-0d13-4f8e-b69a-4d678793708f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:03.698440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-98dc70f7-0d13-4f8e-b69a-4d678793708f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:03.699921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-98dc70f7-0d13-4f8e-b69a-4d678793708f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:03.706934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 234/467] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:03 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:03.731030 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736950b-2a52-4b1b-9877-23af692fdb50 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:03.742906 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736950b-2a52-4b1b-9877-23af692fdb50 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:03.747739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d093ef9-4401-450c-8b64-94a1acd9680a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eWL4oc4STSCb9JqTBUBlAw, audit_chain_id=['eWL4oc4STSCb9JqTBUBlAw']) at 0x7fe09e25bdf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:03.748329 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d093ef9-4401-450c-8b64-94a1acd9680a admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:03.748621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d093ef9-4401-450c-8b64-94a1acd9680a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:03.748906 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d093ef9-4401-450c-8b64-94a1acd9680a admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:03.749581 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d093ef9-4401-450c-8b64-94a1acd9680a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:03.750592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-7d093ef9-4401-450c-8b64-94a1acd9680a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:37:03.750592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:37:03.750592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:37:03.751512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d093ef9-4401-450c-8b64-94a1acd9680a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:03.824313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 234/468] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:37:03 2022] POST /identity/v3/services => generated 242 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:37:05.992765 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0bb09-e904-498e-8883-c902edc9906c None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:05.993311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0bb09-e904-498e-8883-c902edc9906c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:05.993311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0bb09-e904-498e-8883-c902edc9906c None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:05.995053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 235/469] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:06.001076 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3cae9-8386-4bb7-bf45-785a76fbaf4a None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:06.001492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3cae9-8386-4bb7-bf45-785a76fbaf4a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:06.001648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3cae9-8386-4bb7-bf45-785a76fbaf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:06.023586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-64c3cae9-8386-4bb7-bf45-785a76fbaf4a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:06.024734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-64c3cae9-8386-4bb7-bf45-785a76fbaf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:06.041238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 235/470] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:05 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:06.064508 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0bb09-e904-498e-8883-c902edc9906c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:06.076509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0bb09-e904-498e-8883-c902edc9906c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:06.080575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83c0a4-9fa8-4997-afef-e855f84d8ed2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VGh0cpRyQKaAZ0vmAQMs6A, audit_chain_id=['VGh0cpRyQKaAZ0vmAQMs6A']) at 0x7fe09e3dc430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:06.081290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83c0a4-9fa8-4997-afef-e855f84d8ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:06.081575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83c0a4-9fa8-4997-afef-e855f84d8ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:06.081855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83c0a4-9fa8-4997-afef-e855f84d8ed2 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:06.082477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83c0a4-9fa8-4997-afef-e855f84d8ed2 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:06.084112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83c0a4-9fa8-4997-afef-e855f84d8ed2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:06.095004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-0d83c0a4-9fa8-4997-afef-e855f84d8ed2 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 18:37:06.096081 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 236/471] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:06.101939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3cae9-8386-4bb7-bf45-785a76fbaf4a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:06.111364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3cae9-8386-4bb7-bf45-785a76fbaf4a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:06.115459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8761cf-72f6-4982-9257-44a42325d70b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VGh0cpRyQKaAZ0vmAQMs6A, audit_chain_id=['VGh0cpRyQKaAZ0vmAQMs6A']) at 0x7fe09e7b7160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:06.116046 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8761cf-72f6-4982-9257-44a42325d70b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:06.116336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8761cf-72f6-4982-9257-44a42325d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:06.116615 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8761cf-72f6-4982-9257-44a42325d70b admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:06.117283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8761cf-72f6-4982-9257-44a42325d70b admin admin] RBAC: Adding query filter params (name=compute) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:06.117584 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8761cf-72f6-4982-9257-44a42325d70b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:06.119181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8761cf-72f6-4982-9257-44a42325d70b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:06.123591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 236/472] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:37:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:06.129114 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83c0a4-9fa8-4997-afef-e855f84d8ed2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:06.138682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83c0a4-9fa8-4997-afef-e855f84d8ed2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:06.142766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5421555-7d50-4715-8ebd-f815716e7480 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VGh0cpRyQKaAZ0vmAQMs6A, audit_chain_id=['VGh0cpRyQKaAZ0vmAQMs6A']) at 0x7fe09e1b8f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:06.143388 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5421555-7d50-4715-8ebd-f815716e7480 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:06.143678 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5421555-7d50-4715-8ebd-f815716e7480 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:06.143959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5421555-7d50-4715-8ebd-f815716e7480 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:06.144627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5421555-7d50-4715-8ebd-f815716e7480 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:06.144928 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5421555-7d50-4715-8ebd-f815716e7480 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:06.146501 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5421555-7d50-4715-8ebd-f815716e7480 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:06.151102 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 237/473] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:37:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:06.157163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8761cf-72f6-4982-9257-44a42325d70b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:06.166201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8761cf-72f6-4982-9257-44a42325d70b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:06.170430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e95ab-17f7-415e-99fd-8e55151c7aad admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VGh0cpRyQKaAZ0vmAQMs6A, audit_chain_id=['VGh0cpRyQKaAZ0vmAQMs6A']) at 0x7fe09e1e6a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:06.171005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e95ab-17f7-415e-99fd-8e55151c7aad admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:06.171329 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e95ab-17f7-415e-99fd-8e55151c7aad admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:06.171609 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e95ab-17f7-415e-99fd-8e55151c7aad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:06.172343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e95ab-17f7-415e-99fd-8e55151c7aad admin admin] RBAC: Adding query filter params (interface=public, service_id=e2e754a60e084d09a0f8f9ed446794fc, region_id=RegionOne) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:06.172647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e95ab-17f7-415e-99fd-8e55151c7aad admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:06.173637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-d63e95ab-17f7-415e-99fd-8e55151c7aad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:37:06.173637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:37:06.173637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:37:06.174498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e95ab-17f7-415e-99fd-8e55151c7aad admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:06.181145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 237/474] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Feb 28 18:37:06 2022] GET /identity/v3/endpoints?service_id=e2e754a60e084d09a0f8f9ed446794fc&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:06.187203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5421555-7d50-4715-8ebd-f815716e7480 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:06.196534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5421555-7d50-4715-8ebd-f815716e7480 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:06.201403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01aaf5-e870-4d8e-bb39-b987cb3565ca admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VGh0cpRyQKaAZ0vmAQMs6A, audit_chain_id=['VGh0cpRyQKaAZ0vmAQMs6A']) at 0x7fe09e3e9c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:06.201987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01aaf5-e870-4d8e-bb39-b987cb3565ca admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:06.202278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01aaf5-e870-4d8e-bb39-b987cb3565ca admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:06.202563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01aaf5-e870-4d8e-bb39-b987cb3565ca admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:06.203246 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01aaf5-e870-4d8e-bb39-b987cb3565ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:06.204882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01aaf5-e870-4d8e-bb39-b987cb3565ca admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:06.209788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 238/475] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:37:06 2022] GET /identity/v3/services => generated 792 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:08.359031 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c591b-3c22-4c86-9abb-794fa491a155 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:08.359596 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c591b-3c22-4c86-9abb-794fa491a155 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:08.359596 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c591b-3c22-4c86-9abb-794fa491a155 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:08.361289 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 238/476] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:08.366625 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108917d-dc31-4e98-82b7-ea6ef0efef03 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:08.367039 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108917d-dc31-4e98-82b7-ea6ef0efef03 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:08.367201 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108917d-dc31-4e98-82b7-ea6ef0efef03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:08.391624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-4108917d-dc31-4e98-82b7-ea6ef0efef03 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:08.392788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4108917d-dc31-4e98-82b7-ea6ef0efef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:08.400581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 239/477] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:08 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:08.430260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c591b-3c22-4c86-9abb-794fa491a155 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:08.442315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c591b-3c22-4c86-9abb-794fa491a155 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:08.446217 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edb146-2b11-4ae0-a708-a979cfa4bb4a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LvTYoVc8T6qIPmwTdgYpwg, audit_chain_id=['LvTYoVc8T6qIPmwTdgYpwg']) at 0x7fe09e25bca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:08.446935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edb146-2b11-4ae0-a708-a979cfa4bb4a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:08.447260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edb146-2b11-4ae0-a708-a979cfa4bb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:08.447546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edb146-2b11-4ae0-a708-a979cfa4bb4a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:08.448172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edb146-2b11-4ae0-a708-a979cfa4bb4a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:08.449990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edb146-2b11-4ae0-a708-a979cfa4bb4a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:08.460135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-a3edb146-2b11-4ae0-a708-a979cfa4bb4a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 18:37:08.461189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 239/478] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:08.467554 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108917d-dc31-4e98-82b7-ea6ef0efef03 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:08.476483 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108917d-dc31-4e98-82b7-ea6ef0efef03 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:08.481274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37369ee-d619-4670-919e-9378f5202b6f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LvTYoVc8T6qIPmwTdgYpwg, audit_chain_id=['LvTYoVc8T6qIPmwTdgYpwg']) at 0x7fe09e3e4190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:08.481865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37369ee-d619-4670-919e-9378f5202b6f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:08.482154 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37369ee-d619-4670-919e-9378f5202b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:08.482441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37369ee-d619-4670-919e-9378f5202b6f admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:08.483136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37369ee-d619-4670-919e-9378f5202b6f admin admin] RBAC: Adding query filter params (name=compute) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:08.483451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37369ee-d619-4670-919e-9378f5202b6f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:08.485078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37369ee-d619-4670-919e-9378f5202b6f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:08.489467 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 240/479] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:37:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:08.495191 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edb146-2b11-4ae0-a708-a979cfa4bb4a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:08.504615 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edb146-2b11-4ae0-a708-a979cfa4bb4a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:08.508675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc964f59-147a-4476-95f7-26c4ff779330 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LvTYoVc8T6qIPmwTdgYpwg, audit_chain_id=['LvTYoVc8T6qIPmwTdgYpwg']) at 0x7fe09e14ac40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:08.509261 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc964f59-147a-4476-95f7-26c4ff779330 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:08.509548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc964f59-147a-4476-95f7-26c4ff779330 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:08.509829 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc964f59-147a-4476-95f7-26c4ff779330 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:08.510488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc964f59-147a-4476-95f7-26c4ff779330 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:08.510787 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc964f59-147a-4476-95f7-26c4ff779330 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:08.512482 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc964f59-147a-4476-95f7-26c4ff779330 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:08.517071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 240/480] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:37:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:08.522453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37369ee-d619-4670-919e-9378f5202b6f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:08.532285 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37369ee-d619-4670-919e-9378f5202b6f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:08.536385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d24ed5-47fe-4a62-8998-87edefbfcdc2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LvTYoVc8T6qIPmwTdgYpwg, audit_chain_id=['LvTYoVc8T6qIPmwTdgYpwg']) at 0x7fe09e3e48b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:08.536961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d24ed5-47fe-4a62-8998-87edefbfcdc2 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:08.537255 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d24ed5-47fe-4a62-8998-87edefbfcdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:08.537536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d24ed5-47fe-4a62-8998-87edefbfcdc2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:08.538227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d24ed5-47fe-4a62-8998-87edefbfcdc2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:08.539269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-50d24ed5-47fe-4a62-8998-87edefbfcdc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:37:08.539269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:37:08.539269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:37:08.540139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d24ed5-47fe-4a62-8998-87edefbfcdc2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:08.630459 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 241/481] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Feb 28 18:37:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:37:10.834636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029626c2-8d27-4556-ac62-db664bbb2b98 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:10.835263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029626c2-8d27-4556-ac62-db664bbb2b98 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:10.835263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029626c2-8d27-4556-ac62-db664bbb2b98 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:10.836892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 241/482] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:10.843252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3ab5-9b02-454e-8284-1e4272ef60ab None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:10.843716 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3ab5-9b02-454e-8284-1e4272ef60ab None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:10.843825 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3ab5-9b02-454e-8284-1e4272ef60ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:10.866385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-de2a3ab5-9b02-454e-8284-1e4272ef60ab None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:10.867574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-de2a3ab5-9b02-454e-8284-1e4272ef60ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:10.883937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 242/483] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:10 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:10.911784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029626c2-8d27-4556-ac62-db664bbb2b98 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:10.925551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029626c2-8d27-4556-ac62-db664bbb2b98 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:10.929646 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6dcf4-06ad-457c-805b-9f3dd602176b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e14aac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:10.930381 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dcf4-06ad-457c-805b-9f3dd602176b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:10.930670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dcf4-06ad-457c-805b-9f3dd602176b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:10.930953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dcf4-06ad-457c-805b-9f3dd602176b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:10.943318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6dcf4-06ad-457c-805b-9f3dd602176b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:10.950156 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-0be6dcf4-06ad-457c-805b-9f3dd602176b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:37:10.951349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 242/484] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Feb 28 18:37:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:10.957413 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a3ab5-9b02-454e-8284-1e4272ef60ab None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:10.966727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a3ab5-9b02-454e-8284-1e4272ef60ab None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:10.971358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94d26e-feee-4736-bcfb-304156706fc3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e380100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:10.971965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d26e-feee-4736-bcfb-304156706fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:10.972249 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d26e-feee-4736-bcfb-304156706fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:10.972530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d26e-feee-4736-bcfb-304156706fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:10.973251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94d26e-feee-4736-bcfb-304156706fc3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:10.973552 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94d26e-feee-4736-bcfb-304156706fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:10.975190 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94d26e-feee-4736-bcfb-304156706fc3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:10.984566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 243/485] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Feb 28 18:37:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:37:10.990197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6dcf4-06ad-457c-805b-9f3dd602176b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:11.000582 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6dcf4-06ad-457c-805b-9f3dd602176b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:11.004774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc4439-3342-42c9-98fa-df4d62aaac02 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e194280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:11.005490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc4439-3342-42c9-98fa-df4d62aaac02 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:11.005783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc4439-3342-42c9-98fa-df4d62aaac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:11.006066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc4439-3342-42c9-98fa-df4d62aaac02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:11.019740 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc4439-3342-42c9-98fa-df4d62aaac02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:11.021592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc4439-3342-42c9-98fa-df4d62aaac02 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:11.039186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-effc4439-3342-42c9-98fa-df4d62aaac02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:11.040324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 243/486] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:11.046716 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94d26e-feee-4736-bcfb-304156706fc3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:11.056210 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94d26e-feee-4736-bcfb-304156706fc3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:11.061120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954e38-443f-48a9-b67f-62abdee350b2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e7951f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:11.061702 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954e38-443f-48a9-b67f-62abdee350b2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:11.061989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954e38-443f-48a9-b67f-62abdee350b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:11.062269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e954e38-443f-48a9-b67f-62abdee350b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:11.062947 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e954e38-443f-48a9-b67f-62abdee350b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:11.063292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e954e38-443f-48a9-b67f-62abdee350b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:11.064890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e954e38-443f-48a9-b67f-62abdee350b2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:11.077749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 244/487] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:11.083328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc4439-3342-42c9-98fa-df4d62aaac02 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:11.093215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc4439-3342-42c9-98fa-df4d62aaac02 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:11.097283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa7517-8eb8-4f50-9854-e9389a724c5b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e1834f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:11.098008 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa7517-8eb8-4f50-9854-e9389a724c5b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:11.098298 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa7517-8eb8-4f50-9854-e9389a724c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:11.098583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa7517-8eb8-4f50-9854-e9389a724c5b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:11.112454 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa7517-8eb8-4f50-9854-e9389a724c5b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:11.114489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa7517-8eb8-4f50-9854-e9389a724c5b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:11.132799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-7dfa7517-8eb8-4f50-9854-e9389a724c5b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:37:11.133935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 244/488] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 18:37:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:11.139810 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954e38-443f-48a9-b67f-62abdee350b2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:11.149620 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e954e38-443f-48a9-b67f-62abdee350b2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:11.154020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56fcd9-e2cc-423e-95df-b78c469a1f0c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e3d5130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:11.154608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56fcd9-e2cc-423e-95df-b78c469a1f0c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:11.154897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56fcd9-e2cc-423e-95df-b78c469a1f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:11.155217 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56fcd9-e2cc-423e-95df-b78c469a1f0c admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:11.156005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56fcd9-e2cc-423e-95df-b78c469a1f0c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:11.156306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56fcd9-e2cc-423e-95df-b78c469a1f0c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:11.158138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56fcd9-e2cc-423e-95df-b78c469a1f0c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:11.188685 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 245/489] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Feb 28 18:37:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:11.194354 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa7517-8eb8-4f50-9854-e9389a724c5b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:11.203842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa7517-8eb8-4f50-9854-e9389a724c5b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:11.208118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3c952-052c-44cf-8d3a-5cb52231929a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e7058e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:11.208700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c952-052c-44cf-8d3a-5cb52231929a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:11.208987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c952-052c-44cf-8d3a-5cb52231929a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:11.209270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c952-052c-44cf-8d3a-5cb52231929a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:11.220610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3c952-052c-44cf-8d3a-5cb52231929a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:11.222283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3c952-052c-44cf-8d3a-5cb52231929a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:11.235758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 245/490] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:37:11 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:37:11.241728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56fcd9-e2cc-423e-95df-b78c469a1f0c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:11.252082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56fcd9-e2cc-423e-95df-b78c469a1f0c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:11.256341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276537cb-3959-4a6c-bb15-ce913e1151ba admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e3eb2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:11.257060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276537cb-3959-4a6c-bb15-ce913e1151ba admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:11.257352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276537cb-3959-4a6c-bb15-ce913e1151ba admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:11.257637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276537cb-3959-4a6c-bb15-ce913e1151ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:11.269523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276537cb-3959-4a6c-bb15-ce913e1151ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:11.271390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276537cb-3959-4a6c-bb15-ce913e1151ba admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:11.288791 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-276537cb-3959-4a6c-bb15-ce913e1151ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:11.289921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 246/491] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:11.296200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3c952-052c-44cf-8d3a-5cb52231929a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:11.304958 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3c952-052c-44cf-8d3a-5cb52231929a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:11.309369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188d7db-2889-4f1c-abb8-b52ca0bc05bc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e705f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:11.309953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d7db-2889-4f1c-abb8-b52ca0bc05bc admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:11.310240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d7db-2889-4f1c-abb8-b52ca0bc05bc admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:11.310520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188d7db-2889-4f1c-abb8-b52ca0bc05bc admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:11.311228 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188d7db-2889-4f1c-abb8-b52ca0bc05bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:11.311528 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188d7db-2889-4f1c-abb8-b52ca0bc05bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:11.313098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188d7db-2889-4f1c-abb8-b52ca0bc05bc admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:11.325974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 246/492] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:11.331558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276537cb-3959-4a6c-bb15-ce913e1151ba admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:11.341430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276537cb-3959-4a6c-bb15-ce913e1151ba admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:11.345872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae01df-eca5-4d16-8e77-a9a25e02d4ae admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e16eb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:11.346534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae01df-eca5-4d16-8e77-a9a25e02d4ae admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:11.346820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae01df-eca5-4d16-8e77-a9a25e02d4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:11.347105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae01df-eca5-4d16-8e77-a9a25e02d4ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:11.356446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae01df-eca5-4d16-8e77-a9a25e02d4ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:11.358403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae01df-eca5-4d16-8e77-a9a25e02d4ae admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:11.372473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-82ae01df-eca5-4d16-8e77-a9a25e02d4ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:11.373575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 247/493] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:11.379339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188d7db-2889-4f1c-abb8-b52ca0bc05bc admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:11.389127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188d7db-2889-4f1c-abb8-b52ca0bc05bc admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:11.393364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a786f47-e3f0-4f99-9cdb-ba6e2bb28df4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e14e040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:11.393954 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786f47-e3f0-4f99-9cdb-ba6e2bb28df4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:11.394245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786f47-e3f0-4f99-9cdb-ba6e2bb28df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:11.394527 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a786f47-e3f0-4f99-9cdb-ba6e2bb28df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:11.395313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a786f47-e3f0-4f99-9cdb-ba6e2bb28df4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:11.395621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a786f47-e3f0-4f99-9cdb-ba6e2bb28df4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:11.397462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a786f47-e3f0-4f99-9cdb-ba6e2bb28df4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:11.410145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 247/494] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:11.416068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae01df-eca5-4d16-8e77-a9a25e02d4ae admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:11.426977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae01df-eca5-4d16-8e77-a9a25e02d4ae admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:11.435305 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494bb49-a5f1-4c3b-950a-e532c6ec8432 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=F-j3ZdcKS020g-RfSWsgiA, audit_chain_id=['F-j3ZdcKS020g-RfSWsgiA']) at 0x7fe09e1435e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:11.435891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494bb49-a5f1-4c3b-950a-e532c6ec8432 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:11.436178 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494bb49-a5f1-4c3b-950a-e532c6ec8432 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:11.436457 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494bb49-a5f1-4c3b-950a-e532c6ec8432 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:11.437243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494bb49-a5f1-4c3b-950a-e532c6ec8432 admin admin] RBAC: Adding query filter params (role.id=1e35e4150601455c863ca1a2d83431ac, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=6d280e56dc8848eb92cbee073fd9fbc8) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:11.437548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494bb49-a5f1-4c3b-950a-e532c6ec8432 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:11.439424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494bb49-a5f1-4c3b-950a-e532c6ec8432 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:11.444975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 248/495] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:37:11 2022] GET /identity/v3/role_assignments?user.id=6d280e56dc8848eb92cbee073fd9fbc8&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=1e35e4150601455c863ca1a2d83431ac => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:13.574945 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02b0fd-9b80-4153-9da3-7b476f385275 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:13.575545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02b0fd-9b80-4153-9da3-7b476f385275 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:13.575545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02b0fd-9b80-4153-9da3-7b476f385275 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:13.577269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 248/496] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:13.582672 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037eab-2c52-4776-b7ea-75700450c7a0 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:13.583103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037eab-2c52-4776-b7ea-75700450c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:13.583329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037eab-2c52-4776-b7ea-75700450c7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:13.607067 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-83037eab-2c52-4776-b7ea-75700450c7a0 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:13.608257 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-83037eab-2c52-4776-b7ea-75700450c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:13.615308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 249/497] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:13 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:13.638401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02b0fd-9b80-4153-9da3-7b476f385275 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:13.650144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02b0fd-9b80-4153-9da3-7b476f385275 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:13.654965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85232fb-fab2-445b-b02b-0f39b8ab57c1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=h-bwJGNqSr6UBu8PzZWeVQ, audit_chain_id=['h-bwJGNqSr6UBu8PzZWeVQ']) at 0x7fe09e1c04c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:13.655724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85232fb-fab2-445b-b02b-0f39b8ab57c1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:13.656018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85232fb-fab2-445b-b02b-0f39b8ab57c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:13.656371 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85232fb-fab2-445b-b02b-0f39b8ab57c1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:13.668714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85232fb-fab2-445b-b02b-0f39b8ab57c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:13.675475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-d85232fb-fab2-445b-b02b-0f39b8ab57c1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:37:13.677278 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 249/498] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Feb 28 18:37:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:13.682546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037eab-2c52-4776-b7ea-75700450c7a0 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:13.691735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037eab-2c52-4776-b7ea-75700450c7a0 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:13.696068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430f29-f8ee-4f5b-9b06-616f75c5de6a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=h-bwJGNqSr6UBu8PzZWeVQ, audit_chain_id=['h-bwJGNqSr6UBu8PzZWeVQ']) at 0x7fe09e47e040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:13.696661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430f29-f8ee-4f5b-9b06-616f75c5de6a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:13.696952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430f29-f8ee-4f5b-9b06-616f75c5de6a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:13.697238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430f29-f8ee-4f5b-9b06-616f75c5de6a admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:13.697956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38430f29-f8ee-4f5b-9b06-616f75c5de6a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:13.698258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38430f29-f8ee-4f5b-9b06-616f75c5de6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:13.700182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38430f29-f8ee-4f5b-9b06-616f75c5de6a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:13.708620 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 250/499] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Feb 28 18:37:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:13.714137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85232fb-fab2-445b-b02b-0f39b8ab57c1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:13.724895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85232fb-fab2-445b-b02b-0f39b8ab57c1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:13.729065 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1a0fe-a4c9-4d0b-80a2-afc21bae43d1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=h-bwJGNqSr6UBu8PzZWeVQ, audit_chain_id=['h-bwJGNqSr6UBu8PzZWeVQ']) at 0x7fe09e14e3d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:13.729778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1a0fe-a4c9-4d0b-80a2-afc21bae43d1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:13.730136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1a0fe-a4c9-4d0b-80a2-afc21bae43d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:13.730944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1a0fe-a4c9-4d0b-80a2-afc21bae43d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:13.742250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1a0fe-a4c9-4d0b-80a2-afc21bae43d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:13.744106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1a0fe-a4c9-4d0b-80a2-afc21bae43d1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:13.761015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-62d1a0fe-a4c9-4d0b-80a2-afc21bae43d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:13.762105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 250/500] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:13.767741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430f29-f8ee-4f5b-9b06-616f75c5de6a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:13.777687 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430f29-f8ee-4f5b-9b06-616f75c5de6a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:13.781925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fe607-91c4-4c88-8ef8-64118b575c57 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=h-bwJGNqSr6UBu8PzZWeVQ, audit_chain_id=['h-bwJGNqSr6UBu8PzZWeVQ']) at 0x7fe09e17fcd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:13.782512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fe607-91c4-4c88-8ef8-64118b575c57 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:13.782846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fe607-91c4-4c88-8ef8-64118b575c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:13.783199 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fe607-91c4-4c88-8ef8-64118b575c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:13.783891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fe607-91c4-4c88-8ef8-64118b575c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:13.784192 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fe607-91c4-4c88-8ef8-64118b575c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:13.785785 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fe607-91c4-4c88-8ef8-64118b575c57 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:13.799036 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 251/501] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:13.804578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1a0fe-a4c9-4d0b-80a2-afc21bae43d1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:13.813894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1a0fe-a4c9-4d0b-80a2-afc21bae43d1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:13.819178 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1046236-31cf-487a-897b-da9d1fbddf26 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=h-bwJGNqSr6UBu8PzZWeVQ, audit_chain_id=['h-bwJGNqSr6UBu8PzZWeVQ']) at 0x7fe09e14e8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:13.819893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1046236-31cf-487a-897b-da9d1fbddf26 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:13.820180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1046236-31cf-487a-897b-da9d1fbddf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:13.820460 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1046236-31cf-487a-897b-da9d1fbddf26 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:13.833135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1046236-31cf-487a-897b-da9d1fbddf26 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:13.835085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1046236-31cf-487a-897b-da9d1fbddf26 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:13.853030 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-a1046236-31cf-487a-897b-da9d1fbddf26 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:37:13.854120 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 251/502] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 18:37:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:13.860535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fe607-91c4-4c88-8ef8-64118b575c57 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:13.870004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fe607-91c4-4c88-8ef8-64118b575c57 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:13.874684 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43369cf6-3c5b-430a-a8e0-e891c1a78b0d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=h-bwJGNqSr6UBu8PzZWeVQ, audit_chain_id=['h-bwJGNqSr6UBu8PzZWeVQ']) at 0x7fe09e3b0580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:13.875315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43369cf6-3c5b-430a-a8e0-e891c1a78b0d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:13.875612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43369cf6-3c5b-430a-a8e0-e891c1a78b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:13.875916 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43369cf6-3c5b-430a-a8e0-e891c1a78b0d admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:13.876734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43369cf6-3c5b-430a-a8e0-e891c1a78b0d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:13.877039 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43369cf6-3c5b-430a-a8e0-e891c1a78b0d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:13.878890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43369cf6-3c5b-430a-a8e0-e891c1a78b0d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:13.908700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 252/503] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Feb 28 18:37:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:13.914413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1046236-31cf-487a-897b-da9d1fbddf26 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:13.924181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1046236-31cf-487a-897b-da9d1fbddf26 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:13.928328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418a1c0-19c9-4ae7-9f02-d2aecf90efb3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=h-bwJGNqSr6UBu8PzZWeVQ, audit_chain_id=['h-bwJGNqSr6UBu8PzZWeVQ']) at 0x7fe09e106dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:13.929051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418a1c0-19c9-4ae7-9f02-d2aecf90efb3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:13.929342 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418a1c0-19c9-4ae7-9f02-d2aecf90efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:13.929626 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418a1c0-19c9-4ae7-9f02-d2aecf90efb3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:13.942304 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418a1c0-19c9-4ae7-9f02-d2aecf90efb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:13.944188 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418a1c0-19c9-4ae7-9f02-d2aecf90efb3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:13.961574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-4418a1c0-19c9-4ae7-9f02-d2aecf90efb3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:13.962699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 252/504] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:13.969420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43369cf6-3c5b-430a-a8e0-e891c1a78b0d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:13.978998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43369cf6-3c5b-430a-a8e0-e891c1a78b0d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:13.983366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142f4d-757d-42fe-abd5-c22409eaaaab admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=h-bwJGNqSr6UBu8PzZWeVQ, audit_chain_id=['h-bwJGNqSr6UBu8PzZWeVQ']) at 0x7fe09e411f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:13.983995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142f4d-757d-42fe-abd5-c22409eaaaab admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:13.984283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142f4d-757d-42fe-abd5-c22409eaaaab admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:13.984569 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142f4d-757d-42fe-abd5-c22409eaaaab admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:13.985265 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79142f4d-757d-42fe-abd5-c22409eaaaab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:13.985568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79142f4d-757d-42fe-abd5-c22409eaaaab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:13.987194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79142f4d-757d-42fe-abd5-c22409eaaaab admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:13.999432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 253/505] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:14.004877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418a1c0-19c9-4ae7-9f02-d2aecf90efb3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:14.014795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418a1c0-19c9-4ae7-9f02-d2aecf90efb3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:14.018964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdfd78-5892-45fe-a154-dfa80b5930df admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=h-bwJGNqSr6UBu8PzZWeVQ, audit_chain_id=['h-bwJGNqSr6UBu8PzZWeVQ']) at 0x7fe09e14a6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:14.019720 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdfd78-5892-45fe-a154-dfa80b5930df admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:14.020007 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdfd78-5892-45fe-a154-dfa80b5930df admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:14.020291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdfd78-5892-45fe-a154-dfa80b5930df admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:14.029430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdfd78-5892-45fe-a154-dfa80b5930df admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:14.031435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdfd78-5892-45fe-a154-dfa80b5930df admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:14.044887 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-0dbdfd78-5892-45fe-a154-dfa80b5930df admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:14.045999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 253/506] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:37:14.051941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142f4d-757d-42fe-abd5-c22409eaaaab admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:14.061884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142f4d-757d-42fe-abd5-c22409eaaaab admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:14.066110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c0065-70fd-4512-b30b-cc747bbfab87 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=h-bwJGNqSr6UBu8PzZWeVQ, audit_chain_id=['h-bwJGNqSr6UBu8PzZWeVQ']) at 0x7fe09e363850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:14.066729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c0065-70fd-4512-b30b-cc747bbfab87 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:14.067022 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c0065-70fd-4512-b30b-cc747bbfab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:14.067337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c0065-70fd-4512-b30b-cc747bbfab87 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:14.068083 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c0065-70fd-4512-b30b-cc747bbfab87 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:14.068391 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c0065-70fd-4512-b30b-cc747bbfab87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:14.070225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c0065-70fd-4512-b30b-cc747bbfab87 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:14.084215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 254/507] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:14.094745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdfd78-5892-45fe-a154-dfa80b5930df admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:14.104344 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdfd78-5892-45fe-a154-dfa80b5930df admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:14.108529 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6124756-54f8-424b-899f-53a79bc31a15 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=h-bwJGNqSr6UBu8PzZWeVQ, audit_chain_id=['h-bwJGNqSr6UBu8PzZWeVQ']) at 0x7fe09e1a14f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:14.109338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6124756-54f8-424b-899f-53a79bc31a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:14.109626 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6124756-54f8-424b-899f-53a79bc31a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:14.109904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6124756-54f8-424b-899f-53a79bc31a15 admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/6d280e56dc8848eb92cbee073fd9fbc8/roles/1e35e4150601455c863ca1a2d83431ac` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:14.111991 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6124756-54f8-424b-899f-53a79bc31a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=6d280e56dc8848eb92cbee073fd9fbc8, role_id=1e35e4150601455c863ca1a2d83431ac)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:14.114589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6124756-54f8-424b-899f-53a79bc31a15 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:14.219405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 254/508] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:37:14 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/6d280e56dc8848eb92cbee073fd9fbc8/roles/1e35e4150601455c863ca1a2d83431ac => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:37:16.343078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e4d67-165d-4f86-947d-717c14b6770e None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.343624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e4d67-165d-4f86-947d-717c14b6770e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.343624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e4d67-165d-4f86-947d-717c14b6770e None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.345234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 255/509] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:16.350589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899963d1-624b-463e-9078-9d16631121c2 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.351027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899963d1-624b-463e-9078-9d16631121c2 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.351244 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899963d1-624b-463e-9078-9d16631121c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.374997 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-899963d1-624b-463e-9078-9d16631121c2 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:16.376200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-899963d1-624b-463e-9078-9d16631121c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:16.441202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 255/510] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:16 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:16.466926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e4d67-165d-4f86-947d-717c14b6770e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:16.479322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e4d67-165d-4f86-947d-717c14b6770e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:16.483630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ded82-d3d7-4539-a0e7-99d80136eeb0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e1c2af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:16.484384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ded82-d3d7-4539-a0e7-99d80136eeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.484680 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ded82-d3d7-4539-a0e7-99d80136eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.484963 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ded82-d3d7-4539-a0e7-99d80136eeb0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.497251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ded82-d3d7-4539-a0e7-99d80136eeb0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:16.504046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-4f5ded82-d3d7-4539-a0e7-99d80136eeb0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:37:16.505204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 256/511] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Feb 28 18:37:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:37:16.512070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899963d1-624b-463e-9078-9d16631121c2 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:16.520915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899963d1-624b-463e-9078-9d16631121c2 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:16.525123 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918884c-03b4-45b7-b1bf-edfa63d2a61f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e444430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:16.525783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918884c-03b4-45b7-b1bf-edfa63d2a61f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.526075 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918884c-03b4-45b7-b1bf-edfa63d2a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.526359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918884c-03b4-45b7-b1bf-edfa63d2a61f admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.527135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918884c-03b4-45b7-b1bf-edfa63d2a61f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:16.527419 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918884c-03b4-45b7-b1bf-edfa63d2a61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:16.529012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918884c-03b4-45b7-b1bf-edfa63d2a61f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:16.537732 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 256/512] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Feb 28 18:37:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:16.543529 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ded82-d3d7-4539-a0e7-99d80136eeb0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:16.555052 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ded82-d3d7-4539-a0e7-99d80136eeb0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:16.559931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c5bfb-1ef5-4f2c-8f29-aeb2bf4d104d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e1cc040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:16.560650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5bfb-1ef5-4f2c-8f29-aeb2bf4d104d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.560934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5bfb-1ef5-4f2c-8f29-aeb2bf4d104d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.561211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c5bfb-1ef5-4f2c-8f29-aeb2bf4d104d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.573031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c5bfb-1ef5-4f2c-8f29-aeb2bf4d104d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:16.575476 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c5bfb-1ef5-4f2c-8f29-aeb2bf4d104d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:16.593509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-298c5bfb-1ef5-4f2c-8f29-aeb2bf4d104d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:16.594561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 257/513] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:16.600388 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918884c-03b4-45b7-b1bf-edfa63d2a61f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:16.610493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918884c-03b4-45b7-b1bf-edfa63d2a61f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:16.614800 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b35e-e517-4d4d-8653-51808733723e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e269820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:16.615443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b35e-e517-4d4d-8653-51808733723e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.615739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b35e-e517-4d4d-8653-51808733723e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.616028 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b35e-e517-4d4d-8653-51808733723e admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.616722 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266b35e-e517-4d4d-8653-51808733723e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:16.617025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266b35e-e517-4d4d-8653-51808733723e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:16.618630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266b35e-e517-4d4d-8653-51808733723e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:16.634290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 257/514] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:16.640815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c5bfb-1ef5-4f2c-8f29-aeb2bf4d104d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:16.650849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c5bfb-1ef5-4f2c-8f29-aeb2bf4d104d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:16.655425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2686-2dd0-4c7c-b94f-a44bead8ed9f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e1cc8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:16.656158 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2686-2dd0-4c7c-b94f-a44bead8ed9f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.656447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2686-2dd0-4c7c-b94f-a44bead8ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.656731 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2686-2dd0-4c7c-b94f-a44bead8ed9f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.670237 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c2686-2dd0-4c7c-b94f-a44bead8ed9f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:16.672357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c2686-2dd0-4c7c-b94f-a44bead8ed9f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:16.692111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-e86c2686-2dd0-4c7c-b94f-a44bead8ed9f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:37:16.693280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 258/515] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 18:37:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:16.699367 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b35e-e517-4d4d-8653-51808733723e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:16.709886 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b35e-e517-4d4d-8653-51808733723e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:16.715079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5fe33-3c06-4ce0-807d-46de58a6472f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e2697c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:16.715743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5fe33-3c06-4ce0-807d-46de58a6472f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.716032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5fe33-3c06-4ce0-807d-46de58a6472f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.716314 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5fe33-3c06-4ce0-807d-46de58a6472f admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.717126 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5fe33-3c06-4ce0-807d-46de58a6472f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:16.717428 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5fe33-3c06-4ce0-807d-46de58a6472f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:16.719601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5fe33-3c06-4ce0-807d-46de58a6472f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:16.750870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 258/516] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Feb 28 18:37:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:16.756712 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2686-2dd0-4c7c-b94f-a44bead8ed9f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:16.767452 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2686-2dd0-4c7c-b94f-a44bead8ed9f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:16.771711 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86688712-f0de-4021-833e-567213b3dad4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e1fb250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:16.772341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86688712-f0de-4021-833e-567213b3dad4 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.772590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86688712-f0de-4021-833e-567213b3dad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.772874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86688712-f0de-4021-833e-567213b3dad4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.781895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86688712-f0de-4021-833e-567213b3dad4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:16.783689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86688712-f0de-4021-833e-567213b3dad4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:16.793044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 259/517] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:37:16 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:37:16.799378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5fe33-3c06-4ce0-807d-46de58a6472f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:16.809625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5fe33-3c06-4ce0-807d-46de58a6472f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:16.813820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec92ff9-96aa-47ac-972d-d2a11ccf1da7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e1dd5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:16.814558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec92ff9-96aa-47ac-972d-d2a11ccf1da7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.814846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec92ff9-96aa-47ac-972d-d2a11ccf1da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.815141 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec92ff9-96aa-47ac-972d-d2a11ccf1da7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.828047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec92ff9-96aa-47ac-972d-d2a11ccf1da7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:16.829876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec92ff9-96aa-47ac-972d-d2a11ccf1da7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:16.848325 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-4ec92ff9-96aa-47ac-972d-d2a11ccf1da7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:16.849665 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 259/518] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:16.856060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86688712-f0de-4021-833e-567213b3dad4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:16.865255 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86688712-f0de-4021-833e-567213b3dad4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:16.869552 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ba27e-935e-4281-9dea-7be98b5b876d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e3de220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:16.870156 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba27e-935e-4281-9dea-7be98b5b876d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.870447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba27e-935e-4281-9dea-7be98b5b876d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.871424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ba27e-935e-4281-9dea-7be98b5b876d admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.872112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ba27e-935e-4281-9dea-7be98b5b876d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:16.872405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ba27e-935e-4281-9dea-7be98b5b876d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:16.874009 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ba27e-935e-4281-9dea-7be98b5b876d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:16.887796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 260/519] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:16.896089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec92ff9-96aa-47ac-972d-d2a11ccf1da7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:16.911059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec92ff9-96aa-47ac-972d-d2a11ccf1da7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:16.917101 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fa788-5338-45d0-829a-f3a712c3bcae admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e14a220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:16.919153 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa788-5338-45d0-829a-f3a712c3bcae admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.919594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa788-5338-45d0-829a-f3a712c3bcae admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.920042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa788-5338-45d0-829a-f3a712c3bcae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.934381 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fa788-5338-45d0-829a-f3a712c3bcae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:16.937856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fa788-5338-45d0-829a-f3a712c3bcae admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:16.961428 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-0d6fa788-5338-45d0-829a-f3a712c3bcae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:16.963256 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 260/520] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:16.969486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ba27e-935e-4281-9dea-7be98b5b876d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:16.979135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ba27e-935e-4281-9dea-7be98b5b876d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:16.984507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166e079-c3fc-4433-bda1-56b1013ac520 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e353430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:16.985091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166e079-c3fc-4433-bda1-56b1013ac520 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:16.985380 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166e079-c3fc-4433-bda1-56b1013ac520 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:16.985663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166e079-c3fc-4433-bda1-56b1013ac520 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:16.986484 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166e079-c3fc-4433-bda1-56b1013ac520 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:16.986783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166e079-c3fc-4433-bda1-56b1013ac520 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:16.988658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166e079-c3fc-4433-bda1-56b1013ac520 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:17.002925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 261/521] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:17.009436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fa788-5338-45d0-829a-f3a712c3bcae admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:17.020099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fa788-5338-45d0-829a-f3a712c3bcae admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:17.024398 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d0bb7-861d-4f30-9a22-bda25bb465ce admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xFkZzIVaSdSRfxyn9qG79Q, audit_chain_id=['xFkZzIVaSdSRfxyn9qG79Q']) at 0x7fe09e212a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:17.024996 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d0bb7-861d-4f30-9a22-bda25bb465ce admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:17.025291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d0bb7-861d-4f30-9a22-bda25bb465ce admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:17.025577 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d0bb7-861d-4f30-9a22-bda25bb465ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:17.026372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d0bb7-861d-4f30-9a22-bda25bb465ce admin admin] RBAC: Adding query filter params (role.id=1e35e4150601455c863ca1a2d83431ac, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=6d280e56dc8848eb92cbee073fd9fbc8) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:17.026683 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d0bb7-861d-4f30-9a22-bda25bb465ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:17.029273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d0bb7-861d-4f30-9a22-bda25bb465ce admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:17.035878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 261/522] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:37:17 2022] GET /identity/v3/role_assignments?user.id=6d280e56dc8848eb92cbee073fd9fbc8&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=1e35e4150601455c863ca1a2d83431ac => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:19.450165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba5ab-0c87-4102-8192-65661fa180cc None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:19.450695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba5ab-0c87-4102-8192-65661fa180cc None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:19.450780 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba5ab-0c87-4102-8192-65661fa180cc None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:19.452487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 262/523] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:19.457830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a3a22-d426-4ff8-8e62-8df00774caa6 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:19.458247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a3a22-d426-4ff8-8e62-8df00774caa6 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:19.458413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a3a22-d426-4ff8-8e62-8df00774caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:19.482391 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-967a3a22-d426-4ff8-8e62-8df00774caa6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:19.483569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-967a3a22-d426-4ff8-8e62-8df00774caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:19.490529 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 262/524] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:19 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:19.516667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ba5ab-0c87-4102-8192-65661fa180cc None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:19.529145 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ba5ab-0c87-4102-8192-65661fa180cc None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:19.533321 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75566a2a-025f-4f0e-a009-a781313b0e7c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FYRf1e9zR16qgm-FbehktA, audit_chain_id=['FYRf1e9zR16qgm-FbehktA']) at 0x7fe09e1b0880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:19.534031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75566a2a-025f-4f0e-a009-a781313b0e7c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:19.534321 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75566a2a-025f-4f0e-a009-a781313b0e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:19.534604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75566a2a-025f-4f0e-a009-a781313b0e7c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:19.547003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75566a2a-025f-4f0e-a009-a781313b0e7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:19.548851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75566a2a-025f-4f0e-a009-a781313b0e7c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:19.565914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-75566a2a-025f-4f0e-a009-a781313b0e7c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:19.567030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 263/525] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:19.573318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a3a22-d426-4ff8-8e62-8df00774caa6 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:19.582336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a3a22-d426-4ff8-8e62-8df00774caa6 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:19.586564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9548c-9ac3-46da-ab55-d18b52aafa2b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FYRf1e9zR16qgm-FbehktA, audit_chain_id=['FYRf1e9zR16qgm-FbehktA']) at 0x7fe09e25b400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:19.587184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9548c-9ac3-46da-ab55-d18b52aafa2b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:19.587481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9548c-9ac3-46da-ab55-d18b52aafa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:19.587764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9548c-9ac3-46da-ab55-d18b52aafa2b admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:19.588453 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9548c-9ac3-46da-ab55-d18b52aafa2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:19.588756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9548c-9ac3-46da-ab55-d18b52aafa2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:19.591388 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9548c-9ac3-46da-ab55-d18b52aafa2b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:19.604059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 263/526] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:19.610209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75566a2a-025f-4f0e-a009-a781313b0e7c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:19.619725 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75566a2a-025f-4f0e-a009-a781313b0e7c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:19.624015 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0221-8025-47fe-abeb-2beeb078c185 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FYRf1e9zR16qgm-FbehktA, audit_chain_id=['FYRf1e9zR16qgm-FbehktA']) at 0x7fe09e17f3d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:19.624605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0221-8025-47fe-abeb-2beeb078c185 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:19.624901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0221-8025-47fe-abeb-2beeb078c185 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:19.625185 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0221-8025-47fe-abeb-2beeb078c185 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:19.625830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de0221-8025-47fe-abeb-2beeb078c185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:19.627768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de0221-8025-47fe-abeb-2beeb078c185 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:19.713263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 264/527] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:37:19 2022] POST /identity/v3/users => generated 248 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:37:21.876777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988c5d-c6f1-4705-9a60-38ecfaa0b6c0 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:21.877331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988c5d-c6f1-4705-9a60-38ecfaa0b6c0 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:21.877331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988c5d-c6f1-4705-9a60-38ecfaa0b6c0 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:21.878985 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 264/528] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:21.884254 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40332b2e-989e-4b9f-83a5-97fc25d79a70 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:21.884632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40332b2e-989e-4b9f-83a5-97fc25d79a70 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:21.884832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40332b2e-989e-4b9f-83a5-97fc25d79a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:21.907850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-40332b2e-989e-4b9f-83a5-97fc25d79a70 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:21.909010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-40332b2e-989e-4b9f-83a5-97fc25d79a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:21.916124 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 265/529] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:21 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:21.940886 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a988c5d-c6f1-4705-9a60-38ecfaa0b6c0 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:21.953883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a988c5d-c6f1-4705-9a60-38ecfaa0b6c0 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:21.957937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe609df-2401-457e-9713-152577026f20 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e14ae20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:21.958657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe609df-2401-457e-9713-152577026f20 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:21.958948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe609df-2401-457e-9713-152577026f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:21.959261 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe609df-2401-457e-9713-152577026f20 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:21.970955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe609df-2401-457e-9713-152577026f20 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:21.977225 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-7fe609df-2401-457e-9713-152577026f20 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:37:21.978338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 265/530] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:37:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:21.984360 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40332b2e-989e-4b9f-83a5-97fc25d79a70 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:21.993455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40332b2e-989e-4b9f-83a5-97fc25d79a70 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:21.998806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75a8d8-2bf5-414e-a1f5-716701f566cf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e1cc850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:21.999457 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75a8d8-2bf5-414e-a1f5-716701f566cf admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:21.999749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75a8d8-2bf5-414e-a1f5-716701f566cf admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:22.000035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75a8d8-2bf5-414e-a1f5-716701f566cf admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:22.000758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75a8d8-2bf5-414e-a1f5-716701f566cf admin admin] RBAC: Adding query filter params (name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:22.001060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75a8d8-2bf5-414e-a1f5-716701f566cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:22.002723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75a8d8-2bf5-414e-a1f5-716701f566cf admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:22.013288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 266/531] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:37:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:22.019083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe609df-2401-457e-9713-152577026f20 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:22.029117 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe609df-2401-457e-9713-152577026f20 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:22.033350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886dbf6-9185-43b3-aa03-142a19237382 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e183040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:22.034063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886dbf6-9185-43b3-aa03-142a19237382 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:22.034349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886dbf6-9185-43b3-aa03-142a19237382 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:22.034638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886dbf6-9185-43b3-aa03-142a19237382 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:22.048574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886dbf6-9185-43b3-aa03-142a19237382 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:22.050468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886dbf6-9185-43b3-aa03-142a19237382 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:22.068826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-b886dbf6-9185-43b3-aa03-142a19237382 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:22.069977 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 266/532] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:22.076375 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75a8d8-2bf5-414e-a1f5-716701f566cf admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:22.085803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75a8d8-2bf5-414e-a1f5-716701f566cf admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:22.090021 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bf954-0847-436d-948f-ab8502edf29a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e3e7a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:22.090608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bf954-0847-436d-948f-ab8502edf29a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:22.090898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bf954-0847-436d-948f-ab8502edf29a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:22.091219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bf954-0847-436d-948f-ab8502edf29a admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:22.091908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bf954-0847-436d-948f-ab8502edf29a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:22.092211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bf954-0847-436d-948f-ab8502edf29a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:22.094045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bf954-0847-436d-948f-ab8502edf29a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:22.107172 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 267/533] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:22.112744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886dbf6-9185-43b3-aa03-142a19237382 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:22.123263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886dbf6-9185-43b3-aa03-142a19237382 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:22.127618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6e39d-c649-416f-9dc2-c82e77a4a5ec admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e14a1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:22.128290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e39d-c649-416f-9dc2-c82e77a4a5ec admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:22.128583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e39d-c649-416f-9dc2-c82e77a4a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:22.128869 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6e39d-c649-416f-9dc2-c82e77a4a5ec admin admin] PATH_INFO: `/v3/users/glance` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:22.142250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6e39d-c649-416f-9dc2-c82e77a4a5ec admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:22.144329 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6e39d-c649-416f-9dc2-c82e77a4a5ec admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:22.162231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-7bd6e39d-c649-416f-9dc2-c82e77a4a5ec admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 18:37:22.163377 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 267/534] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:37:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:22.170202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bf954-0847-436d-948f-ab8502edf29a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:22.179766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bf954-0847-436d-948f-ab8502edf29a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:22.185130 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2d809-01c2-47c6-ae5b-fd27966e6425 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e439ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:22.185753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2d809-01c2-47c6-ae5b-fd27966e6425 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:22.186046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2d809-01c2-47c6-ae5b-fd27966e6425 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:22.186331 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2d809-01c2-47c6-ae5b-fd27966e6425 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:22.187142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2d809-01c2-47c6-ae5b-fd27966e6425 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:22.187455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2d809-01c2-47c6-ae5b-fd27966e6425 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:22.189297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2d809-01c2-47c6-ae5b-fd27966e6425 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:22.220121 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 268/535] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Feb 28 18:37:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:22.225991 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6e39d-c649-416f-9dc2-c82e77a4a5ec admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:22.236122 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6e39d-c649-416f-9dc2-c82e77a4a5ec admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:22.240161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd17387-4f0e-48c7-ac4b-1dac15a37565 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e25b6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:22.240736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd17387-4f0e-48c7-ac4b-1dac15a37565 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:22.241027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd17387-4f0e-48c7-ac4b-1dac15a37565 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:22.241306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd17387-4f0e-48c7-ac4b-1dac15a37565 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:22.249761 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd17387-4f0e-48c7-ac4b-1dac15a37565 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:22.251551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd17387-4f0e-48c7-ac4b-1dac15a37565 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:22.260086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 268/536] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:37:22 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:37:22.265903 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2d809-01c2-47c6-ae5b-fd27966e6425 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:22.275993 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2d809-01c2-47c6-ae5b-fd27966e6425 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:22.280403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf881b-ba7c-4704-b179-d5282c77b91d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e3e2c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:22.281154 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf881b-ba7c-4704-b179-d5282c77b91d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:22.281441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf881b-ba7c-4704-b179-d5282c77b91d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:22.281722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf881b-ba7c-4704-b179-d5282c77b91d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:22.294426 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf881b-ba7c-4704-b179-d5282c77b91d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:22.296303 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf881b-ba7c-4704-b179-d5282c77b91d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:22.313613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-16cf881b-ba7c-4704-b179-d5282c77b91d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:22.314708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 269/537] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:22.320364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd17387-4f0e-48c7-ac4b-1dac15a37565 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:22.329286 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd17387-4f0e-48c7-ac4b-1dac15a37565 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:22.333490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1530b9-f8a1-44c8-9ae9-a82c6c9a634f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e2697c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:22.334078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1530b9-f8a1-44c8-9ae9-a82c6c9a634f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:22.334368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1530b9-f8a1-44c8-9ae9-a82c6c9a634f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:22.334652 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1530b9-f8a1-44c8-9ae9-a82c6c9a634f admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:22.335431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1530b9-f8a1-44c8-9ae9-a82c6c9a634f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:22.335734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1530b9-f8a1-44c8-9ae9-a82c6c9a634f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:22.337303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1530b9-f8a1-44c8-9ae9-a82c6c9a634f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:22.350111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 269/538] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:22.356230 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf881b-ba7c-4704-b179-d5282c77b91d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:22.365626 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf881b-ba7c-4704-b179-d5282c77b91d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:22.369724 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9238e7d-8484-4896-afbf-4e758e285fcc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e143310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:22.371066 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9238e7d-8484-4896-afbf-4e758e285fcc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:22.371373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9238e7d-8484-4896-afbf-4e758e285fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:22.371644 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9238e7d-8484-4896-afbf-4e758e285fcc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:22.381615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9238e7d-8484-4896-afbf-4e758e285fcc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:22.383540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9238e7d-8484-4896-afbf-4e758e285fcc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:22.396869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-f9238e7d-8484-4896-afbf-4e758e285fcc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:22.397936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 270/539] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:22.403910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1530b9-f8a1-44c8-9ae9-a82c6c9a634f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:22.413619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1530b9-f8a1-44c8-9ae9-a82c6c9a634f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:22.418496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a47810-4279-4b25-a9f3-c2dd89e73711 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e14a2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:22.419097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a47810-4279-4b25-a9f3-c2dd89e73711 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:22.419423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a47810-4279-4b25-a9f3-c2dd89e73711 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:22.419799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a47810-4279-4b25-a9f3-c2dd89e73711 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:22.420636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a47810-4279-4b25-a9f3-c2dd89e73711 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:22.420950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a47810-4279-4b25-a9f3-c2dd89e73711 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:22.422784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a47810-4279-4b25-a9f3-c2dd89e73711 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:22.436235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 270/540] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:22.442241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9238e7d-8484-4896-afbf-4e758e285fcc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:22.452128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9238e7d-8484-4896-afbf-4e758e285fcc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:22.456333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d23ee-b557-409a-a63a-b80d127182b0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XH5qVcgMRg-V9J5houk9qQ, audit_chain_id=['XH5qVcgMRg-V9J5houk9qQ']) at 0x7fe09e3e4100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:22.456920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d23ee-b557-409a-a63a-b80d127182b0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:22.457225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d23ee-b557-409a-a63a-b80d127182b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:22.457491 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d23ee-b557-409a-a63a-b80d127182b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:22.458276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d23ee-b557-409a-a63a-b80d127182b0 admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=e956656659004428b3aaf23ae962f001) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:22.458583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d23ee-b557-409a-a63a-b80d127182b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:22.460486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d23ee-b557-409a-a63a-b80d127182b0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:22.466650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 271/541] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:37:22 2022] GET /identity/v3/role_assignments?user.id=e956656659004428b3aaf23ae962f001&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:24.574805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24298-1ea7-442b-9faf-ca86258e75a9 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:24.575423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24298-1ea7-442b-9faf-ca86258e75a9 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:24.575423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24298-1ea7-442b-9faf-ca86258e75a9 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:24.577116 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 271/542] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:24.582961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3184-6bce-421e-ad83-0991f56e70f5 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:24.583451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3184-6bce-421e-ad83-0991f56e70f5 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:24.583558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3184-6bce-421e-ad83-0991f56e70f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:24.607866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f15f3184-6bce-421e-ad83-0991f56e70f5 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:24.612013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f15f3184-6bce-421e-ad83-0991f56e70f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:24.616100 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 272/543] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:24 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:24.639689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24298-1ea7-442b-9faf-ca86258e75a9 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:24.651517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24298-1ea7-442b-9faf-ca86258e75a9 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:24.656082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64527546-b834-4784-ba9a-585eb2c3ed83 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OUz589nzRma9UFaQZUg2sw, audit_chain_id=['OUz589nzRma9UFaQZUg2sw']) at 0x7fe09e444430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:24.656444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527546-b834-4784-ba9a-585eb2c3ed83 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:24.656733 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527546-b834-4784-ba9a-585eb2c3ed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:24.657016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527546-b834-4784-ba9a-585eb2c3ed83 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:24.668993 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64527546-b834-4784-ba9a-585eb2c3ed83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:24.675453 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-64527546-b834-4784-ba9a-585eb2c3ed83 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:37:24.676590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 272/544] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:37:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:24.682548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3184-6bce-421e-ad83-0991f56e70f5 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:24.692598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3184-6bce-421e-ad83-0991f56e70f5 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:24.697019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349341a-0341-4a06-8a73-5bb07615214e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OUz589nzRma9UFaQZUg2sw, audit_chain_id=['OUz589nzRma9UFaQZUg2sw']) at 0x7fe09e14a130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:24.697455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349341a-0341-4a06-8a73-5bb07615214e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:24.697749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349341a-0341-4a06-8a73-5bb07615214e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:24.698034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349341a-0341-4a06-8a73-5bb07615214e admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:24.699465 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349341a-0341-4a06-8a73-5bb07615214e admin admin] RBAC: Adding query filter params (name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:24.699825 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349341a-0341-4a06-8a73-5bb07615214e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:24.701450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349341a-0341-4a06-8a73-5bb07615214e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:24.710353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 273/545] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:37:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:24.716639 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64527546-b834-4784-ba9a-585eb2c3ed83 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:24.728315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64527546-b834-4784-ba9a-585eb2c3ed83 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:24.733212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6061a8c-5c06-4936-beae-60ca0496f0ea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OUz589nzRma9UFaQZUg2sw, audit_chain_id=['OUz589nzRma9UFaQZUg2sw']) at 0x7fe09e106940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:24.733952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6061a8c-5c06-4936-beae-60ca0496f0ea admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:24.734247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6061a8c-5c06-4936-beae-60ca0496f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:24.734526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6061a8c-5c06-4936-beae-60ca0496f0ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:24.748767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6061a8c-5c06-4936-beae-60ca0496f0ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:24.750602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6061a8c-5c06-4936-beae-60ca0496f0ea admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:24.767858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-d6061a8c-5c06-4936-beae-60ca0496f0ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:24.768984 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 273/546] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:24.774727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349341a-0341-4a06-8a73-5bb07615214e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:24.784965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349341a-0341-4a06-8a73-5bb07615214e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:24.789153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da33a-b6b3-4214-ac1b-17b511792f99 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OUz589nzRma9UFaQZUg2sw, audit_chain_id=['OUz589nzRma9UFaQZUg2sw']) at 0x7fe09e14af10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:24.789733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da33a-b6b3-4214-ac1b-17b511792f99 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:24.790017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da33a-b6b3-4214-ac1b-17b511792f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:24.790294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da33a-b6b3-4214-ac1b-17b511792f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:24.790976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63da33a-b6b3-4214-ac1b-17b511792f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:24.791303 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63da33a-b6b3-4214-ac1b-17b511792f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:24.793506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63da33a-b6b3-4214-ac1b-17b511792f99 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:24.806050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 274/547] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:24.811738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6061a8c-5c06-4936-beae-60ca0496f0ea admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:24.821274 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6061a8c-5c06-4936-beae-60ca0496f0ea admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:24.825643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21bd6-e292-49ef-8209-8011f6876be2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OUz589nzRma9UFaQZUg2sw, audit_chain_id=['OUz589nzRma9UFaQZUg2sw']) at 0x7fe09e106e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:24.826304 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21bd6-e292-49ef-8209-8011f6876be2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:24.826587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21bd6-e292-49ef-8209-8011f6876be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:24.826858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21bd6-e292-49ef-8209-8011f6876be2 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:24.841146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed21bd6-e292-49ef-8209-8011f6876be2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:24.843532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed21bd6-e292-49ef-8209-8011f6876be2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:24.862367 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-bed21bd6-e292-49ef-8209-8011f6876be2 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 18:37:24.863546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 274/548] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:37:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:24.869212 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da33a-b6b3-4214-ac1b-17b511792f99 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:24.878812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da33a-b6b3-4214-ac1b-17b511792f99 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:24.883027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ecc6b-a18d-4fd6-8d0f-11f24ae3468a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OUz589nzRma9UFaQZUg2sw, audit_chain_id=['OUz589nzRma9UFaQZUg2sw']) at 0x7fe09e14a6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:24.883654 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ecc6b-a18d-4fd6-8d0f-11f24ae3468a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:24.883939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ecc6b-a18d-4fd6-8d0f-11f24ae3468a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:24.884221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ecc6b-a18d-4fd6-8d0f-11f24ae3468a admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:24.885008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ecc6b-a18d-4fd6-8d0f-11f24ae3468a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:24.885306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ecc6b-a18d-4fd6-8d0f-11f24ae3468a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:24.887513 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ecc6b-a18d-4fd6-8d0f-11f24ae3468a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:24.917983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 275/549] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Feb 28 18:37:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:24.923619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21bd6-e292-49ef-8209-8011f6876be2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:24.933272 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21bd6-e292-49ef-8209-8011f6876be2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:24.937563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8585-96d0-4ccf-be90-45395cac27e8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OUz589nzRma9UFaQZUg2sw, audit_chain_id=['OUz589nzRma9UFaQZUg2sw']) at 0x7fe09e705880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:24.938280 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8585-96d0-4ccf-be90-45395cac27e8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:24.938564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8585-96d0-4ccf-be90-45395cac27e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:24.938842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8585-96d0-4ccf-be90-45395cac27e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:24.951203 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de8585-96d0-4ccf-be90-45395cac27e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:24.953088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de8585-96d0-4ccf-be90-45395cac27e8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:24.977935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-43de8585-96d0-4ccf-be90-45395cac27e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:24.980742 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 275/550] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:24.986333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ecc6b-a18d-4fd6-8d0f-11f24ae3468a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:24.996261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ecc6b-a18d-4fd6-8d0f-11f24ae3468a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:25.000427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c07dbd-9558-48e9-b650-e94faad34bb8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OUz589nzRma9UFaQZUg2sw, audit_chain_id=['OUz589nzRma9UFaQZUg2sw']) at 0x7fe09e3e7e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:25.001012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07dbd-9558-48e9-b650-e94faad34bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:25.001298 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07dbd-9558-48e9-b650-e94faad34bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:25.001579 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07dbd-9558-48e9-b650-e94faad34bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:25.002293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c07dbd-9558-48e9-b650-e94faad34bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:25.002589 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c07dbd-9558-48e9-b650-e94faad34bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:25.004201 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c07dbd-9558-48e9-b650-e94faad34bb8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:25.016784 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 276/551] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:25.024350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8585-96d0-4ccf-be90-45395cac27e8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:25.034524 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8585-96d0-4ccf-be90-45395cac27e8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:25.038738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ed865-6ffb-4c9b-86db-b0a7a707458a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OUz589nzRma9UFaQZUg2sw, audit_chain_id=['OUz589nzRma9UFaQZUg2sw']) at 0x7fe09e1060a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:25.039497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ed865-6ffb-4c9b-86db-b0a7a707458a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:25.039787 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ed865-6ffb-4c9b-86db-b0a7a707458a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:25.040073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ed865-6ffb-4c9b-86db-b0a7a707458a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:25.049445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ed865-6ffb-4c9b-86db-b0a7a707458a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:25.051426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ed865-6ffb-4c9b-86db-b0a7a707458a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:25.065061 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-ad8ed865-6ffb-4c9b-86db-b0a7a707458a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:25.066183 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 276/552] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:25.072379 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c07dbd-9558-48e9-b650-e94faad34bb8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:25.082014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c07dbd-9558-48e9-b650-e94faad34bb8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:25.086174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122a889-d64b-42d5-9a80-983de186e53b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OUz589nzRma9UFaQZUg2sw, audit_chain_id=['OUz589nzRma9UFaQZUg2sw']) at 0x7fe09e14a130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:25.086763 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122a889-d64b-42d5-9a80-983de186e53b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:25.087052 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122a889-d64b-42d5-9a80-983de186e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:25.087367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122a889-d64b-42d5-9a80-983de186e53b admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:25.088109 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122a889-d64b-42d5-9a80-983de186e53b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:25.088413 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122a889-d64b-42d5-9a80-983de186e53b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:25.090868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122a889-d64b-42d5-9a80-983de186e53b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:25.104207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 277/553] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:25.110928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ed865-6ffb-4c9b-86db-b0a7a707458a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:25.120393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ed865-6ffb-4c9b-86db-b0a7a707458a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:25.124485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058711a9-647a-4183-b0d4-5584d93f7455 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OUz589nzRma9UFaQZUg2sw, audit_chain_id=['OUz589nzRma9UFaQZUg2sw']) at 0x7fe09e106100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:25.125275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058711a9-647a-4183-b0d4-5584d93f7455 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:25.125558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058711a9-647a-4183-b0d4-5584d93f7455 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:25.125834 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058711a9-647a-4183-b0d4-5584d93f7455 admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/e956656659004428b3aaf23ae962f001/roles/9a37fbff179849e58437f2fad75ce546` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:25.146135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058711a9-647a-4183-b0d4-5584d93f7455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=e956656659004428b3aaf23ae962f001, role_id=9a37fbff179849e58437f2fad75ce546)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:25.148915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058711a9-647a-4183-b0d4-5584d93f7455 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:25.206632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 277/554] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:37:25 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/e956656659004428b3aaf23ae962f001/roles/9a37fbff179849e58437f2fad75ce546 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:37:27.327508 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721e914-6929-4cd2-b870-e61cfd7ce0b5 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.328063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721e914-6929-4cd2-b870-e61cfd7ce0b5 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.328063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721e914-6929-4cd2-b870-e61cfd7ce0b5 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.329651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 278/555] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:27.335173 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb7fc-f145-4207-8927-e5d8bf3e28ce None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.335600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb7fc-f145-4207-8927-e5d8bf3e28ce None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.335748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb7fc-f145-4207-8927-e5d8bf3e28ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.358103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-143bb7fc-f145-4207-8927-e5d8bf3e28ce None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:27.359290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-143bb7fc-f145-4207-8927-e5d8bf3e28ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:27.425169 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 278/556] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:27 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:27.448574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721e914-6929-4cd2-b870-e61cfd7ce0b5 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.460425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721e914-6929-4cd2-b870-e61cfd7ce0b5 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.464488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6db750-b9a2-4ef9-ad3c-4cfa02bb36b6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e2727c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.465233 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6db750-b9a2-4ef9-ad3c-4cfa02bb36b6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.465519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6db750-b9a2-4ef9-ad3c-4cfa02bb36b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.465830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6db750-b9a2-4ef9-ad3c-4cfa02bb36b6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.477340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6db750-b9a2-4ef9-ad3c-4cfa02bb36b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:27.484146 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-dc6db750-b9a2-4ef9-ad3c-4cfa02bb36b6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:37:27.485222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 279/557] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:27.491461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bb7fc-f145-4207-8927-e5d8bf3e28ce None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.500740 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bb7fc-f145-4207-8927-e5d8bf3e28ce None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.504895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abe080-e718-4d42-90da-78539546d16a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e705b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.505490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abe080-e718-4d42-90da-78539546d16a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.505783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abe080-e718-4d42-90da-78539546d16a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.506065 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abe080-e718-4d42-90da-78539546d16a admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.506778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abe080-e718-4d42-90da-78539546d16a admin admin] RBAC: Adding query filter params (name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:27.507081 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abe080-e718-4d42-90da-78539546d16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:27.508715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abe080-e718-4d42-90da-78539546d16a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:27.517283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 279/558] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:27.522652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6db750-b9a2-4ef9-ad3c-4cfa02bb36b6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.532376 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6db750-b9a2-4ef9-ad3c-4cfa02bb36b6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.536913 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea783-420e-4476-bb03-82f01c8b8bc6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e1b8610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.537309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea783-420e-4476-bb03-82f01c8b8bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.537592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea783-420e-4476-bb03-82f01c8b8bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.537869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea783-420e-4476-bb03-82f01c8b8bc6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.549653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ea783-420e-4476-bb03-82f01c8b8bc6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:27.551490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ea783-420e-4476-bb03-82f01c8b8bc6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:27.569137 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-bf2ea783-420e-4476-bb03-82f01c8b8bc6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:27.570181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 280/559] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:27.575881 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abe080-e718-4d42-90da-78539546d16a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.585226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abe080-e718-4d42-90da-78539546d16a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.589627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35c2dc-0593-4317-8fdf-32b64d6a9e46 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e705e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.590208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35c2dc-0593-4317-8fdf-32b64d6a9e46 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.590501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35c2dc-0593-4317-8fdf-32b64d6a9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.590786 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35c2dc-0593-4317-8fdf-32b64d6a9e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.591515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35c2dc-0593-4317-8fdf-32b64d6a9e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:27.591819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35c2dc-0593-4317-8fdf-32b64d6a9e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:27.593676 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35c2dc-0593-4317-8fdf-32b64d6a9e46 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:27.606868 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 280/560] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:27.612471 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea783-420e-4476-bb03-82f01c8b8bc6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.635532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea783-420e-4476-bb03-82f01c8b8bc6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.642288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e186c-f9d5-44bc-8b97-fd36416e863a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e17f610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.643017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e186c-f9d5-44bc-8b97-fd36416e863a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.643334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e186c-f9d5-44bc-8b97-fd36416e863a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.643622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e186c-f9d5-44bc-8b97-fd36416e863a admin admin] PATH_INFO: `/v3/users/glance` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.657322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e186c-f9d5-44bc-8b97-fd36416e863a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:27.659348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e186c-f9d5-44bc-8b97-fd36416e863a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:27.677734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-da7e186c-f9d5-44bc-8b97-fd36416e863a admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 18:37:27.678797 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 281/561] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:27.685689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35c2dc-0593-4317-8fdf-32b64d6a9e46 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.694934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35c2dc-0593-4317-8fdf-32b64d6a9e46 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.699051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ab599-b4c0-4443-ab90-577141eddcc0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e4efd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.699669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab599-b4c0-4443-ab90-577141eddcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.699954 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab599-b4c0-4443-ab90-577141eddcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.700231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab599-b4c0-4443-ab90-577141eddcc0 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.701002 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ab599-b4c0-4443-ab90-577141eddcc0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:27.701302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ab599-b4c0-4443-ab90-577141eddcc0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:27.703128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ab599-b4c0-4443-ab90-577141eddcc0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:27.731379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 281/562] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:27.736931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e186c-f9d5-44bc-8b97-fd36416e863a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.746898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e186c-f9d5-44bc-8b97-fd36416e863a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.751000 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f443a9-dafe-4ffc-819d-96cc10c2e939 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e17fa00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.751604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f443a9-dafe-4ffc-819d-96cc10c2e939 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.751890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f443a9-dafe-4ffc-819d-96cc10c2e939 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.752169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f443a9-dafe-4ffc-819d-96cc10c2e939 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.759736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f443a9-dafe-4ffc-819d-96cc10c2e939 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:27.761462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f443a9-dafe-4ffc-819d-96cc10c2e939 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:27.769752 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 282/563] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:37:27.775538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ab599-b4c0-4443-ab90-577141eddcc0 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.787605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ab599-b4c0-4443-ab90-577141eddcc0 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.794889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf44b3e-0b5c-4e15-8bbd-4aeb8e1aa372 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e1a1a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.795661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf44b3e-0b5c-4e15-8bbd-4aeb8e1aa372 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.795957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf44b3e-0b5c-4e15-8bbd-4aeb8e1aa372 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.796240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf44b3e-0b5c-4e15-8bbd-4aeb8e1aa372 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.814331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf44b3e-0b5c-4e15-8bbd-4aeb8e1aa372 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:27.816271 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf44b3e-0b5c-4e15-8bbd-4aeb8e1aa372 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:27.833118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-caf44b3e-0b5c-4e15-8bbd-4aeb8e1aa372 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:27.834215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 282/564] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:27.840591 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f443a9-dafe-4ffc-819d-96cc10c2e939 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.851306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f443a9-dafe-4ffc-819d-96cc10c2e939 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.856311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a400449-4d4a-4384-af88-751984fdac49 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e188070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.856893 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a400449-4d4a-4384-af88-751984fdac49 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.857181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a400449-4d4a-4384-af88-751984fdac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.857466 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a400449-4d4a-4384-af88-751984fdac49 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.858145 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a400449-4d4a-4384-af88-751984fdac49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:27.858446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a400449-4d4a-4384-af88-751984fdac49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:27.860057 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a400449-4d4a-4384-af88-751984fdac49 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:27.872883 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 283/565] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:27.878323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf44b3e-0b5c-4e15-8bbd-4aeb8e1aa372 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.887784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf44b3e-0b5c-4e15-8bbd-4aeb8e1aa372 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.892226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0d2ef-4a6c-4850-a21f-a4720a03d3c5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e15e940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.892935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d2ef-4a6c-4850-a21f-a4720a03d3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.893221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d2ef-4a6c-4850-a21f-a4720a03d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.893500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d2ef-4a6c-4850-a21f-a4720a03d3c5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.902457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0d2ef-4a6c-4850-a21f-a4720a03d3c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:27.904455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0d2ef-4a6c-4850-a21f-a4720a03d3c5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:27.918848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-f2c0d2ef-4a6c-4850-a21f-a4720a03d3c5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:27.920013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 283/566] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:27.925728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a400449-4d4a-4384-af88-751984fdac49 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.935734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a400449-4d4a-4384-af88-751984fdac49 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.941547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7df4e-e045-4a2c-a09f-bae7a7c3d8e1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e3e7af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.942208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7df4e-e045-4a2c-a09f-bae7a7c3d8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.942584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7df4e-e045-4a2c-a09f-bae7a7c3d8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.942926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7df4e-e045-4a2c-a09f-bae7a7c3d8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.943779 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7df4e-e045-4a2c-a09f-bae7a7c3d8e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:27.944166 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7df4e-e045-4a2c-a09f-bae7a7c3d8e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:27.946059 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7df4e-e045-4a2c-a09f-bae7a7c3d8e1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:27.959608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 284/567] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:27.966144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0d2ef-4a6c-4850-a21f-a4720a03d3c5 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:27.975654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0d2ef-4a6c-4850-a21f-a4720a03d3c5 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:27.980386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61429f-3279-4730-873b-74f60a4aca1f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AdqxHd0CQMmyHAwOX5kogg, audit_chain_id=['AdqxHd0CQMmyHAwOX5kogg']) at 0x7fe09e1556a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:27.980957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61429f-3279-4730-873b-74f60a4aca1f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:27.981243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61429f-3279-4730-873b-74f60a4aca1f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:27.981522 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61429f-3279-4730-873b-74f60a4aca1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:27.982309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61429f-3279-4730-873b-74f60a4aca1f admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=e956656659004428b3aaf23ae962f001) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:27.982611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61429f-3279-4730-873b-74f60a4aca1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:27.984440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61429f-3279-4730-873b-74f60a4aca1f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:27.990244 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 284/568] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:37:27 2022] GET /identity/v3/role_assignments?user.id=e956656659004428b3aaf23ae962f001&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:30.169193 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965b3c-b75b-4600-9c41-91038781ccef None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:30.169719 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965b3c-b75b-4600-9c41-91038781ccef None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:30.169842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965b3c-b75b-4600-9c41-91038781ccef None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:30.171484 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 285/569] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:30.176935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89655e00-1f86-4a36-bbcf-4e09bd7e9ecf None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:30.177326 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89655e00-1f86-4a36-bbcf-4e09bd7e9ecf None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:30.177500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89655e00-1f86-4a36-bbcf-4e09bd7e9ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:30.199487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-89655e00-1f86-4a36-bbcf-4e09bd7e9ecf None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:30.200648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-89655e00-1f86-4a36-bbcf-4e09bd7e9ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:30.207508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 285/570] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:30 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:30.232476 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b965b3c-b75b-4600-9c41-91038781ccef None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:30.244475 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b965b3c-b75b-4600-9c41-91038781ccef None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:30.249161 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a9b63-9c1c-406c-9d71-92a66bbf5699 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8-Oa-nncSIuAaJVexTVgbQ, audit_chain_id=['8-Oa-nncSIuAaJVexTVgbQ']) at 0x7fe09e439ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:30.249877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a9b63-9c1c-406c-9d71-92a66bbf5699 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:30.250172 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a9b63-9c1c-406c-9d71-92a66bbf5699 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:30.250458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a9b63-9c1c-406c-9d71-92a66bbf5699 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:30.262410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a9b63-9c1c-406c-9d71-92a66bbf5699 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:30.264292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a9b63-9c1c-406c-9d71-92a66bbf5699 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:30.281556 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-ae6a9b63-9c1c-406c-9d71-92a66bbf5699 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:30.282634 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 286/571] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:30.288720 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89655e00-1f86-4a36-bbcf-4e09bd7e9ecf None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:30.297874 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89655e00-1f86-4a36-bbcf-4e09bd7e9ecf None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:30.304128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb954ccb-4691-45ea-b6f2-8a4afd84ee0c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8-Oa-nncSIuAaJVexTVgbQ, audit_chain_id=['8-Oa-nncSIuAaJVexTVgbQ']) at 0x7fe09e4441c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:30.304128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb954ccb-4691-45ea-b6f2-8a4afd84ee0c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:30.304128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb954ccb-4691-45ea-b6f2-8a4afd84ee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:30.304128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb954ccb-4691-45ea-b6f2-8a4afd84ee0c admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:30.304530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb954ccb-4691-45ea-b6f2-8a4afd84ee0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:30.304530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb954ccb-4691-45ea-b6f2-8a4afd84ee0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:30.305699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb954ccb-4691-45ea-b6f2-8a4afd84ee0c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:30.318702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 286/572] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:30.324335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a9b63-9c1c-406c-9d71-92a66bbf5699 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:30.335418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a9b63-9c1c-406c-9d71-92a66bbf5699 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:30.340227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367422c-88c2-4194-81e9-8a32861192c4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8-Oa-nncSIuAaJVexTVgbQ, audit_chain_id=['8-Oa-nncSIuAaJVexTVgbQ']) at 0x7fe09e1b0d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:30.340821 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367422c-88c2-4194-81e9-8a32861192c4 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:30.341103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367422c-88c2-4194-81e9-8a32861192c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:30.341378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367422c-88c2-4194-81e9-8a32861192c4 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:30.342292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367422c-88c2-4194-81e9-8a32861192c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:30.344301 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367422c-88c2-4194-81e9-8a32861192c4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:30.446479 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 287/573] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:37:30 2022] POST /identity/v3/users => generated 254 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:37:32.596696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e67af-beed-4802-ad25-43c62c6f36ef None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:32.597270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e67af-beed-4802-ad25-43c62c6f36ef None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:32.597270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e67af-beed-4802-ad25-43c62c6f36ef None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:32.598976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 287/574] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:32.604454 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc55695-f901-445a-8685-fa682e4bc88c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:32.604930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc55695-f901-445a-8685-fa682e4bc88c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:32.605021 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc55695-f901-445a-8685-fa682e4bc88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:32.629777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-6cc55695-f901-445a-8685-fa682e4bc88c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:32.630935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-6cc55695-f901-445a-8685-fa682e4bc88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:32.638550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 288/575] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:32 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:32.662614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e67af-beed-4802-ad25-43c62c6f36ef None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:32.674395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e67af-beed-4802-ad25-43c62c6f36ef None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:32.678313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe74a98-3b1b-4fab-a59f-438d0d62f79a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09e25be50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:32.679033 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe74a98-3b1b-4fab-a59f-438d0d62f79a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:32.679347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe74a98-3b1b-4fab-a59f-438d0d62f79a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:32.679629 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe74a98-3b1b-4fab-a59f-438d0d62f79a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:32.690954 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe74a98-3b1b-4fab-a59f-438d0d62f79a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:32.697516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-4fe74a98-3b1b-4fab-a59f-438d0d62f79a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:37:32.699193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 288/576] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:37:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:32.705562 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc55695-f901-445a-8685-fa682e4bc88c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:32.714992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc55695-f901-445a-8685-fa682e4bc88c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:32.719473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2bd02-1108-4d02-9364-9a615b29b06c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09e3e7250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:32.720113 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2bd02-1108-4d02-9364-9a615b29b06c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:32.720620 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2bd02-1108-4d02-9364-9a615b29b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:32.720719 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2bd02-1108-4d02-9364-9a615b29b06c admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:32.721461 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2bd02-1108-4d02-9364-9a615b29b06c admin admin] RBAC: Adding query filter params (name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:32.721801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2bd02-1108-4d02-9364-9a615b29b06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:32.723466 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2bd02-1108-4d02-9364-9a615b29b06c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:32.732188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 289/577] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:37:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:32.737775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe74a98-3b1b-4fab-a59f-438d0d62f79a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:32.747921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe74a98-3b1b-4fab-a59f-438d0d62f79a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:32.752016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804b8c5-84c4-44d0-96be-2bd126395013 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09e14a220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:32.752725 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804b8c5-84c4-44d0-96be-2bd126395013 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:32.753013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804b8c5-84c4-44d0-96be-2bd126395013 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:32.753290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804b8c5-84c4-44d0-96be-2bd126395013 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:32.765099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804b8c5-84c4-44d0-96be-2bd126395013 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:32.766902 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804b8c5-84c4-44d0-96be-2bd126395013 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:32.784618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-7804b8c5-84c4-44d0-96be-2bd126395013 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:32.785729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 289/578] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:32.791419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2bd02-1108-4d02-9364-9a615b29b06c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:32.801661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2bd02-1108-4d02-9364-9a615b29b06c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:32.807281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bded7-344f-40e8-9033-1768d6018e0f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09eb9f7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:32.808514 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bded7-344f-40e8-9033-1768d6018e0f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:32.808844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bded7-344f-40e8-9033-1768d6018e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:32.809171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bded7-344f-40e8-9033-1768d6018e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:32.809912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bded7-344f-40e8-9033-1768d6018e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:32.810263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bded7-344f-40e8-9033-1768d6018e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:32.811936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bded7-344f-40e8-9033-1768d6018e0f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:32.826163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 290/579] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:32.831733 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804b8c5-84c4-44d0-96be-2bd126395013 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:32.841792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804b8c5-84c4-44d0-96be-2bd126395013 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:32.846204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15425d-cb74-4717-94e8-1100f65bde42 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09e269cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:32.846980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15425d-cb74-4717-94e8-1100f65bde42 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:32.847248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15425d-cb74-4717-94e8-1100f65bde42 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:32.847526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15425d-cb74-4717-94e8-1100f65bde42 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:32.860172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15425d-cb74-4717-94e8-1100f65bde42 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:32.862145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15425d-cb74-4717-94e8-1100f65bde42 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:32.880255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-1d15425d-cb74-4717-94e8-1100f65bde42 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:37:32.881342 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 290/580] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Feb 28 18:37:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:32.887663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bded7-344f-40e8-9033-1768d6018e0f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:32.897097 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bded7-344f-40e8-9033-1768d6018e0f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:32.902000 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15487b-4484-49df-a9b3-fc204e2338e7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09e3f3580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:32.902611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15487b-4484-49df-a9b3-fc204e2338e7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:32.902895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15487b-4484-49df-a9b3-fc204e2338e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:32.903202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15487b-4484-49df-a9b3-fc204e2338e7 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:32.903984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15487b-4484-49df-a9b3-fc204e2338e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:32.904283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15487b-4484-49df-a9b3-fc204e2338e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:32.906098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15487b-4484-49df-a9b3-fc204e2338e7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:32.934355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 291/581] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Feb 28 18:37:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:32.939932 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15425d-cb74-4717-94e8-1100f65bde42 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:32.949968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15425d-cb74-4717-94e8-1100f65bde42 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:32.954102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3673ff4-dd2a-4083-ba64-cc58f5e28c9b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09e1ae4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:32.954681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673ff4-dd2a-4083-ba64-cc58f5e28c9b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:32.954967 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673ff4-dd2a-4083-ba64-cc58f5e28c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:32.955282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673ff4-dd2a-4083-ba64-cc58f5e28c9b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:32.963035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3673ff4-dd2a-4083-ba64-cc58f5e28c9b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:32.965394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3673ff4-dd2a-4083-ba64-cc58f5e28c9b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:32.974029 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 291/582] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:37:32 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:37:32.979621 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15487b-4484-49df-a9b3-fc204e2338e7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:32.988937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15487b-4484-49df-a9b3-fc204e2338e7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:32.993381 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e975-27b8-4485-875d-d96a4eea2402 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09e716460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:32.994091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e975-27b8-4485-875d-d96a4eea2402 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:32.994374 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e975-27b8-4485-875d-d96a4eea2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:32.994651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e975-27b8-4485-875d-d96a4eea2402 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:33.006797 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3e975-27b8-4485-875d-d96a4eea2402 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:33.008629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3e975-27b8-4485-875d-d96a4eea2402 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:33.025951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-74b3e975-27b8-4485-875d-d96a4eea2402 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:33.027293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 292/583] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:33.033020 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3673ff4-dd2a-4083-ba64-cc58f5e28c9b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:33.041782 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3673ff4-dd2a-4083-ba64-cc58f5e28c9b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:33.046065 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece45c12-34e9-4751-bd53-58bcbc000fad admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09e14abb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:33.046665 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece45c12-34e9-4751-bd53-58bcbc000fad admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:33.046956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece45c12-34e9-4751-bd53-58bcbc000fad admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:33.047270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece45c12-34e9-4751-bd53-58bcbc000fad admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:33.047971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece45c12-34e9-4751-bd53-58bcbc000fad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:33.048306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece45c12-34e9-4751-bd53-58bcbc000fad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:33.049901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece45c12-34e9-4751-bd53-58bcbc000fad admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:33.063481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 292/584] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:33.069085 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e975-27b8-4485-875d-d96a4eea2402 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:33.079323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e975-27b8-4485-875d-d96a4eea2402 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:33.083515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2071cbd-6ae0-4d19-999d-62f53f2ff46a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09e14aa60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:33.084222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2071cbd-6ae0-4d19-999d-62f53f2ff46a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:33.084509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2071cbd-6ae0-4d19-999d-62f53f2ff46a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:33.084791 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2071cbd-6ae0-4d19-999d-62f53f2ff46a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:33.093474 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2071cbd-6ae0-4d19-999d-62f53f2ff46a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:33.095448 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2071cbd-6ae0-4d19-999d-62f53f2ff46a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:33.108722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-b2071cbd-6ae0-4d19-999d-62f53f2ff46a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:33.109718 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 293/585] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:33.115607 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece45c12-34e9-4751-bd53-58bcbc000fad admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:33.126472 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece45c12-34e9-4751-bd53-58bcbc000fad admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:33.130694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58460188-d6a9-45ab-a913-5fac06c71d78 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09e196c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:33.131333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460188-d6a9-45ab-a913-5fac06c71d78 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:33.131628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460188-d6a9-45ab-a913-5fac06c71d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:33.131913 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460188-d6a9-45ab-a913-5fac06c71d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:33.132664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58460188-d6a9-45ab-a913-5fac06c71d78 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:33.132969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58460188-d6a9-45ab-a913-5fac06c71d78 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:33.134810 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58460188-d6a9-45ab-a913-5fac06c71d78 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:33.149153 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 293/586] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:33.156038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2071cbd-6ae0-4d19-999d-62f53f2ff46a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:33.165687 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2071cbd-6ae0-4d19-999d-62f53f2ff46a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:33.170300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a37c9d-70f5-4df4-88e1-0973f7548d92 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eiIWwk5hQSWsGbZPIkCiEQ, audit_chain_id=['eiIWwk5hQSWsGbZPIkCiEQ']) at 0x7fe09e1ccd90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:33.170872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a37c9d-70f5-4df4-88e1-0973f7548d92 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:33.171183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a37c9d-70f5-4df4-88e1-0973f7548d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:33.171464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a37c9d-70f5-4df4-88e1-0973f7548d92 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:33.172240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a37c9d-70f5-4df4-88e1-0973f7548d92 admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=94bc9c43b3bc4eb4bcd1d0c997340376) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:33.172538 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a37c9d-70f5-4df4-88e1-0973f7548d92 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:33.174357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a37c9d-70f5-4df4-88e1-0973f7548d92 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:33.179681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 294/587] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:37:33 2022] GET /identity/v3/role_assignments?user.id=94bc9c43b3bc4eb4bcd1d0c997340376&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:35.287304 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9126c-7485-4274-a77a-76b42f0f5a0c None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.287804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9126c-7485-4274-a77a-76b42f0f5a0c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.287804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9126c-7485-4274-a77a-76b42f0f5a0c None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.289468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 294/588] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:35.295334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725905d-afba-4233-abc9-55169410db41 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.295759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725905d-afba-4233-abc9-55169410db41 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.295915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725905d-afba-4233-abc9-55169410db41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.318334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-9725905d-afba-4233-abc9-55169410db41 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:35.319528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9725905d-afba-4233-abc9-55169410db41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:35.326938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 295/589] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:35 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:35.350475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9126c-7485-4274-a77a-76b42f0f5a0c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:35.364155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9126c-7485-4274-a77a-76b42f0f5a0c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:35.368170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a1694-02fa-4426-aab2-6849014b7d56 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Cuuy8c4ARjOZqUrfUKnt1A, audit_chain_id=['Cuuy8c4ARjOZqUrfUKnt1A']) at 0x7fe09e150c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:35.368897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a1694-02fa-4426-aab2-6849014b7d56 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.369200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a1694-02fa-4426-aab2-6849014b7d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.369494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a1694-02fa-4426-aab2-6849014b7d56 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.381438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a1694-02fa-4426-aab2-6849014b7d56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:35.388231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-be8a1694-02fa-4426-aab2-6849014b7d56 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:37:35.389359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 295/590] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:37:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:35.395317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725905d-afba-4233-abc9-55169410db41 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:35.404499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725905d-afba-4233-abc9-55169410db41 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:35.408675 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048ab8a-5117-48d5-9f2c-8635eeaf0ced admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Cuuy8c4ARjOZqUrfUKnt1A, audit_chain_id=['Cuuy8c4ARjOZqUrfUKnt1A']) at 0x7fe09e1fbd00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:35.409267 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ab8a-5117-48d5-9f2c-8635eeaf0ced admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.409550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ab8a-5117-48d5-9f2c-8635eeaf0ced admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.409829 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ab8a-5117-48d5-9f2c-8635eeaf0ced admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.410538 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048ab8a-5117-48d5-9f2c-8635eeaf0ced admin admin] RBAC: Adding query filter params (name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:35.410834 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048ab8a-5117-48d5-9f2c-8635eeaf0ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:35.412446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048ab8a-5117-48d5-9f2c-8635eeaf0ced admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:35.421521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 296/591] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:37:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:35.427099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a1694-02fa-4426-aab2-6849014b7d56 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:35.437197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a1694-02fa-4426-aab2-6849014b7d56 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:35.441400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac7ae5-a284-4cc5-bc3d-a6cc41050fae admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Cuuy8c4ARjOZqUrfUKnt1A, audit_chain_id=['Cuuy8c4ARjOZqUrfUKnt1A']) at 0x7fe09e1c0850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:35.442110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac7ae5-a284-4cc5-bc3d-a6cc41050fae admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.442401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac7ae5-a284-4cc5-bc3d-a6cc41050fae admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.442682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac7ae5-a284-4cc5-bc3d-a6cc41050fae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.453987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac7ae5-a284-4cc5-bc3d-a6cc41050fae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:35.455837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac7ae5-a284-4cc5-bc3d-a6cc41050fae admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:35.473610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-c8ac7ae5-a284-4cc5-bc3d-a6cc41050fae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:35.475002 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 296/592] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:35.481458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048ab8a-5117-48d5-9f2c-8635eeaf0ced admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:35.490833 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048ab8a-5117-48d5-9f2c-8635eeaf0ced admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:35.495200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9739a3-32f7-40b3-ae57-654cd5bdce44 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Cuuy8c4ARjOZqUrfUKnt1A, audit_chain_id=['Cuuy8c4ARjOZqUrfUKnt1A']) at 0x7fe09e14a6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:35.495834 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9739a3-32f7-40b3-ae57-654cd5bdce44 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.496121 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9739a3-32f7-40b3-ae57-654cd5bdce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.496397 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9739a3-32f7-40b3-ae57-654cd5bdce44 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.497075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9739a3-32f7-40b3-ae57-654cd5bdce44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:35.497375 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9739a3-32f7-40b3-ae57-654cd5bdce44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:35.498934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9739a3-32f7-40b3-ae57-654cd5bdce44 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:35.511067 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 297/593] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:35.516471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac7ae5-a284-4cc5-bc3d-a6cc41050fae admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:35.527101 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac7ae5-a284-4cc5-bc3d-a6cc41050fae admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:35.531360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07981b1-d485-44ff-b8fe-7610cd14d1f5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Cuuy8c4ARjOZqUrfUKnt1A, audit_chain_id=['Cuuy8c4ARjOZqUrfUKnt1A']) at 0x7fe09e14eb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:35.532093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07981b1-d485-44ff-b8fe-7610cd14d1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.532387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07981b1-d485-44ff-b8fe-7610cd14d1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.532672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07981b1-d485-44ff-b8fe-7610cd14d1f5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.546125 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07981b1-d485-44ff-b8fe-7610cd14d1f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:35.548121 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07981b1-d485-44ff-b8fe-7610cd14d1f5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:35.567070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-c07981b1-d485-44ff-b8fe-7610cd14d1f5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:37:35.568184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 297/594] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Feb 28 18:37:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:35.574400 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9739a3-32f7-40b3-ae57-654cd5bdce44 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:35.583975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9739a3-32f7-40b3-ae57-654cd5bdce44 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:35.588842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a3c19-1954-4d94-b1ef-c8be42b91803 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Cuuy8c4ARjOZqUrfUKnt1A, audit_chain_id=['Cuuy8c4ARjOZqUrfUKnt1A']) at 0x7fe09e3d1c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:35.589435 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3c19-1954-4d94-b1ef-c8be42b91803 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.589720 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3c19-1954-4d94-b1ef-c8be42b91803 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.590019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3c19-1954-4d94-b1ef-c8be42b91803 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.590785 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a3c19-1954-4d94-b1ef-c8be42b91803 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:35.591084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a3c19-1954-4d94-b1ef-c8be42b91803 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:35.593194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a3c19-1954-4d94-b1ef-c8be42b91803 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:35.622858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 298/595] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Feb 28 18:37:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:35.628873 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07981b1-d485-44ff-b8fe-7610cd14d1f5 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:35.641293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07981b1-d485-44ff-b8fe-7610cd14d1f5 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:35.645439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf96e9e-6327-4d13-a5a7-9d277affc603 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Cuuy8c4ARjOZqUrfUKnt1A, audit_chain_id=['Cuuy8c4ARjOZqUrfUKnt1A']) at 0x7fe09e105820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:35.646146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf96e9e-6327-4d13-a5a7-9d277affc603 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.646434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf96e9e-6327-4d13-a5a7-9d277affc603 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.646713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf96e9e-6327-4d13-a5a7-9d277affc603 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.659627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf96e9e-6327-4d13-a5a7-9d277affc603 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:35.661449 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf96e9e-6327-4d13-a5a7-9d277affc603 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:35.678946 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-2bf96e9e-6327-4d13-a5a7-9d277affc603 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:35.680066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 298/596] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:37:35.686580 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a3c19-1954-4d94-b1ef-c8be42b91803 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:35.695978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a3c19-1954-4d94-b1ef-c8be42b91803 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:35.700973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43fefc-5cb7-4c29-91ee-c1374473d771 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Cuuy8c4ARjOZqUrfUKnt1A, audit_chain_id=['Cuuy8c4ARjOZqUrfUKnt1A']) at 0x7fe09e3f3340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:35.701558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43fefc-5cb7-4c29-91ee-c1374473d771 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.701849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43fefc-5cb7-4c29-91ee-c1374473d771 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.702133 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43fefc-5cb7-4c29-91ee-c1374473d771 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.702816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43fefc-5cb7-4c29-91ee-c1374473d771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:35.703153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43fefc-5cb7-4c29-91ee-c1374473d771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:35.704736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43fefc-5cb7-4c29-91ee-c1374473d771 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:35.719069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 299/597] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:35.724518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf96e9e-6327-4d13-a5a7-9d277affc603 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:35.734191 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf96e9e-6327-4d13-a5a7-9d277affc603 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:35.738218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476cd4f-9683-443d-9272-d572630dad65 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Cuuy8c4ARjOZqUrfUKnt1A, audit_chain_id=['Cuuy8c4ARjOZqUrfUKnt1A']) at 0x7fe09e1a13a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:35.738931 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476cd4f-9683-443d-9272-d572630dad65 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.739251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476cd4f-9683-443d-9272-d572630dad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.739531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476cd4f-9683-443d-9272-d572630dad65 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.749140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476cd4f-9683-443d-9272-d572630dad65 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:35.751098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476cd4f-9683-443d-9272-d572630dad65 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:35.764438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-b476cd4f-9683-443d-9272-d572630dad65 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:35.765502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 299/598] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:35.771222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43fefc-5cb7-4c29-91ee-c1374473d771 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:35.781040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43fefc-5cb7-4c29-91ee-c1374473d771 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:35.785219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d686ae-16d0-4bff-a532-aff94c7259c8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Cuuy8c4ARjOZqUrfUKnt1A, audit_chain_id=['Cuuy8c4ARjOZqUrfUKnt1A']) at 0x7fe09e1ccc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:35.785799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d686ae-16d0-4bff-a532-aff94c7259c8 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.786086 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d686ae-16d0-4bff-a532-aff94c7259c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.786367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d686ae-16d0-4bff-a532-aff94c7259c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.787105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d686ae-16d0-4bff-a532-aff94c7259c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:35.787437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d686ae-16d0-4bff-a532-aff94c7259c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:35.789290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d686ae-16d0-4bff-a532-aff94c7259c8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:35.802602 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 300/599] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:35.808994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476cd4f-9683-443d-9272-d572630dad65 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:35.818660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476cd4f-9683-443d-9272-d572630dad65 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:35.822733 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885dd52-eaa2-4011-aaa4-36e75b8e1329 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Cuuy8c4ARjOZqUrfUKnt1A, audit_chain_id=['Cuuy8c4ARjOZqUrfUKnt1A']) at 0x7fe09e105850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:35.825620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885dd52-eaa2-4011-aaa4-36e75b8e1329 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:35.825620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885dd52-eaa2-4011-aaa4-36e75b8e1329 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:35.825620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885dd52-eaa2-4011-aaa4-36e75b8e1329 admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/94bc9c43b3bc4eb4bcd1d0c997340376/roles/9a37fbff179849e58437f2fad75ce546` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:35.844439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885dd52-eaa2-4011-aaa4-36e75b8e1329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=94bc9c43b3bc4eb4bcd1d0c997340376, role_id=9a37fbff179849e58437f2fad75ce546)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:35.847066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885dd52-eaa2-4011-aaa4-36e75b8e1329 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:35.953666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 300/600] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:37:35 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/94bc9c43b3bc4eb4bcd1d0c997340376/roles/9a37fbff179849e58437f2fad75ce546 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:37:38.074611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54484e6c-7fe9-439d-b45c-fe3a90f8acbe None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.075280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54484e6c-7fe9-439d-b45c-fe3a90f8acbe None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.075280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54484e6c-7fe9-439d-b45c-fe3a90f8acbe None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.078198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 301/601] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:38.083826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e77c-cd85-4b7e-b9a9-911658d6b7ac None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.084267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e77c-cd85-4b7e-b9a9-911658d6b7ac None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.084399 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e77c-cd85-4b7e-b9a9-911658d6b7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.108331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3312e77c-cd85-4b7e-b9a9-911658d6b7ac None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:38.109496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3312e77c-cd85-4b7e-b9a9-911658d6b7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:38.177447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 301/602] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:38 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:37:38.202617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54484e6c-7fe9-439d-b45c-fe3a90f8acbe None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.215922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54484e6c-7fe9-439d-b45c-fe3a90f8acbe None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.220254 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af7c32-c3d3-4bb5-8fb9-396b013a0709 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e17fc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.220969 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af7c32-c3d3-4bb5-8fb9-396b013a0709 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.221261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af7c32-c3d3-4bb5-8fb9-396b013a0709 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.221555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af7c32-c3d3-4bb5-8fb9-396b013a0709 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.233495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af7c32-c3d3-4bb5-8fb9-396b013a0709 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:38.239857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-73af7c32-c3d3-4bb5-8fb9-396b013a0709 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:37:38.240972 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 302/603] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:38.249548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312e77c-cd85-4b7e-b9a9-911658d6b7ac None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.258312 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312e77c-cd85-4b7e-b9a9-911658d6b7ac None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.263359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91100261-1e2e-4a3f-8dca-8458225e15b8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e4e0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.263971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91100261-1e2e-4a3f-8dca-8458225e15b8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.264256 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91100261-1e2e-4a3f-8dca-8458225e15b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.264537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91100261-1e2e-4a3f-8dca-8458225e15b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.265260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91100261-1e2e-4a3f-8dca-8458225e15b8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:38.265562 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91100261-1e2e-4a3f-8dca-8458225e15b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:38.267192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91100261-1e2e-4a3f-8dca-8458225e15b8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:38.276034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 302/604] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:38.281723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af7c32-c3d3-4bb5-8fb9-396b013a0709 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.293551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af7c32-c3d3-4bb5-8fb9-396b013a0709 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.297716 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd572f0f-4d4c-4c01-b265-25763e4207bd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e1432b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.298431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572f0f-4d4c-4c01-b265-25763e4207bd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.298717 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572f0f-4d4c-4c01-b265-25763e4207bd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.298996 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572f0f-4d4c-4c01-b265-25763e4207bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.311691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd572f0f-4d4c-4c01-b265-25763e4207bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:38.313539 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd572f0f-4d4c-4c01-b265-25763e4207bd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:38.331829 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-cd572f0f-4d4c-4c01-b265-25763e4207bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:38.332959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 303/605] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:38.339292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91100261-1e2e-4a3f-8dca-8458225e15b8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.351934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91100261-1e2e-4a3f-8dca-8458225e15b8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.357855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26732c44-817b-42ef-a888-084e7262d8c7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e4f3ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.358464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26732c44-817b-42ef-a888-084e7262d8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.358760 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26732c44-817b-42ef-a888-084e7262d8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.359042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26732c44-817b-42ef-a888-084e7262d8c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.359778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26732c44-817b-42ef-a888-084e7262d8c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:38.360085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26732c44-817b-42ef-a888-084e7262d8c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:38.361683 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26732c44-817b-42ef-a888-084e7262d8c7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:38.378232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 303/606] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:38.384003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd572f0f-4d4c-4c01-b265-25763e4207bd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.394369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd572f0f-4d4c-4c01-b265-25763e4207bd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.398786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e6f5-1776-4fb6-96a8-852eec7a10af admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e2044f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.399555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e6f5-1776-4fb6-96a8-852eec7a10af admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.399840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e6f5-1776-4fb6-96a8-852eec7a10af admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.400119 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e6f5-1776-4fb6-96a8-852eec7a10af admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.413125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261e6f5-1776-4fb6-96a8-852eec7a10af admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:38.415188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261e6f5-1776-4fb6-96a8-852eec7a10af admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:38.434406 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-3261e6f5-1776-4fb6-96a8-852eec7a10af admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:37:38.435560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 304/607] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:38.441306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26732c44-817b-42ef-a888-084e7262d8c7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.452137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26732c44-817b-42ef-a888-084e7262d8c7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.456414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9d1a4-04a7-48d9-8977-ddf553fcfbca admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e183460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.457024 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d1a4-04a7-48d9-8977-ddf553fcfbca admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.457312 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d1a4-04a7-48d9-8977-ddf553fcfbca admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.457592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d1a4-04a7-48d9-8977-ddf553fcfbca admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.458386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9d1a4-04a7-48d9-8977-ddf553fcfbca admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:38.458694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9d1a4-04a7-48d9-8977-ddf553fcfbca admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:38.460563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9d1a4-04a7-48d9-8977-ddf553fcfbca admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:38.490126 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 304/608] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:38.496194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e6f5-1776-4fb6-96a8-852eec7a10af admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.505619 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e6f5-1776-4fb6-96a8-852eec7a10af admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.509697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb0eb6-f3da-4e1e-b412-8ce3770d1235 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e3d5670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.510919 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0eb6-f3da-4e1e-b412-8ce3770d1235 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.511295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0eb6-f3da-4e1e-b412-8ce3770d1235 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.511575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0eb6-f3da-4e1e-b412-8ce3770d1235 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.519180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb0eb6-f3da-4e1e-b412-8ce3770d1235 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:38.520931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb0eb6-f3da-4e1e-b412-8ce3770d1235 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:38.529643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 305/609] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:37:38.535471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9d1a4-04a7-48d9-8977-ddf553fcfbca admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.545179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9d1a4-04a7-48d9-8977-ddf553fcfbca admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.549377 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec57f20-fe2b-4d79-9508-f176345113d7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e183ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.550099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57f20-fe2b-4d79-9508-f176345113d7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.550392 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57f20-fe2b-4d79-9508-f176345113d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.550673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57f20-fe2b-4d79-9508-f176345113d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.563504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec57f20-fe2b-4d79-9508-f176345113d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:38.565347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec57f20-fe2b-4d79-9508-f176345113d7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:38.582708 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-9ec57f20-fe2b-4d79-9508-f176345113d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:38.583848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 305/610] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:38.589796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb0eb6-f3da-4e1e-b412-8ce3770d1235 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.598841 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb0eb6-f3da-4e1e-b412-8ce3770d1235 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.603076 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bc999-c31d-44fe-b1c6-c79de43eba32 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e3f3af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.603738 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc999-c31d-44fe-b1c6-c79de43eba32 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.604539 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc999-c31d-44fe-b1c6-c79de43eba32 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.604942 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc999-c31d-44fe-b1c6-c79de43eba32 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.605789 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bc999-c31d-44fe-b1c6-c79de43eba32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:38.606093 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bc999-c31d-44fe-b1c6-c79de43eba32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:38.607730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bc999-c31d-44fe-b1c6-c79de43eba32 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:38.622549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 306/611] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:38.628233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec57f20-fe2b-4d79-9508-f176345113d7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.638438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec57f20-fe2b-4d79-9508-f176345113d7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.642789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807af40c-4910-4620-b186-a829077692de admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e1051f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.643536 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807af40c-4910-4620-b186-a829077692de admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.643829 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807af40c-4910-4620-b186-a829077692de admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.644111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807af40c-4910-4620-b186-a829077692de admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.653006 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807af40c-4910-4620-b186-a829077692de admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:38.655015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807af40c-4910-4620-b186-a829077692de admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:38.669269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-807af40c-4910-4620-b186-a829077692de admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:38.670349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 306/612] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:38.676276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bc999-c31d-44fe-b1c6-c79de43eba32 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.687040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bc999-c31d-44fe-b1c6-c79de43eba32 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.695354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39570f-3931-4178-9855-743ba0f77699 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e3e49d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.695354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39570f-3931-4178-9855-743ba0f77699 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.695354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39570f-3931-4178-9855-743ba0f77699 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.695354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39570f-3931-4178-9855-743ba0f77699 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.695723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39570f-3931-4178-9855-743ba0f77699 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:38.695723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39570f-3931-4178-9855-743ba0f77699 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:38.695723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39570f-3931-4178-9855-743ba0f77699 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:38.708623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 307/613] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:38.714641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807af40c-4910-4620-b186-a829077692de admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:38.724636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807af40c-4910-4620-b186-a829077692de admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:38.730328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a786a0-1c69-4559-ba61-cba4eb142fb2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vfK-PFZMSKSZPPec57Hxxg, audit_chain_id=['vfK-PFZMSKSZPPec57Hxxg']) at 0x7fe09e4ffa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:38.730328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a786a0-1c69-4559-ba61-cba4eb142fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:38.730537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a786a0-1c69-4559-ba61-cba4eb142fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:38.730792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a786a0-1c69-4559-ba61-cba4eb142fb2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:38.731591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a786a0-1c69-4559-ba61-cba4eb142fb2 admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=94bc9c43b3bc4eb4bcd1d0c997340376) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:38.731896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a786a0-1c69-4559-ba61-cba4eb142fb2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:38.733724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a786a0-1c69-4559-ba61-cba4eb142fb2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:38.739576 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 307/614] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:37:38 2022] GET /identity/v3/role_assignments?user.id=94bc9c43b3bc4eb4bcd1d0c997340376&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:37:40.939700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96e3e9-f2c0-47d7-930c-d7dd6b6b6275 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:40.940222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96e3e9-f2c0-47d7-930c-d7dd6b6b6275 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:40.940335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96e3e9-f2c0-47d7-930c-d7dd6b6b6275 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:40.941921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 308/615] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:40.947055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bb51b-d945-41a3-9d9d-df3b79336b23 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:40.947477 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bb51b-d945-41a3-9d9d-df3b79336b23 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:40.947778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bb51b-d945-41a3-9d9d-df3b79336b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:40.970924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-491bb51b-d945-41a3-9d9d-df3b79336b23 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:40.972168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-491bb51b-d945-41a3-9d9d-df3b79336b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:40.979487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 308/616] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:40 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:37:41.002700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96e3e9-f2c0-47d7-930c-d7dd6b6b6275 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.014643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96e3e9-f2c0-47d7-930c-d7dd6b6b6275 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.018626 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688997-209f-444d-bf81-87d0bdcea72c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e159100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.019376 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688997-209f-444d-bf81-87d0bdcea72c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.019662 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688997-209f-444d-bf81-87d0bdcea72c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.019940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688997-209f-444d-bf81-87d0bdcea72c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.031132 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688997-209f-444d-bf81-87d0bdcea72c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:41.037798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-c8688997-209f-444d-bf81-87d0bdcea72c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:37:41.038876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 309/617] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:41.045643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bb51b-d945-41a3-9d9d-df3b79336b23 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.054217 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bb51b-d945-41a3-9d9d-df3b79336b23 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.059192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baade8a-994b-48df-a628-c8900ea5c3c6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e1066d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.059791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baade8a-994b-48df-a628-c8900ea5c3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.060085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baade8a-994b-48df-a628-c8900ea5c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.060375 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baade8a-994b-48df-a628-c8900ea5c3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.061086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baade8a-994b-48df-a628-c8900ea5c3c6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:41.061391 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baade8a-994b-48df-a628-c8900ea5c3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:41.062990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baade8a-994b-48df-a628-c8900ea5c3c6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:41.071253 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 309/618] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:41.076453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688997-209f-444d-bf81-87d0bdcea72c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.086050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688997-209f-444d-bf81-87d0bdcea72c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.090766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a8fed-5a70-4fd3-9e33-f37f83e30256 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e3dcf10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.091494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8fed-5a70-4fd3-9e33-f37f83e30256 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.092038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8fed-5a70-4fd3-9e33-f37f83e30256 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.092318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8fed-5a70-4fd3-9e33-f37f83e30256 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.103196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a8fed-5a70-4fd3-9e33-f37f83e30256 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:41.105691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a8fed-5a70-4fd3-9e33-f37f83e30256 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:41.123589 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-627a8fed-5a70-4fd3-9e33-f37f83e30256 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:41.125356 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 310/619] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:41.131268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baade8a-994b-48df-a628-c8900ea5c3c6 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.141508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baade8a-994b-48df-a628-c8900ea5c3c6 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.145662 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b45ae-4d27-4675-8147-c55cb590b500 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e106130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.146255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b45ae-4d27-4675-8147-c55cb590b500 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.146549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b45ae-4d27-4675-8147-c55cb590b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.146836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b45ae-4d27-4675-8147-c55cb590b500 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.147563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b45ae-4d27-4675-8147-c55cb590b500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:41.147868 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b45ae-4d27-4675-8147-c55cb590b500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:41.149436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b45ae-4d27-4675-8147-c55cb590b500 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:41.166070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 310/620] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:41.172131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a8fed-5a70-4fd3-9e33-f37f83e30256 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.181679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a8fed-5a70-4fd3-9e33-f37f83e30256 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.186607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d2fd4-39c5-4bdc-aaed-77c1172362f7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e17f580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.187428 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2fd4-39c5-4bdc-aaed-77c1172362f7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.187715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2fd4-39c5-4bdc-aaed-77c1172362f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.187994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2fd4-39c5-4bdc-aaed-77c1172362f7 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.200535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d2fd4-39c5-4bdc-aaed-77c1172362f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:41.202497 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d2fd4-39c5-4bdc-aaed-77c1172362f7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:41.220656 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-8e4d2fd4-39c5-4bdc-aaed-77c1172362f7 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:37:41.221714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 311/621] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:41.227314 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b45ae-4d27-4675-8147-c55cb590b500 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.237009 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b45ae-4d27-4675-8147-c55cb590b500 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.241663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead13c1-ff7d-4b5c-b1ee-5d20d292501e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e106df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.242254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead13c1-ff7d-4b5c-b1ee-5d20d292501e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.242535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead13c1-ff7d-4b5c-b1ee-5d20d292501e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.242810 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead13c1-ff7d-4b5c-b1ee-5d20d292501e admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.243622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead13c1-ff7d-4b5c-b1ee-5d20d292501e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:41.243924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead13c1-ff7d-4b5c-b1ee-5d20d292501e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:41.246311 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead13c1-ff7d-4b5c-b1ee-5d20d292501e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:41.274082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 311/622] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:41.280409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d2fd4-39c5-4bdc-aaed-77c1172362f7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.289798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d2fd4-39c5-4bdc-aaed-77c1172362f7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.294504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8fe79-4054-4b46-83ea-c9a08daacc1f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e3b0580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.295073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8fe79-4054-4b46-83ea-c9a08daacc1f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.295395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8fe79-4054-4b46-83ea-c9a08daacc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.295679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8fe79-4054-4b46-83ea-c9a08daacc1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.303316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8fe79-4054-4b46-83ea-c9a08daacc1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:41.305050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8fe79-4054-4b46-83ea-c9a08daacc1f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:41.313498 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 312/623] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:37:41.318895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead13c1-ff7d-4b5c-b1ee-5d20d292501e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.328342 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead13c1-ff7d-4b5c-b1ee-5d20d292501e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.332708 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa76e8-51f6-4ce7-8512-66f2b1a9612c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e106a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.333408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa76e8-51f6-4ce7-8512-66f2b1a9612c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.333696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa76e8-51f6-4ce7-8512-66f2b1a9612c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.334139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa76e8-51f6-4ce7-8512-66f2b1a9612c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.347983 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa76e8-51f6-4ce7-8512-66f2b1a9612c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:41.350010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa76e8-51f6-4ce7-8512-66f2b1a9612c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:41.368174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-acaa76e8-51f6-4ce7-8512-66f2b1a9612c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:41.369311 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 312/624] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:41.375979 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8fe79-4054-4b46-83ea-c9a08daacc1f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.384856 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8fe79-4054-4b46-83ea-c9a08daacc1f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.389151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8fcd5-8276-40a4-a020-05eea6e8c395 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e17fe20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.389739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8fcd5-8276-40a4-a020-05eea6e8c395 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.390054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8fcd5-8276-40a4-a020-05eea6e8c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.390340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8fcd5-8276-40a4-a020-05eea6e8c395 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.391046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8fcd5-8276-40a4-a020-05eea6e8c395 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:41.391380 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8fcd5-8276-40a4-a020-05eea6e8c395 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:41.393002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8fcd5-8276-40a4-a020-05eea6e8c395 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:41.407066 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 313/625] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:41.412710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa76e8-51f6-4ce7-8512-66f2b1a9612c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.423325 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa76e8-51f6-4ce7-8512-66f2b1a9612c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.427531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45656e-83d8-4a39-a86e-f094d2e18e41 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e106dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.428251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45656e-83d8-4a39-a86e-f094d2e18e41 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.428543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45656e-83d8-4a39-a86e-f094d2e18e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.428850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45656e-83d8-4a39-a86e-f094d2e18e41 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.437930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45656e-83d8-4a39-a86e-f094d2e18e41 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:41.439909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45656e-83d8-4a39-a86e-f094d2e18e41 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:41.453905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-dd45656e-83d8-4a39-a86e-f094d2e18e41 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:41.454955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 313/626] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:41.460780 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8fcd5-8276-40a4-a020-05eea6e8c395 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.471191 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8fcd5-8276-40a4-a020-05eea6e8c395 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.475426 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ccdf1-d504-48b7-8938-ba0532888040 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e1b8c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.476009 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ccdf1-d504-48b7-8938-ba0532888040 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.476295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ccdf1-d504-48b7-8938-ba0532888040 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.476575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ccdf1-d504-48b7-8938-ba0532888040 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.477317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ccdf1-d504-48b7-8938-ba0532888040 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:41.477619 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ccdf1-d504-48b7-8938-ba0532888040 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:41.480170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ccdf1-d504-48b7-8938-ba0532888040 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:41.492889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 314/627] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:41.499313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45656e-83d8-4a39-a86e-f094d2e18e41 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:41.508655 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45656e-83d8-4a39-a86e-f094d2e18e41 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:41.513368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3c89e-ad52-4065-acc3-1afc6036a302 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0tUjGh5LT6isNubGa0oZsQ, audit_chain_id=['0tUjGh5LT6isNubGa0oZsQ']) at 0x7fe09e25b9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:41.513949 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3c89e-ad52-4065-acc3-1afc6036a302 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:41.514239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3c89e-ad52-4065-acc3-1afc6036a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:41.514523 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3c89e-ad52-4065-acc3-1afc6036a302 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:41.515335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3c89e-ad52-4065-acc3-1afc6036a302 admin admin] RBAC: Adding query filter params (role.id=1e35e4150601455c863ca1a2d83431ac, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=94bc9c43b3bc4eb4bcd1d0c997340376) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:41.515645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3c89e-ad52-4065-acc3-1afc6036a302 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:41.517469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3c89e-ad52-4065-acc3-1afc6036a302 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:41.522693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 314/628] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:37:41 2022] GET /identity/v3/role_assignments?user.id=94bc9c43b3bc4eb4bcd1d0c997340376&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=1e35e4150601455c863ca1a2d83431ac => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:43.624655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345605e-24fc-4c69-9c39-1cd306b6bce8 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:43.625185 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345605e-24fc-4c69-9c39-1cd306b6bce8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:43.625272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345605e-24fc-4c69-9c39-1cd306b6bce8 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:43.626900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 315/629] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:43.631986 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a91e7-4b86-4750-b776-8bd6aedc5487 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:43.632398 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a91e7-4b86-4750-b776-8bd6aedc5487 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:43.632550 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a91e7-4b86-4750-b776-8bd6aedc5487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:43.655528 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-ae5a91e7-4b86-4750-b776-8bd6aedc5487 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:43.656655 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ae5a91e7-4b86-4750-b776-8bd6aedc5487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:43.663663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 315/630] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:43 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:43.686752 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345605e-24fc-4c69-9c39-1cd306b6bce8 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:43.698373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345605e-24fc-4c69-9c39-1cd306b6bce8 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:43.702278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9e2c5-ee53-4b3d-af3f-b7ca5e2c9301 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-egjhmeyTle8CYOrU3wo8A, audit_chain_id=['-egjhmeyTle8CYOrU3wo8A']) at 0x7fe09e411a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:43.703003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e2c5-ee53-4b3d-af3f-b7ca5e2c9301 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:43.703320 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e2c5-ee53-4b3d-af3f-b7ca5e2c9301 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:43.703600 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e2c5-ee53-4b3d-af3f-b7ca5e2c9301 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:43.714897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9e2c5-ee53-4b3d-af3f-b7ca5e2c9301 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:43.721836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-afe9e2c5-ee53-4b3d-af3f-b7ca5e2c9301 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:37:43.722900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 316/631] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Feb 28 18:37:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:43.728642 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a91e7-4b86-4750-b776-8bd6aedc5487 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:43.737634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a91e7-4b86-4750-b776-8bd6aedc5487 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:43.741686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ef736-0c7e-4c47-888e-fc9bd8d06767 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-egjhmeyTle8CYOrU3wo8A, audit_chain_id=['-egjhmeyTle8CYOrU3wo8A']) at 0x7fe09e155d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:43.742274 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ef736-0c7e-4c47-888e-fc9bd8d06767 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:43.742560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ef736-0c7e-4c47-888e-fc9bd8d06767 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:43.742839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ef736-0c7e-4c47-888e-fc9bd8d06767 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:43.743575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ef736-0c7e-4c47-888e-fc9bd8d06767 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:43.743871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ef736-0c7e-4c47-888e-fc9bd8d06767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:43.745434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ef736-0c7e-4c47-888e-fc9bd8d06767 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:43.753552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 316/632] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Feb 28 18:37:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:43.758873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9e2c5-ee53-4b3d-af3f-b7ca5e2c9301 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:43.768781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9e2c5-ee53-4b3d-af3f-b7ca5e2c9301 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:43.772932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2ff1d-9b6d-4173-86e9-5e56dde97ffe admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-egjhmeyTle8CYOrU3wo8A, audit_chain_id=['-egjhmeyTle8CYOrU3wo8A']) at 0x7fe09e17ffa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:43.773630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2ff1d-9b6d-4173-86e9-5e56dde97ffe admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:43.773921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2ff1d-9b6d-4173-86e9-5e56dde97ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:43.774206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2ff1d-9b6d-4173-86e9-5e56dde97ffe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:43.785922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2ff1d-9b6d-4173-86e9-5e56dde97ffe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:43.787774 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2ff1d-9b6d-4173-86e9-5e56dde97ffe admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:43.805352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-a9b2ff1d-9b6d-4173-86e9-5e56dde97ffe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:43.806421 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 317/633] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:43.812472 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ef736-0c7e-4c47-888e-fc9bd8d06767 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:43.821596 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ef736-0c7e-4c47-888e-fc9bd8d06767 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:43.826059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c94695-8058-4f70-8e45-93eee2c13470 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-egjhmeyTle8CYOrU3wo8A, audit_chain_id=['-egjhmeyTle8CYOrU3wo8A']) at 0x7fe09e155160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:43.826654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c94695-8058-4f70-8e45-93eee2c13470 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:43.826944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c94695-8058-4f70-8e45-93eee2c13470 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:43.827257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c94695-8058-4f70-8e45-93eee2c13470 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:43.827937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c94695-8058-4f70-8e45-93eee2c13470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:43.828235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c94695-8058-4f70-8e45-93eee2c13470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:43.829797 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c94695-8058-4f70-8e45-93eee2c13470 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:43.843413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 317/634] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:43.848794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2ff1d-9b6d-4173-86e9-5e56dde97ffe admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:43.859899 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2ff1d-9b6d-4173-86e9-5e56dde97ffe admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:43.864487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49db5c8-d76d-4448-a24c-24a8e7568851 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-egjhmeyTle8CYOrU3wo8A, audit_chain_id=['-egjhmeyTle8CYOrU3wo8A']) at 0x7fe09e17f730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:43.865215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49db5c8-d76d-4448-a24c-24a8e7568851 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:43.865504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49db5c8-d76d-4448-a24c-24a8e7568851 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:43.865786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49db5c8-d76d-4448-a24c-24a8e7568851 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:43.880779 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49db5c8-d76d-4448-a24c-24a8e7568851 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:43.882724 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49db5c8-d76d-4448-a24c-24a8e7568851 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:43.901945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-c49db5c8-d76d-4448-a24c-24a8e7568851 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:37:43.903018 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 318/635] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Feb 28 18:37:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:43.908739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c94695-8058-4f70-8e45-93eee2c13470 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:43.918004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c94695-8058-4f70-8e45-93eee2c13470 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:43.922034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae20fb-a8b5-46af-a761-501789c28d04 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-egjhmeyTle8CYOrU3wo8A, audit_chain_id=['-egjhmeyTle8CYOrU3wo8A']) at 0x7fe09e444070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:43.922628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae20fb-a8b5-46af-a761-501789c28d04 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:43.922918 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae20fb-a8b5-46af-a761-501789c28d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:43.923230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae20fb-a8b5-46af-a761-501789c28d04 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:43.924111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae20fb-a8b5-46af-a761-501789c28d04 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:43.924415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae20fb-a8b5-46af-a761-501789c28d04 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:43.926224 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae20fb-a8b5-46af-a761-501789c28d04 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:43.955029 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 318/636] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Feb 28 18:37:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:37:43.960158 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49db5c8-d76d-4448-a24c-24a8e7568851 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:43.970420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49db5c8-d76d-4448-a24c-24a8e7568851 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:43.974565 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e68bfe-0e96-408a-9505-598abdbb8045 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-egjhmeyTle8CYOrU3wo8A, audit_chain_id=['-egjhmeyTle8CYOrU3wo8A']) at 0x7fe09e1b8c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:43.975323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e68bfe-0e96-408a-9505-598abdbb8045 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:43.975613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e68bfe-0e96-408a-9505-598abdbb8045 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:43.975895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e68bfe-0e96-408a-9505-598abdbb8045 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:43.987442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e68bfe-0e96-408a-9505-598abdbb8045 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:43.989248 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e68bfe-0e96-408a-9505-598abdbb8045 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:44.005711 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-a1e68bfe-0e96-408a-9505-598abdbb8045 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:44.006781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 319/637] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:37:44.012729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae20fb-a8b5-46af-a761-501789c28d04 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:44.021904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae20fb-a8b5-46af-a761-501789c28d04 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:44.026569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d91780-b5a1-4558-b0cf-4c7633ca2ed2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-egjhmeyTle8CYOrU3wo8A, audit_chain_id=['-egjhmeyTle8CYOrU3wo8A']) at 0x7fe09e155190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:44.027170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d91780-b5a1-4558-b0cf-4c7633ca2ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:44.027462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d91780-b5a1-4558-b0cf-4c7633ca2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:44.027742 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d91780-b5a1-4558-b0cf-4c7633ca2ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:44.028417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d91780-b5a1-4558-b0cf-4c7633ca2ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:44.028715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d91780-b5a1-4558-b0cf-4c7633ca2ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:44.030283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d91780-b5a1-4558-b0cf-4c7633ca2ed2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:44.042585 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 319/638] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:44.048081 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e68bfe-0e96-408a-9505-598abdbb8045 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:44.057411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e68bfe-0e96-408a-9505-598abdbb8045 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:44.061681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88386b1b-430d-44c6-9c9b-ce1e903f990c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-egjhmeyTle8CYOrU3wo8A, audit_chain_id=['-egjhmeyTle8CYOrU3wo8A']) at 0x7fe09e198760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:44.062382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88386b1b-430d-44c6-9c9b-ce1e903f990c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:44.062664 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88386b1b-430d-44c6-9c9b-ce1e903f990c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:44.062941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88386b1b-430d-44c6-9c9b-ce1e903f990c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:44.071206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88386b1b-430d-44c6-9c9b-ce1e903f990c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:44.073824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88386b1b-430d-44c6-9c9b-ce1e903f990c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:44.086888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-88386b1b-430d-44c6-9c9b-ce1e903f990c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:44.087937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 320/639] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:44.094388 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d91780-b5a1-4558-b0cf-4c7633ca2ed2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:44.103436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d91780-b5a1-4558-b0cf-4c7633ca2ed2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:44.107795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb3bbf-d270-479d-9a5d-29879a78b887 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-egjhmeyTle8CYOrU3wo8A, audit_chain_id=['-egjhmeyTle8CYOrU3wo8A']) at 0x7fe09e106880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:44.108372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb3bbf-d270-479d-9a5d-29879a78b887 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:44.108660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb3bbf-d270-479d-9a5d-29879a78b887 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:44.108941 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb3bbf-d270-479d-9a5d-29879a78b887 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:44.109671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb3bbf-d270-479d-9a5d-29879a78b887 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:44.109971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb3bbf-d270-479d-9a5d-29879a78b887 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:44.111808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb3bbf-d270-479d-9a5d-29879a78b887 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:44.124143 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 320/640] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:44.129771 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88386b1b-430d-44c6-9c9b-ce1e903f990c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:44.139847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88386b1b-430d-44c6-9c9b-ce1e903f990c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:44.143840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717eb1d-cf3f-4918-a540-a260ca3e0817 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-egjhmeyTle8CYOrU3wo8A, audit_chain_id=['-egjhmeyTle8CYOrU3wo8A']) at 0x7fe09e16ecd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:44.144638 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717eb1d-cf3f-4918-a540-a260ca3e0817 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:44.145083 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717eb1d-cf3f-4918-a540-a260ca3e0817 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:44.145345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717eb1d-cf3f-4918-a540-a260ca3e0817 admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/94bc9c43b3bc4eb4bcd1d0c997340376/roles/1e35e4150601455c863ca1a2d83431ac` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:44.147384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717eb1d-cf3f-4918-a540-a260ca3e0817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=94bc9c43b3bc4eb4bcd1d0c997340376, role_id=1e35e4150601455c863ca1a2d83431ac)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:44.149945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717eb1d-cf3f-4918-a540-a260ca3e0817 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:44.240341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 321/641] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:37:44 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/94bc9c43b3bc4eb4bcd1d0c997340376/roles/1e35e4150601455c863ca1a2d83431ac => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:37:46.337597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916411-8e2a-4a29-81ea-05a0d63e7f9f None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.338223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916411-8e2a-4a29-81ea-05a0d63e7f9f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.338223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916411-8e2a-4a29-81ea-05a0d63e7f9f None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.339840 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 321/642] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:46.345457 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fbe54-bd0e-4ccf-bb4c-c7cced135bbe None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.345880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fbe54-bd0e-4ccf-bb4c-c7cced135bbe None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.346020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fbe54-bd0e-4ccf-bb4c-c7cced135bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.368672 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-5f9fbe54-bd0e-4ccf-bb4c-c7cced135bbe None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:46.370439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5f9fbe54-bd0e-4ccf-bb4c-c7cced135bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:46.434470 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 322/643] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:46 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:46.458011 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916411-8e2a-4a29-81ea-05a0d63e7f9f None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.470174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916411-8e2a-4a29-81ea-05a0d63e7f9f None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.474161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a736ea-48b0-4b52-a65a-6d79f3fa1a90 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e4442b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.474890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a736ea-48b0-4b52-a65a-6d79f3fa1a90 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.475215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a736ea-48b0-4b52-a65a-6d79f3fa1a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.475500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a736ea-48b0-4b52-a65a-6d79f3fa1a90 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.486980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a736ea-48b0-4b52-a65a-6d79f3fa1a90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:37:46.493680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-f3a736ea-48b0-4b52-a65a-6d79f3fa1a90 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:37:46.495442 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 322/644] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:46.501282 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fbe54-bd0e-4ccf-bb4c-c7cced135bbe None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.509861 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fbe54-bd0e-4ccf-bb4c-c7cced135bbe None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.514198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a7bc-e16a-4423-bec6-4928d76caf18 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e16ed90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.514786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a7bc-e16a-4423-bec6-4928d76caf18 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.515076 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a7bc-e16a-4423-bec6-4928d76caf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.515383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a7bc-e16a-4423-bec6-4928d76caf18 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.516098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10a7bc-e16a-4423-bec6-4928d76caf18 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:46.516399 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10a7bc-e16a-4423-bec6-4928d76caf18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:46.517985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10a7bc-e16a-4423-bec6-4928d76caf18 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:46.526895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 323/645] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:46.532144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a736ea-48b0-4b52-a65a-6d79f3fa1a90 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.542304 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a736ea-48b0-4b52-a65a-6d79f3fa1a90 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.546426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8bc76-0ec6-4460-af31-2bea655957b7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e1dd0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.547162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8bc76-0ec6-4460-af31-2bea655957b7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.547458 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8bc76-0ec6-4460-af31-2bea655957b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.547746 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8bc76-0ec6-4460-af31-2bea655957b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.558839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8bc76-0ec6-4460-af31-2bea655957b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:46.560702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8bc76-0ec6-4460-af31-2bea655957b7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:46.577598 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-09d8bc76-0ec6-4460-af31-2bea655957b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:46.578677 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 323/646] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:46.584456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a7bc-e16a-4423-bec6-4928d76caf18 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.594655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a7bc-e16a-4423-bec6-4928d76caf18 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.598826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033d72-3360-410b-9ab9-8bd3f4d744ac admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e188220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.599432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033d72-3360-410b-9ab9-8bd3f4d744ac admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.599721 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033d72-3360-410b-9ab9-8bd3f4d744ac admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.600041 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033d72-3360-410b-9ab9-8bd3f4d744ac admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.600712 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94033d72-3360-410b-9ab9-8bd3f4d744ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:46.601009 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94033d72-3360-410b-9ab9-8bd3f4d744ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:46.602568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94033d72-3360-410b-9ab9-8bd3f4d744ac admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:46.615408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 324/647] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:46.621200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8bc76-0ec6-4460-af31-2bea655957b7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.630975 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8bc76-0ec6-4460-af31-2bea655957b7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.635848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010a7f5-5f75-406b-832c-bd653259fdce admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e183be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.636578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010a7f5-5f75-406b-832c-bd653259fdce admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.636873 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010a7f5-5f75-406b-832c-bd653259fdce admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.637160 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010a7f5-5f75-406b-832c-bd653259fdce admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.652017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010a7f5-5f75-406b-832c-bd653259fdce admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:46.654043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010a7f5-5f75-406b-832c-bd653259fdce admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:46.672805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-3010a7f5-5f75-406b-832c-bd653259fdce admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:37:46.673875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 324/648] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:46.679498 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033d72-3360-410b-9ab9-8bd3f4d744ac admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.689194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033d72-3360-410b-9ab9-8bd3f4d744ac admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.693518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6243fb-8c33-42c8-8413-b42c04cf232f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e204c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.694104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6243fb-8c33-42c8-8413-b42c04cf232f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.694387 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6243fb-8c33-42c8-8413-b42c04cf232f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.694668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6243fb-8c33-42c8-8413-b42c04cf232f admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.695480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6243fb-8c33-42c8-8413-b42c04cf232f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:46.695781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6243fb-8c33-42c8-8413-b42c04cf232f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:46.697591 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6243fb-8c33-42c8-8413-b42c04cf232f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:46.726167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 325/649] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:46.732387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010a7f5-5f75-406b-832c-bd653259fdce admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.741577 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010a7f5-5f75-406b-832c-bd653259fdce admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.746198 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5576c-18f5-4ef7-8936-fb0db6b3f005 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e55f610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.746769 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5576c-18f5-4ef7-8936-fb0db6b3f005 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.747062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5576c-18f5-4ef7-8936-fb0db6b3f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.747370 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5576c-18f5-4ef7-8936-fb0db6b3f005 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.754890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5576c-18f5-4ef7-8936-fb0db6b3f005 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:46.756640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5576c-18f5-4ef7-8936-fb0db6b3f005 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:46.765418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 325/650] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:37:46.770912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6243fb-8c33-42c8-8413-b42c04cf232f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.780760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6243fb-8c33-42c8-8413-b42c04cf232f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.784963 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5ae2f-61d5-4e5c-8834-26f7563142fc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e3eda00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.785797 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5ae2f-61d5-4e5c-8834-26f7563142fc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.786087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5ae2f-61d5-4e5c-8834-26f7563142fc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.786516 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5ae2f-61d5-4e5c-8834-26f7563142fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.798456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5ae2f-61d5-4e5c-8834-26f7563142fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:46.800311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5ae2f-61d5-4e5c-8834-26f7563142fc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:46.816831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-cfc5ae2f-61d5-4e5c-8834-26f7563142fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:37:46.817887 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 326/651] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:46.823826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5576c-18f5-4ef7-8936-fb0db6b3f005 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.832229 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5576c-18f5-4ef7-8936-fb0db6b3f005 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.836465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320d654-da96-415b-84c0-32863a525306 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e1e6d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.837048 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d654-da96-415b-84c0-32863a525306 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.837337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d654-da96-415b-84c0-32863a525306 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.837617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320d654-da96-415b-84c0-32863a525306 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.839413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320d654-da96-415b-84c0-32863a525306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:46.839721 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320d654-da96-415b-84c0-32863a525306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:46.841386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320d654-da96-415b-84c0-32863a525306 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:46.854541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 326/652] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:46.859760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5ae2f-61d5-4e5c-8834-26f7563142fc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.869008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5ae2f-61d5-4e5c-8834-26f7563142fc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.873834 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278771f-59f1-4580-b7a1-e8aa92e980a9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e1b0d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.874538 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278771f-59f1-4580-b7a1-e8aa92e980a9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.874830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278771f-59f1-4580-b7a1-e8aa92e980a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.875135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278771f-59f1-4580-b7a1-e8aa92e980a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.883531 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278771f-59f1-4580-b7a1-e8aa92e980a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:46.886619 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278771f-59f1-4580-b7a1-e8aa92e980a9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:46.899868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-3278771f-59f1-4580-b7a1-e8aa92e980a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:37:46.901968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 327/653] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:46.907443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320d654-da96-415b-84c0-32863a525306 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.918104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320d654-da96-415b-84c0-32863a525306 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.922486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c12de2-131f-4cbe-abcd-0912b6792314 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e4e0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.923073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c12de2-131f-4cbe-abcd-0912b6792314 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.923391 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c12de2-131f-4cbe-abcd-0912b6792314 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.923670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c12de2-131f-4cbe-abcd-0912b6792314 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.924411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c12de2-131f-4cbe-abcd-0912b6792314 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:46.924710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c12de2-131f-4cbe-abcd-0912b6792314 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:46.926511 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c12de2-131f-4cbe-abcd-0912b6792314 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:46.939872 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 327/654] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:46.945676 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278771f-59f1-4580-b7a1-e8aa92e980a9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:46.955696 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278771f-59f1-4580-b7a1-e8aa92e980a9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:46.960027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7449a11-85dd-4b0c-8eb7-fbb10b0fbe49 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AEqYekJHRTSmHIx9rKLAhQ, audit_chain_id=['AEqYekJHRTSmHIx9rKLAhQ']) at 0x7fe09e3f36d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:46.960607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7449a11-85dd-4b0c-8eb7-fbb10b0fbe49 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:46.960900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7449a11-85dd-4b0c-8eb7-fbb10b0fbe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:46.961186 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7449a11-85dd-4b0c-8eb7-fbb10b0fbe49 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:46.961958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7449a11-85dd-4b0c-8eb7-fbb10b0fbe49 admin admin] RBAC: Adding query filter params (role.id=1e35e4150601455c863ca1a2d83431ac, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=94bc9c43b3bc4eb4bcd1d0c997340376) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:46.962272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7449a11-85dd-4b0c-8eb7-fbb10b0fbe49 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:46.964755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7449a11-85dd-4b0c-8eb7-fbb10b0fbe49 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:46.970783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 328/655] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:37:46 2022] GET /identity/v3/role_assignments?user.id=94bc9c43b3bc4eb4bcd1d0c997340376&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=1e35e4150601455c863ca1a2d83431ac => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:49.246049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0a529-4f11-4603-a105-cd77d09a0e10 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:49.246552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0a529-4f11-4603-a105-cd77d09a0e10 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:49.246552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0a529-4f11-4603-a105-cd77d09a0e10 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:49.248202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 328/656] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:49.253364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b51b-a8f7-4ecf-8b6b-8ebc38be9a21 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:49.253776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b51b-a8f7-4ecf-8b6b-8ebc38be9a21 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:49.253922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b51b-a8f7-4ecf-8b6b-8ebc38be9a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:49.277365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b4b0b51b-a8f7-4ecf-8b6b-8ebc38be9a21 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:49.278512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b4b0b51b-a8f7-4ecf-8b6b-8ebc38be9a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:49.285357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 329/657] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:49 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:49.307387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0a529-4f11-4603-a105-cd77d09a0e10 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:49.319052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0a529-4f11-4603-a105-cd77d09a0e10 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:49.323670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd592bd-4ccf-4951-bdf0-2d9504e58b5a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QIVSL5AEQDSyLv_1hRaxhg, audit_chain_id=['QIVSL5AEQDSyLv_1hRaxhg']) at 0x7fe09e1e6d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:49.324377 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd592bd-4ccf-4951-bdf0-2d9504e58b5a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:49.324670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd592bd-4ccf-4951-bdf0-2d9504e58b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:49.324955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd592bd-4ccf-4951-bdf0-2d9504e58b5a admin admin] PATH_INFO: `/v3/services/image` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:49.325576 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd592bd-4ccf-4951-bdf0-2d9504e58b5a admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:49.327230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd592bd-4ccf-4951-bdf0-2d9504e58b5a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:49.337203 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-0bd592bd-4ccf-4951-bdf0-2d9504e58b5a admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 18:37:49.338871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 329/658] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 18:37:49 2022] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:49.344946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0b51b-a8f7-4ecf-8b6b-8ebc38be9a21 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:49.353596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0b51b-a8f7-4ecf-8b6b-8ebc38be9a21 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:49.357790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a737b03-3705-46b3-bdc8-4121fa7dff7a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QIVSL5AEQDSyLv_1hRaxhg, audit_chain_id=['QIVSL5AEQDSyLv_1hRaxhg']) at 0x7fe09e3e9b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:49.358375 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737b03-3705-46b3-bdc8-4121fa7dff7a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:49.358663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737b03-3705-46b3-bdc8-4121fa7dff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:49.358944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737b03-3705-46b3-bdc8-4121fa7dff7a admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:49.359650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a737b03-3705-46b3-bdc8-4121fa7dff7a admin admin] RBAC: Adding query filter params (name=image) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:49.359951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a737b03-3705-46b3-bdc8-4121fa7dff7a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:49.361547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a737b03-3705-46b3-bdc8-4121fa7dff7a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:49.365975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 330/659] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:49.371385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd592bd-4ccf-4951-bdf0-2d9504e58b5a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:49.380571 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd592bd-4ccf-4951-bdf0-2d9504e58b5a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:49.384661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24ac11-714f-48db-8fd9-6065b44f4c9b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QIVSL5AEQDSyLv_1hRaxhg, audit_chain_id=['QIVSL5AEQDSyLv_1hRaxhg']) at 0x7fe09e14e520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:49.385796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24ac11-714f-48db-8fd9-6065b44f4c9b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:49.386082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24ac11-714f-48db-8fd9-6065b44f4c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:49.386364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24ac11-714f-48db-8fd9-6065b44f4c9b admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:49.387024 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24ac11-714f-48db-8fd9-6065b44f4c9b admin admin] RBAC: Adding query filter params (type=image) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:49.387357 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24ac11-714f-48db-8fd9-6065b44f4c9b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:49.388896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24ac11-714f-48db-8fd9-6065b44f4c9b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:49.393111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 330/660] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:51.538278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16634478-5dd4-48c5-963b-c67be2654ed0 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:51.542606 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16634478-5dd4-48c5-963b-c67be2654ed0 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:51.542606 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16634478-5dd4-48c5-963b-c67be2654ed0 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:51.542606 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 331/661] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:51.546799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7676dd-169f-4098-bb37-391d508fe4cb None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:51.547268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7676dd-169f-4098-bb37-391d508fe4cb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:51.547398 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7676dd-169f-4098-bb37-391d508fe4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:51.570913 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-2f7676dd-169f-4098-bb37-391d508fe4cb None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:51.572154 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2f7676dd-169f-4098-bb37-391d508fe4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:51.579563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 331/662] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:51 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:51.603968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16634478-5dd4-48c5-963b-c67be2654ed0 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:51.616602 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16634478-5dd4-48c5-963b-c67be2654ed0 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:51.621948 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258516f1-8da9-487d-819a-c112a73fec75 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Xk1hL2QnTFiMtHljIND-fQ, audit_chain_id=['Xk1hL2QnTFiMtHljIND-fQ']) at 0x7fe09e3eb550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:51.622610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258516f1-8da9-487d-819a-c112a73fec75 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:51.622922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258516f1-8da9-487d-819a-c112a73fec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:51.623254 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258516f1-8da9-487d-819a-c112a73fec75 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:51.623944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258516f1-8da9-487d-819a-c112a73fec75 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:51.625570 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258516f1-8da9-487d-819a-c112a73fec75 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:51.704142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 332/663] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:37:51 2022] POST /identity/v3/services => generated 242 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:37:53.848244 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917ce86-1cba-4bb8-94c6-acd6b06f33ae None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:53.848777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917ce86-1cba-4bb8-94c6-acd6b06f33ae None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:53.848777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917ce86-1cba-4bb8-94c6-acd6b06f33ae None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:53.850458 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 332/664] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:53.855858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacbf17-3649-47f0-82c9-271d1da179e5 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:53.856298 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacbf17-3649-47f0-82c9-271d1da179e5 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:53.856428 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacbf17-3649-47f0-82c9-271d1da179e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:53.879958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-ccacbf17-3649-47f0-82c9-271d1da179e5 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:53.881102 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ccacbf17-3649-47f0-82c9-271d1da179e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:53.898968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 333/665] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:53 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:53.922089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917ce86-1cba-4bb8-94c6-acd6b06f33ae None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:53.934204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917ce86-1cba-4bb8-94c6-acd6b06f33ae None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:53.938448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffe37c-a9e6-4d17-8dff-e426e417b1f2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OXmgvlRfT6GL6o-NZar8jA, audit_chain_id=['OXmgvlRfT6GL6o-NZar8jA']) at 0x7fe09e1dd0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:53.939223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffe37c-a9e6-4d17-8dff-e426e417b1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:53.939478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffe37c-a9e6-4d17-8dff-e426e417b1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:53.939757 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffe37c-a9e6-4d17-8dff-e426e417b1f2 admin admin] PATH_INFO: `/v3/services/image` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:53.940374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffe37c-a9e6-4d17-8dff-e426e417b1f2 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:53.941956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffe37c-a9e6-4d17-8dff-e426e417b1f2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:53.952779 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-70ffe37c-a9e6-4d17-8dff-e426e417b1f2 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 18:37:53.953887 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 333/666] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 18:37:53 2022] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:53.959895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacbf17-3649-47f0-82c9-271d1da179e5 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:53.969605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacbf17-3649-47f0-82c9-271d1da179e5 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:53.973824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa05bc-b24f-405b-9604-528579abb9e3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OXmgvlRfT6GL6o-NZar8jA, audit_chain_id=['OXmgvlRfT6GL6o-NZar8jA']) at 0x7fe09e159490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:53.974414 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa05bc-b24f-405b-9604-528579abb9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:53.974707 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa05bc-b24f-405b-9604-528579abb9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:53.974987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa05bc-b24f-405b-9604-528579abb9e3 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:53.975695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa05bc-b24f-405b-9604-528579abb9e3 admin admin] RBAC: Adding query filter params (name=image) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:53.975993 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa05bc-b24f-405b-9604-528579abb9e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:53.977594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa05bc-b24f-405b-9604-528579abb9e3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:53.982066 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 334/667] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:53.987934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffe37c-a9e6-4d17-8dff-e426e417b1f2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:53.997689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffe37c-a9e6-4d17-8dff-e426e417b1f2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:54.001801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82b050-3a41-439b-8f7f-28fa259253c0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OXmgvlRfT6GL6o-NZar8jA, audit_chain_id=['OXmgvlRfT6GL6o-NZar8jA']) at 0x7fe09e118b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:54.002379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82b050-3a41-439b-8f7f-28fa259253c0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:54.002667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82b050-3a41-439b-8f7f-28fa259253c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:54.002948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82b050-3a41-439b-8f7f-28fa259253c0 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:54.003646 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82b050-3a41-439b-8f7f-28fa259253c0 admin admin] RBAC: Adding query filter params (type=image) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:54.004034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82b050-3a41-439b-8f7f-28fa259253c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:54.005593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82b050-3a41-439b-8f7f-28fa259253c0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:54.011297 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 334/668] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:54.016877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa05bc-b24f-405b-9604-528579abb9e3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:54.026298 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa05bc-b24f-405b-9604-528579abb9e3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:54.030497 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49935467-d3da-4be9-bfff-42ac0d7facc2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OXmgvlRfT6GL6o-NZar8jA, audit_chain_id=['OXmgvlRfT6GL6o-NZar8jA']) at 0x7fe09e159d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:54.031083 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49935467-d3da-4be9-bfff-42ac0d7facc2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:54.031416 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49935467-d3da-4be9-bfff-42ac0d7facc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:54.031697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49935467-d3da-4be9-bfff-42ac0d7facc2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:54.032444 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49935467-d3da-4be9-bfff-42ac0d7facc2 admin admin] RBAC: Adding query filter params (interface=public, service_id=7be8b3ac0afe48d79ff56da3aa1956cf, region_id=RegionOne) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:54.032748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49935467-d3da-4be9-bfff-42ac0d7facc2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:54.034327 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49935467-d3da-4be9-bfff-42ac0d7facc2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:54.039806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 335/669] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Feb 28 18:37:54 2022] GET /identity/v3/endpoints?service_id=7be8b3ac0afe48d79ff56da3aa1956cf&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:37:54.046012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82b050-3a41-439b-8f7f-28fa259253c0 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:54.055336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82b050-3a41-439b-8f7f-28fa259253c0 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:54.060591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c78dc-e35d-4abc-a988-424d489a0738 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OXmgvlRfT6GL6o-NZar8jA, audit_chain_id=['OXmgvlRfT6GL6o-NZar8jA']) at 0x7fe09e21b580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:54.061192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c78dc-e35d-4abc-a988-424d489a0738 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:54.061485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c78dc-e35d-4abc-a988-424d489a0738 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:54.061769 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c78dc-e35d-4abc-a988-424d489a0738 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:54.062423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c78dc-e35d-4abc-a988-424d489a0738 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:54.064026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c78dc-e35d-4abc-a988-424d489a0738 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:54.069280 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 335/670] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:37:54 2022] GET /identity/v3/services => generated 1022 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:37:56.196607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d162fa-34d1-4ac3-8aa7-2ebaaa11b780 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:56.197879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d162fa-34d1-4ac3-8aa7-2ebaaa11b780 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:56.197879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d162fa-34d1-4ac3-8aa7-2ebaaa11b780 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:56.199467 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 336/671] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:56.204752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f922ea1-7221-42a4-9595-2339532a5e0c None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:56.205244 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f922ea1-7221-42a4-9595-2339532a5e0c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:56.205333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f922ea1-7221-42a4-9595-2339532a5e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:56.228221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3f922ea1-7221-42a4-9595-2339532a5e0c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:56.229426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3f922ea1-7221-42a4-9595-2339532a5e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:56.236279 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 336/672] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:56 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:56.259010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d162fa-34d1-4ac3-8aa7-2ebaaa11b780 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:56.271557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d162fa-34d1-4ac3-8aa7-2ebaaa11b780 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:56.275711 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac44fd-564c-439e-ac35-48be54ac68fc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gBo6GcZEQs6yPd5U_L7pxA, audit_chain_id=['gBo6GcZEQs6yPd5U_L7pxA']) at 0x7fe09e3e0280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:56.276362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac44fd-564c-439e-ac35-48be54ac68fc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:56.276652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac44fd-564c-439e-ac35-48be54ac68fc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:56.276926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac44fd-564c-439e-ac35-48be54ac68fc admin admin] PATH_INFO: `/v3/services/image` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:56.277621 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac44fd-564c-439e-ac35-48be54ac68fc admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:56.279219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac44fd-564c-439e-ac35-48be54ac68fc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:56.289233 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-45ac44fd-564c-439e-ac35-48be54ac68fc admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 18:37:56.290264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 337/673] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 18:37:56 2022] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:37:56.296143 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f922ea1-7221-42a4-9595-2339532a5e0c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:56.304603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f922ea1-7221-42a4-9595-2339532a5e0c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:56.309372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9222b6-4ff8-4164-ae76-caafa2fd7ebf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gBo6GcZEQs6yPd5U_L7pxA, audit_chain_id=['gBo6GcZEQs6yPd5U_L7pxA']) at 0x7fe09e25b6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:56.309939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9222b6-4ff8-4164-ae76-caafa2fd7ebf admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:56.310226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9222b6-4ff8-4164-ae76-caafa2fd7ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:56.310505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9222b6-4ff8-4164-ae76-caafa2fd7ebf admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:56.311195 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9222b6-4ff8-4164-ae76-caafa2fd7ebf admin admin] RBAC: Adding query filter params (name=image) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:56.311497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9222b6-4ff8-4164-ae76-caafa2fd7ebf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:56.313056 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9222b6-4ff8-4164-ae76-caafa2fd7ebf admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:56.317393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 337/674] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:56.323438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac44fd-564c-439e-ac35-48be54ac68fc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:56.332627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac44fd-564c-439e-ac35-48be54ac68fc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:56.336758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070b894-6b47-4f52-997d-0a3efcc08553 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gBo6GcZEQs6yPd5U_L7pxA, audit_chain_id=['gBo6GcZEQs6yPd5U_L7pxA']) at 0x7fe09e1f37f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:56.337335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070b894-6b47-4f52-997d-0a3efcc08553 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:56.337667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070b894-6b47-4f52-997d-0a3efcc08553 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:56.338068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070b894-6b47-4f52-997d-0a3efcc08553 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:56.338737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070b894-6b47-4f52-997d-0a3efcc08553 admin admin] RBAC: Adding query filter params (type=image) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:37:56.339038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070b894-6b47-4f52-997d-0a3efcc08553 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:56.340672 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070b894-6b47-4f52-997d-0a3efcc08553 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:56.345518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 338/675] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:37:56.350802 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9222b6-4ff8-4164-ae76-caafa2fd7ebf admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:56.360232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9222b6-4ff8-4164-ae76-caafa2fd7ebf admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:56.364465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b1b1d-ecdf-4410-ba65-255c97302744 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gBo6GcZEQs6yPd5U_L7pxA, audit_chain_id=['gBo6GcZEQs6yPd5U_L7pxA']) at 0x7fe09e269820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:56.365037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1b1d-ecdf-4410-ba65-255c97302744 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:56.365327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1b1d-ecdf-4410-ba65-255c97302744 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:56.365611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1b1d-ecdf-4410-ba65-255c97302744 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:56.366290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b1b1d-ecdf-4410-ba65-255c97302744 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:56.367880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b1b1d-ecdf-4410-ba65-255c97302744 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:56.457036 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 338/676] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Feb 28 18:37:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:37:58.656253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7c5ad-4679-423c-8eb0-d074e53a8cab None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:58.656843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7c5ad-4679-423c-8eb0-d074e53a8cab None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:58.656843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7c5ad-4679-423c-8eb0-d074e53a8cab None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:58.658453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 339/677] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:37:58.663925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04e7f8-49c1-4068-a723-bfd131e54d02 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:58.664377 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04e7f8-49c1-4068-a723-bfd131e54d02 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:58.664505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04e7f8-49c1-4068-a723-bfd131e54d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:58.687489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-5e04e7f8-49c1-4068-a723-bfd131e54d02 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:37:58.688945 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-5e04e7f8-49c1-4068-a723-bfd131e54d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:37:58.707319 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 339/678] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:37:58 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:37:58.731409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7c5ad-4679-423c-8eb0-d074e53a8cab None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:58.743135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7c5ad-4679-423c-8eb0-d074e53a8cab None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:58.747772 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846db8c-35a0-4337-80c4-f62f4229cf8e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dhQwENAOQECaQYoVK-Lo3Q, audit_chain_id=['dhQwENAOQECaQYoVK-Lo3Q']) at 0x7fe09e1f3af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:58.748342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846db8c-35a0-4337-80c4-f62f4229cf8e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:58.748630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846db8c-35a0-4337-80c4-f62f4229cf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:58.748910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846db8c-35a0-4337-80c4-f62f4229cf8e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:58.756602 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846db8c-35a0-4337-80c4-f62f4229cf8e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:58.758438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846db8c-35a0-4337-80c4-f62f4229cf8e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:58.767814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 340/679] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:37:58 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:37:58.774426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04e7f8-49c1-4068-a723-bfd131e54d02 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:37:58.783639 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04e7f8-49c1-4068-a723-bfd131e54d02 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:37:58.787806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d32a15-d60d-4898-a9bb-adc7b63cc48f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dhQwENAOQECaQYoVK-Lo3Q, audit_chain_id=['dhQwENAOQECaQYoVK-Lo3Q']) at 0x7fe09e118760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:37:58.788512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32a15-d60d-4898-a9bb-adc7b63cc48f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:37:58.788801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32a15-d60d-4898-a9bb-adc7b63cc48f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:37:58.789084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32a15-d60d-4898-a9bb-adc7b63cc48f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:37:58.790156 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d32a15-d60d-4898-a9bb-adc7b63cc48f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:37:58.792625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d32a15-d60d-4898-a9bb-adc7b63cc48f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:37:58.794109 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 340/680] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:37:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:01.184887 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393af5-5b94-42d8-a22b-186654b9e50d None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:01.185408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393af5-5b94-42d8-a22b-186654b9e50d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:01.185513 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99393af5-5b94-42d8-a22b-186654b9e50d None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:01.187191 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 341/681] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:01.192210 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d3bcc-c0b2-4d0d-a9ca-cd1b6a522c1e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:01.192629 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d3bcc-c0b2-4d0d-a9ca-cd1b6a522c1e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:01.192767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d3bcc-c0b2-4d0d-a9ca-cd1b6a522c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:01.215519 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-805d3bcc-c0b2-4d0d-a9ca-cd1b6a522c1e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:01.216845 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-805d3bcc-c0b2-4d0d-a9ca-cd1b6a522c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:01.223712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 341/682] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:01 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:01.247838 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393af5-5b94-42d8-a22b-186654b9e50d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:01.259949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99393af5-5b94-42d8-a22b-186654b9e50d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:01.264168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408a2e-acf4-456e-8e49-19be07429ae2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UcHghLt0THeC9oVQ9nhpGQ, audit_chain_id=['UcHghLt0THeC9oVQ9nhpGQ']) at 0x7fe09e1435b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:01.264872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408a2e-acf4-456e-8e49-19be07429ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:01.265158 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408a2e-acf4-456e-8e49-19be07429ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:01.265438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408a2e-acf4-456e-8e49-19be07429ae2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:01.277361 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85408a2e-acf4-456e-8e49-19be07429ae2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:01.279185 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85408a2e-acf4-456e-8e49-19be07429ae2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:01.295610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-85408a2e-acf4-456e-8e49-19be07429ae2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:01.296685 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 342/683] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:01.302710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d3bcc-c0b2-4d0d-a9ca-cd1b6a522c1e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:01.312246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d3bcc-c0b2-4d0d-a9ca-cd1b6a522c1e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:01.316471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d77ea-cd48-4a4a-aac7-1a9380502057 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UcHghLt0THeC9oVQ9nhpGQ, audit_chain_id=['UcHghLt0THeC9oVQ9nhpGQ']) at 0x7fe09e705760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:01.317195 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d77ea-cd48-4a4a-aac7-1a9380502057 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:01.317493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d77ea-cd48-4a4a-aac7-1a9380502057 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:01.317781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d77ea-cd48-4a4a-aac7-1a9380502057 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:01.318475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d77ea-cd48-4a4a-aac7-1a9380502057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:01.318780 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d77ea-cd48-4a4a-aac7-1a9380502057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:01.320418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d77ea-cd48-4a4a-aac7-1a9380502057 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:01.340946 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 342/684] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:01.346635 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408a2e-acf4-456e-8e49-19be07429ae2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:01.356456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408a2e-acf4-456e-8e49-19be07429ae2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:01.360666 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c687df1-c6d0-4cc9-a901-648905abacbe admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UcHghLt0THeC9oVQ9nhpGQ, audit_chain_id=['UcHghLt0THeC9oVQ9nhpGQ']) at 0x7fe09e17ff70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:01.361258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687df1-c6d0-4cc9-a901-648905abacbe admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:01.361546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687df1-c6d0-4cc9-a901-648905abacbe admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:01.361828 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687df1-c6d0-4cc9-a901-648905abacbe admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:01.362511 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c687df1-c6d0-4cc9-a901-648905abacbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:01.364440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c687df1-c6d0-4cc9-a901-648905abacbe admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:01.456558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 343/685] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:38:01 2022] POST /identity/v3/users => generated 248 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:38:03.565324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2d96-489f-42eb-adeb-f61b416664ac None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:03.565924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2d96-489f-42eb-adeb-f61b416664ac None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:03.565924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2d96-489f-42eb-adeb-f61b416664ac None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:03.567892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 343/686] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:03.573892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3730b6-ff6a-4882-a587-8ff62004269d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:03.574304 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3730b6-ff6a-4882-a587-8ff62004269d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:03.574443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3730b6-ff6a-4882-a587-8ff62004269d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:03.597078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-3a3730b6-ff6a-4882-a587-8ff62004269d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:03.599187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3a3730b6-ff6a-4882-a587-8ff62004269d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:03.605745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 344/687] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:03 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:03.628754 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd2d96-489f-42eb-adeb-f61b416664ac None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:03.640801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd2d96-489f-42eb-adeb-f61b416664ac None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:03.644758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9a3f8-74e5-40f9-b933-edcb668c2abb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09e1a1670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:03.645467 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9a3f8-74e5-40f9-b933-edcb668c2abb admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:03.645753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9a3f8-74e5-40f9-b933-edcb668c2abb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:03.646030 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9a3f8-74e5-40f9-b933-edcb668c2abb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:03.657801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9a3f8-74e5-40f9-b933-edcb668c2abb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:38:03.664102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-5cb9a3f8-74e5-40f9-b933-edcb668c2abb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:38:03.665206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 344/688] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:38:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:38:03.671452 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3730b6-ff6a-4882-a587-8ff62004269d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:03.680271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3730b6-ff6a-4882-a587-8ff62004269d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:03.684756 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f089a3-37f0-455a-a2a8-ea24a05ce5b1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09eac1b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:03.685338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f089a3-37f0-455a-a2a8-ea24a05ce5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:03.685622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f089a3-37f0-455a-a2a8-ea24a05ce5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:03.685903 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f089a3-37f0-455a-a2a8-ea24a05ce5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:03.686605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f089a3-37f0-455a-a2a8-ea24a05ce5b1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:03.686900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f089a3-37f0-455a-a2a8-ea24a05ce5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:03.688494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f089a3-37f0-455a-a2a8-ea24a05ce5b1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:03.697501 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 345/689] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:38:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:03.702962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9a3f8-74e5-40f9-b933-edcb668c2abb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:03.713232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9a3f8-74e5-40f9-b933-edcb668c2abb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:03.717696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c149dfc-5e20-4ea1-8416-d6adda7ae310 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09e1ddeb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:03.718402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c149dfc-5e20-4ea1-8416-d6adda7ae310 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:03.718693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c149dfc-5e20-4ea1-8416-d6adda7ae310 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:03.718976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c149dfc-5e20-4ea1-8416-d6adda7ae310 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:03.730005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c149dfc-5e20-4ea1-8416-d6adda7ae310 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:03.731852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c149dfc-5e20-4ea1-8416-d6adda7ae310 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:03.748933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-0c149dfc-5e20-4ea1-8416-d6adda7ae310 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:03.749990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 345/690] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:03.755425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f089a3-37f0-455a-a2a8-ea24a05ce5b1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:03.765261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f089a3-37f0-455a-a2a8-ea24a05ce5b1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:03.769428 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69d5e5-1df3-44e6-93da-73bb2c3da2f7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09e3d1df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:03.770003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69d5e5-1df3-44e6-93da-73bb2c3da2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:03.770288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69d5e5-1df3-44e6-93da-73bb2c3da2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:03.770568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69d5e5-1df3-44e6-93da-73bb2c3da2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:03.771274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69d5e5-1df3-44e6-93da-73bb2c3da2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:03.771573 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69d5e5-1df3-44e6-93da-73bb2c3da2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:03.773123 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69d5e5-1df3-44e6-93da-73bb2c3da2f7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:03.785161 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 346/691] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:03.790378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c149dfc-5e20-4ea1-8416-d6adda7ae310 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:03.799621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c149dfc-5e20-4ea1-8416-d6adda7ae310 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:03.803687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12324e6-4a2d-4471-b91b-fdc2be5a4f1a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09e212b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:03.804393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12324e6-4a2d-4471-b91b-fdc2be5a4f1a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:03.804680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12324e6-4a2d-4471-b91b-fdc2be5a4f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:03.804960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12324e6-4a2d-4471-b91b-fdc2be5a4f1a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:03.817799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12324e6-4a2d-4471-b91b-fdc2be5a4f1a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:03.819788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12324e6-4a2d-4471-b91b-fdc2be5a4f1a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:03.837534 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-d12324e6-4a2d-4471-b91b-fdc2be5a4f1a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 18:38:03.838612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 346/692] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:38:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:03.844915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69d5e5-1df3-44e6-93da-73bb2c3da2f7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:03.854329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69d5e5-1df3-44e6-93da-73bb2c3da2f7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:03.858451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9de36-7c96-4467-b214-8300e0e55061 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09e3e9c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:03.859034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9de36-7c96-4467-b214-8300e0e55061 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:03.859352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9de36-7c96-4467-b214-8300e0e55061 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:03.859630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9de36-7c96-4467-b214-8300e0e55061 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:03.860442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9de36-7c96-4467-b214-8300e0e55061 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:03.860744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9de36-7c96-4467-b214-8300e0e55061 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:03.862551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9de36-7c96-4467-b214-8300e0e55061 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:03.893051 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 347/693] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Feb 28 18:38:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:03.898617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12324e6-4a2d-4471-b91b-fdc2be5a4f1a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:03.908202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12324e6-4a2d-4471-b91b-fdc2be5a4f1a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:03.912350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59966f76-ea6c-4e0d-8529-d74c57603fc6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09e105d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:03.912923 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59966f76-ea6c-4e0d-8529-d74c57603fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:03.913217 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59966f76-ea6c-4e0d-8529-d74c57603fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:03.913499 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59966f76-ea6c-4e0d-8529-d74c57603fc6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:03.921098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59966f76-ea6c-4e0d-8529-d74c57603fc6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:03.922836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59966f76-ea6c-4e0d-8529-d74c57603fc6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:03.931709 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 347/694] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:38:03 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:38:03.937420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9de36-7c96-4467-b214-8300e0e55061 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:03.946736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9de36-7c96-4467-b214-8300e0e55061 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:03.951499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bfd9c-68a2-4c19-8982-14ce268188e2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09e3e4e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:03.952210 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bfd9c-68a2-4c19-8982-14ce268188e2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:03.952496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bfd9c-68a2-4c19-8982-14ce268188e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:03.952772 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bfd9c-68a2-4c19-8982-14ce268188e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:03.964382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bfd9c-68a2-4c19-8982-14ce268188e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:03.966447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bfd9c-68a2-4c19-8982-14ce268188e2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:03.982935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-8e2bfd9c-68a2-4c19-8982-14ce268188e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:03.984039 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 348/695] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:38:03.989656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59966f76-ea6c-4e0d-8529-d74c57603fc6 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:03.998732 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59966f76-ea6c-4e0d-8529-d74c57603fc6 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:04.002918 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad641d8-808d-4067-9201-09084211d503 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09e105310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:04.003554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad641d8-808d-4067-9201-09084211d503 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:04.003844 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad641d8-808d-4067-9201-09084211d503 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:04.004123 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad641d8-808d-4067-9201-09084211d503 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:04.004801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad641d8-808d-4067-9201-09084211d503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:04.005100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad641d8-808d-4067-9201-09084211d503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:04.006678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad641d8-808d-4067-9201-09084211d503 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:04.019549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 348/696] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:04.024866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bfd9c-68a2-4c19-8982-14ce268188e2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:04.034012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bfd9c-68a2-4c19-8982-14ce268188e2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:04.038135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a0185-eca1-4702-a9cf-a1d49d51e49a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09e143a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:04.038832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a0185-eca1-4702-a9cf-a1d49d51e49a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:04.039134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a0185-eca1-4702-a9cf-a1d49d51e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:04.039408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a0185-eca1-4702-a9cf-a1d49d51e49a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:04.047628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a0185-eca1-4702-a9cf-a1d49d51e49a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:04.049549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a0185-eca1-4702-a9cf-a1d49d51e49a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:04.063641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-5c7a0185-eca1-4702-a9cf-a1d49d51e49a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:38:04.064702 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 349/697] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:04.070401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad641d8-808d-4067-9201-09084211d503 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:04.080217 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad641d8-808d-4067-9201-09084211d503 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:04.084479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077a7c3-7c78-4162-a2a5-a6bc54e0e139 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09e92e640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:04.085068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077a7c3-7c78-4162-a2a5-a6bc54e0e139 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:04.085358 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077a7c3-7c78-4162-a2a5-a6bc54e0e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:04.085639 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077a7c3-7c78-4162-a2a5-a6bc54e0e139 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:04.086373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077a7c3-7c78-4162-a2a5-a6bc54e0e139 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:04.086671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077a7c3-7c78-4162-a2a5-a6bc54e0e139 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:04.088582 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077a7c3-7c78-4162-a2a5-a6bc54e0e139 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:04.102324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 349/698] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:04.109149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a0185-eca1-4702-a9cf-a1d49d51e49a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:04.118492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a0185-eca1-4702-a9cf-a1d49d51e49a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:04.123336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f5ed5-f69b-479a-8407-f7e5d21a26a7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AvEZT6EoSqm7ALDfj21gMg, audit_chain_id=['AvEZT6EoSqm7ALDfj21gMg']) at 0x7fe09e2044f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:04.123910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5ed5-f69b-479a-8407-f7e5d21a26a7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:04.124198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5ed5-f69b-479a-8407-f7e5d21a26a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:04.124480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5ed5-f69b-479a-8407-f7e5d21a26a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:04.125251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f5ed5-f69b-479a-8407-f7e5d21a26a7 admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=43304b4fcb06440f9d5166ca439a581b) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:04.125554 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f5ed5-f69b-479a-8407-f7e5d21a26a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:04.127407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f5ed5-f69b-479a-8407-f7e5d21a26a7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:04.132574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 350/699] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:38:04 2022] GET /identity/v3/role_assignments?user.id=43304b4fcb06440f9d5166ca439a581b&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:06.222962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b882c-f679-468c-afef-056c57a50423 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.223515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b882c-f679-468c-afef-056c57a50423 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.223515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b882c-f679-468c-afef-056c57a50423 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.225116 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 350/700] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:06.230263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7fcc-8951-4879-8870-43f718f791a5 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.230686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7fcc-8951-4879-8870-43f718f791a5 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.230831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7fcc-8951-4879-8870-43f718f791a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.253561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-469d7fcc-8951-4879-8870-43f718f791a5 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:06.254699 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-469d7fcc-8951-4879-8870-43f718f791a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:06.262588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 351/701] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:06 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:06.284400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b882c-f679-468c-afef-056c57a50423 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:06.295928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b882c-f679-468c-afef-056c57a50423 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:06.299834 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1f9b6-b39a-4fe7-977d-3f9313b4e533 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wn5SLj-SQhCIajADA0_gdQ, audit_chain_id=['wn5SLj-SQhCIajADA0_gdQ']) at 0x7fe09e150e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:06.300543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1f9b6-b39a-4fe7-977d-3f9313b4e533 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.300830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1f9b6-b39a-4fe7-977d-3f9313b4e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.301108 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1f9b6-b39a-4fe7-977d-3f9313b4e533 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.312486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1f9b6-b39a-4fe7-977d-3f9313b4e533 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:38:06.318617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-09a1f9b6-b39a-4fe7-977d-3f9313b4e533 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:38:06.319711 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 351/702] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:38:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:06.325980 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d7fcc-8951-4879-8870-43f718f791a5 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:06.334536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d7fcc-8951-4879-8870-43f718f791a5 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:06.338745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b559930-1c92-403f-bd3e-4d822df8b405 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wn5SLj-SQhCIajADA0_gdQ, audit_chain_id=['wn5SLj-SQhCIajADA0_gdQ']) at 0x7fe09e3f02b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:06.339361 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b559930-1c92-403f-bd3e-4d822df8b405 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.339652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b559930-1c92-403f-bd3e-4d822df8b405 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.339932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b559930-1c92-403f-bd3e-4d822df8b405 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.340640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b559930-1c92-403f-bd3e-4d822df8b405 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:06.340936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b559930-1c92-403f-bd3e-4d822df8b405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:06.342760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b559930-1c92-403f-bd3e-4d822df8b405 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:06.350965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 352/703] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:38:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:06.356866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1f9b6-b39a-4fe7-977d-3f9313b4e533 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:06.366477 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1f9b6-b39a-4fe7-977d-3f9313b4e533 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:06.371387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b1f6d-8f8e-4884-9c45-327bc8e04840 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wn5SLj-SQhCIajADA0_gdQ, audit_chain_id=['wn5SLj-SQhCIajADA0_gdQ']) at 0x7fe09e1063a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:06.372088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b1f6d-8f8e-4884-9c45-327bc8e04840 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.372379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b1f6d-8f8e-4884-9c45-327bc8e04840 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.372664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b1f6d-8f8e-4884-9c45-327bc8e04840 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.383591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b1f6d-8f8e-4884-9c45-327bc8e04840 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:06.385755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b1f6d-8f8e-4884-9c45-327bc8e04840 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:06.402646 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-883b1f6d-8f8e-4884-9c45-327bc8e04840 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:06.403748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 352/704] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:06.409331 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b559930-1c92-403f-bd3e-4d822df8b405 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:06.419133 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b559930-1c92-403f-bd3e-4d822df8b405 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:06.423294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d215285-c7e6-4d86-973d-63473d825426 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wn5SLj-SQhCIajADA0_gdQ, audit_chain_id=['wn5SLj-SQhCIajADA0_gdQ']) at 0x7fe09e3ed610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:06.423877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d215285-c7e6-4d86-973d-63473d825426 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.424166 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d215285-c7e6-4d86-973d-63473d825426 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.424450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d215285-c7e6-4d86-973d-63473d825426 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.425134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d215285-c7e6-4d86-973d-63473d825426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:06.425436 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d215285-c7e6-4d86-973d-63473d825426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:06.427004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d215285-c7e6-4d86-973d-63473d825426 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:06.439326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 353/705] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:06.444514 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b1f6d-8f8e-4884-9c45-327bc8e04840 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:06.454529 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b1f6d-8f8e-4884-9c45-327bc8e04840 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:06.458604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438df67-10a8-414e-8d91-ff82924e3fc2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wn5SLj-SQhCIajADA0_gdQ, audit_chain_id=['wn5SLj-SQhCIajADA0_gdQ']) at 0x7fe09e106d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:06.459332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438df67-10a8-414e-8d91-ff82924e3fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.459620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438df67-10a8-414e-8d91-ff82924e3fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.459899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438df67-10a8-414e-8d91-ff82924e3fc2 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.473260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438df67-10a8-414e-8d91-ff82924e3fc2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:06.475241 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438df67-10a8-414e-8d91-ff82924e3fc2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:06.492360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-d438df67-10a8-414e-8d91-ff82924e3fc2 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 18:38:06.493426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 353/706] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:38:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:06.499089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d215285-c7e6-4d86-973d-63473d825426 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:06.508428 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d215285-c7e6-4d86-973d-63473d825426 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:06.513371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa0acd-09c2-4d97-a6d1-beaea1a5d4ac admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wn5SLj-SQhCIajADA0_gdQ, audit_chain_id=['wn5SLj-SQhCIajADA0_gdQ']) at 0x7fe09e4396d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:06.513956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa0acd-09c2-4d97-a6d1-beaea1a5d4ac admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.514245 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa0acd-09c2-4d97-a6d1-beaea1a5d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.514528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa0acd-09c2-4d97-a6d1-beaea1a5d4ac admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.515335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa0acd-09c2-4d97-a6d1-beaea1a5d4ac admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:06.515643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa0acd-09c2-4d97-a6d1-beaea1a5d4ac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:06.517469 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa0acd-09c2-4d97-a6d1-beaea1a5d4ac admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:06.547079 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 354/707] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Feb 28 18:38:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:06.552487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438df67-10a8-414e-8d91-ff82924e3fc2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:06.561730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438df67-10a8-414e-8d91-ff82924e3fc2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:06.565848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8627b-4cdc-4f02-8d14-f3ddb15006c2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wn5SLj-SQhCIajADA0_gdQ, audit_chain_id=['wn5SLj-SQhCIajADA0_gdQ']) at 0x7fe09e1059a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:06.566556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8627b-4cdc-4f02-8d14-f3ddb15006c2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.566846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8627b-4cdc-4f02-8d14-f3ddb15006c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.567150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8627b-4cdc-4f02-8d14-f3ddb15006c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.579246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8627b-4cdc-4f02-8d14-f3ddb15006c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:06.581050 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8627b-4cdc-4f02-8d14-f3ddb15006c2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:06.598575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-c3e8627b-4cdc-4f02-8d14-f3ddb15006c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:06.599690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 354/708] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:06.605699 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa0acd-09c2-4d97-a6d1-beaea1a5d4ac admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:06.614974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa0acd-09c2-4d97-a6d1-beaea1a5d4ac admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:06.619826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9a27c-7262-4442-9ac9-e0d990cdd04d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wn5SLj-SQhCIajADA0_gdQ, audit_chain_id=['wn5SLj-SQhCIajADA0_gdQ']) at 0x7fe09e439730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:06.620404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9a27c-7262-4442-9ac9-e0d990cdd04d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.620693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9a27c-7262-4442-9ac9-e0d990cdd04d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.620974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9a27c-7262-4442-9ac9-e0d990cdd04d admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.621658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9a27c-7262-4442-9ac9-e0d990cdd04d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:06.621956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9a27c-7262-4442-9ac9-e0d990cdd04d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:06.623577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9a27c-7262-4442-9ac9-e0d990cdd04d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:06.635488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 355/709] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:06.640909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8627b-4cdc-4f02-8d14-f3ddb15006c2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:06.650143 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8627b-4cdc-4f02-8d14-f3ddb15006c2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:06.654337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa135d3b-7568-4432-9997-ac1918270551 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wn5SLj-SQhCIajADA0_gdQ, audit_chain_id=['wn5SLj-SQhCIajADA0_gdQ']) at 0x7fe09e106610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:06.655043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa135d3b-7568-4432-9997-ac1918270551 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.655391 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa135d3b-7568-4432-9997-ac1918270551 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.655676 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa135d3b-7568-4432-9997-ac1918270551 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.663957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa135d3b-7568-4432-9997-ac1918270551 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:06.666477 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa135d3b-7568-4432-9997-ac1918270551 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:06.679664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-fa135d3b-7568-4432-9997-ac1918270551 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:38:06.680718 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 355/710] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:06.686877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9a27c-7262-4442-9ac9-e0d990cdd04d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:06.696209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9a27c-7262-4442-9ac9-e0d990cdd04d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:06.702559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9616f8f-3250-4596-b180-c725ad5fe7be admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wn5SLj-SQhCIajADA0_gdQ, audit_chain_id=['wn5SLj-SQhCIajADA0_gdQ']) at 0x7fe09e16ee80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:06.703176 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9616f8f-3250-4596-b180-c725ad5fe7be admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.703468 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9616f8f-3250-4596-b180-c725ad5fe7be admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.703750 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9616f8f-3250-4596-b180-c725ad5fe7be admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.704488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9616f8f-3250-4596-b180-c725ad5fe7be admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:06.704791 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9616f8f-3250-4596-b180-c725ad5fe7be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:06.706626 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9616f8f-3250-4596-b180-c725ad5fe7be admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:06.720199 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 356/711] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:06.726043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa135d3b-7568-4432-9997-ac1918270551 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:06.735264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa135d3b-7568-4432-9997-ac1918270551 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:06.739332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cadbb-d976-455f-8469-1974e0b0e657 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wn5SLj-SQhCIajADA0_gdQ, audit_chain_id=['wn5SLj-SQhCIajADA0_gdQ']) at 0x7fe09e105400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:06.740144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cadbb-d976-455f-8469-1974e0b0e657 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:06.740431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cadbb-d976-455f-8469-1974e0b0e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:06.740708 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cadbb-d976-455f-8469-1974e0b0e657 admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/43304b4fcb06440f9d5166ca439a581b/roles/9a37fbff179849e58437f2fad75ce546` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:06.761105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cadbb-d976-455f-8469-1974e0b0e657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=43304b4fcb06440f9d5166ca439a581b, role_id=9a37fbff179849e58437f2fad75ce546)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:06.763778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cadbb-d976-455f-8469-1974e0b0e657 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:06.836953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 356/712] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:38:06 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/43304b4fcb06440f9d5166ca439a581b/roles/9a37fbff179849e58437f2fad75ce546 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:38:08.924892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf6ad3-7e35-4cec-84ba-781c32179e8d None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:08.925424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf6ad3-7e35-4cec-84ba-781c32179e8d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:08.925532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf6ad3-7e35-4cec-84ba-781c32179e8d None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:08.927299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 357/713] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:08.932415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2110-6998-43de-affe-9662cd4b27c7 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:08.932838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2110-6998-43de-affe-9662cd4b27c7 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:08.932980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2110-6998-43de-affe-9662cd4b27c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:08.955224 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-125d2110-6998-43de-affe-9662cd4b27c7 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:08.956424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-125d2110-6998-43de-affe-9662cd4b27c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:09.019772 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 357/714] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:08 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:09.043104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf6ad3-7e35-4cec-84ba-781c32179e8d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.054802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf6ad3-7e35-4cec-84ba-781c32179e8d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.059629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a825f-ae24-4225-b3ac-9ba0759e1626 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e716250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.060370 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a825f-ae24-4225-b3ac-9ba0759e1626 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.060655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a825f-ae24-4225-b3ac-9ba0759e1626 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.060936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a825f-ae24-4225-b3ac-9ba0759e1626 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.072816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a825f-ae24-4225-b3ac-9ba0759e1626 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:38:09.079131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-ea3a825f-ae24-4225-b3ac-9ba0759e1626 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:38:09.080206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 358/715] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:09.086053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d2110-6998-43de-affe-9662cd4b27c7 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.094891 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d2110-6998-43de-affe-9662cd4b27c7 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.098967 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4252e-f03b-4d2d-9735-b51fefd16fc5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e108550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.099598 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4252e-f03b-4d2d-9735-b51fefd16fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.099889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4252e-f03b-4d2d-9735-b51fefd16fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.100169 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4252e-f03b-4d2d-9735-b51fefd16fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.100870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4252e-f03b-4d2d-9735-b51fefd16fc5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:09.101169 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4252e-f03b-4d2d-9735-b51fefd16fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:09.102773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4252e-f03b-4d2d-9735-b51fefd16fc5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:09.110973 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 358/716] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:09.116294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a825f-ae24-4225-b3ac-9ba0759e1626 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.126611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a825f-ae24-4225-b3ac-9ba0759e1626 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.130699 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9973-9d4d-497c-b3a2-c1530f50eed0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e1b0100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.131436 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9973-9d4d-497c-b3a2-c1530f50eed0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.131722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9973-9d4d-497c-b3a2-c1530f50eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.132000 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9973-9d4d-497c-b3a2-c1530f50eed0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.143191 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b9973-9d4d-497c-b3a2-c1530f50eed0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:09.144999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b9973-9d4d-497c-b3a2-c1530f50eed0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:09.162257 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-6d0b9973-9d4d-497c-b3a2-c1530f50eed0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:09.163330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 359/717] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:09.169623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4252e-f03b-4d2d-9735-b51fefd16fc5 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.178807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4252e-f03b-4d2d-9735-b51fefd16fc5 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.182999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae0df1-d108-4969-89e9-8d54691baaa9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e150e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.183611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae0df1-d108-4969-89e9-8d54691baaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.183899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae0df1-d108-4969-89e9-8d54691baaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.184180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae0df1-d108-4969-89e9-8d54691baaa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.184856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae0df1-d108-4969-89e9-8d54691baaa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:09.185155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae0df1-d108-4969-89e9-8d54691baaa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:09.186713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae0df1-d108-4969-89e9-8d54691baaa9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:09.199020 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 359/718] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:09.204292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9973-9d4d-497c-b3a2-c1530f50eed0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.214103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9973-9d4d-497c-b3a2-c1530f50eed0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.218478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e23fd-1037-4e7f-b785-97eba8c2d166 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e204100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.219273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e23fd-1037-4e7f-b785-97eba8c2d166 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.219558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e23fd-1037-4e7f-b785-97eba8c2d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.219832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e23fd-1037-4e7f-b785-97eba8c2d166 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.233078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e23fd-1037-4e7f-b785-97eba8c2d166 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:09.235040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e23fd-1037-4e7f-b785-97eba8c2d166 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:09.252078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-7c3e23fd-1037-4e7f-b785-97eba8c2d166 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 18:38:09.253120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 360/719] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:09.258744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae0df1-d108-4969-89e9-8d54691baaa9 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.269692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae0df1-d108-4969-89e9-8d54691baaa9 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.273692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90f0e8-dc8e-4fe5-9f3e-b1a800e7f6e7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e105730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.274293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f0e8-dc8e-4fe5-9f3e-b1a800e7f6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.274580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f0e8-dc8e-4fe5-9f3e-b1a800e7f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.275391 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f0e8-dc8e-4fe5-9f3e-b1a800e7f6e7 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.276539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90f0e8-dc8e-4fe5-9f3e-b1a800e7f6e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:09.276848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90f0e8-dc8e-4fe5-9f3e-b1a800e7f6e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:09.278910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90f0e8-dc8e-4fe5-9f3e-b1a800e7f6e7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:09.308624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 360/720] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:09.314378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e23fd-1037-4e7f-b785-97eba8c2d166 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.323957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e23fd-1037-4e7f-b785-97eba8c2d166 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.328134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cddf29-8bc3-4699-85f9-c10e0d9b687d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e1c8fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.328705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cddf29-8bc3-4699-85f9-c10e0d9b687d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.328995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cddf29-8bc3-4699-85f9-c10e0d9b687d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.329276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cddf29-8bc3-4699-85f9-c10e0d9b687d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.336850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cddf29-8bc3-4699-85f9-c10e0d9b687d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:09.339127 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cddf29-8bc3-4699-85f9-c10e0d9b687d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:09.347719 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 361/721] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:38:09.353678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90f0e8-dc8e-4fe5-9f3e-b1a800e7f6e7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.362767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90f0e8-dc8e-4fe5-9f3e-b1a800e7f6e7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.366875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2007ad-712b-42f3-b148-40e96e4ea4b1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e14e7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.367623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2007ad-712b-42f3-b148-40e96e4ea4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.367915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2007ad-712b-42f3-b148-40e96e4ea4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.368196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2007ad-712b-42f3-b148-40e96e4ea4b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.379602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2007ad-712b-42f3-b148-40e96e4ea4b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:09.381402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2007ad-712b-42f3-b148-40e96e4ea4b1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:09.398158 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-9d2007ad-712b-42f3-b148-40e96e4ea4b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:09.399238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 361/722] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:09.405739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cddf29-8bc3-4699-85f9-c10e0d9b687d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.414276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cddf29-8bc3-4699-85f9-c10e0d9b687d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.418500 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ed7b0-049d-427f-887e-6814cdccb6f4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e795eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.419078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ed7b0-049d-427f-887e-6814cdccb6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.419400 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ed7b0-049d-427f-887e-6814cdccb6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.419684 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ed7b0-049d-427f-887e-6814cdccb6f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.420364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ed7b0-049d-427f-887e-6814cdccb6f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:09.420664 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ed7b0-049d-427f-887e-6814cdccb6f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:09.422219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ed7b0-049d-427f-887e-6814cdccb6f4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:09.434677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 362/723] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:09.439829 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2007ad-712b-42f3-b148-40e96e4ea4b1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.449404 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2007ad-712b-42f3-b148-40e96e4ea4b1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.453534 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8152e-78a2-4b56-bca1-2acbfbfe0197 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e108b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.454237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8152e-78a2-4b56-bca1-2acbfbfe0197 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.454527 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8152e-78a2-4b56-bca1-2acbfbfe0197 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.454810 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8152e-78a2-4b56-bca1-2acbfbfe0197 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.463708 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8152e-78a2-4b56-bca1-2acbfbfe0197 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:09.465620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8152e-78a2-4b56-bca1-2acbfbfe0197 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:09.479301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-c7e8152e-78a2-4b56-bca1-2acbfbfe0197 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:38:09.480356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 362/724] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:38:09.485881 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ed7b0-049d-427f-887e-6814cdccb6f4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.495399 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ed7b0-049d-427f-887e-6814cdccb6f4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.499536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea4a95-7871-436b-87b5-a403a90f953d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e3f3280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.500113 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea4a95-7871-436b-87b5-a403a90f953d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.500400 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea4a95-7871-436b-87b5-a403a90f953d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.500682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea4a95-7871-436b-87b5-a403a90f953d admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.501418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea4a95-7871-436b-87b5-a403a90f953d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:09.501721 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea4a95-7871-436b-87b5-a403a90f953d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:09.503565 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea4a95-7871-436b-87b5-a403a90f953d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:09.516550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 363/725] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:09.522299 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8152e-78a2-4b56-bca1-2acbfbfe0197 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:09.532303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8152e-78a2-4b56-bca1-2acbfbfe0197 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:09.536410 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ec098-35e0-4b7f-ac90-654ac5c74f93 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ShtLUsSeRYOX0hKmIVeVRQ, audit_chain_id=['ShtLUsSeRYOX0hKmIVeVRQ']) at 0x7fe09e1186d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:09.536984 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ec098-35e0-4b7f-ac90-654ac5c74f93 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:09.537277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ec098-35e0-4b7f-ac90-654ac5c74f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:09.537563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ec098-35e0-4b7f-ac90-654ac5c74f93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:09.538335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ec098-35e0-4b7f-ac90-654ac5c74f93 admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=43304b4fcb06440f9d5166ca439a581b) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:09.538643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ec098-35e0-4b7f-ac90-654ac5c74f93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:09.540549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ec098-35e0-4b7f-ac90-654ac5c74f93 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:09.546038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 363/726] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:38:09 2022] GET /identity/v3/role_assignments?user.id=43304b4fcb06440f9d5166ca439a581b&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:11.694731 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af51033-9967-4d94-aa64-b6bdb48be25f None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:11.695313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af51033-9967-4d94-aa64-b6bdb48be25f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:11.695404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af51033-9967-4d94-aa64-b6bdb48be25f None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:11.697104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 364/727] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:11.702394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4f9b6-3a76-403d-84fe-591b1db41a1f None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:11.702826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4f9b6-3a76-403d-84fe-591b1db41a1f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:11.702968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4f9b6-3a76-403d-84fe-591b1db41a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:11.724919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-72c4f9b6-3a76-403d-84fe-591b1db41a1f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:11.726077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-72c4f9b6-3a76-403d-84fe-591b1db41a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:11.733603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 364/728] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:11 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:11.756924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af51033-9967-4d94-aa64-b6bdb48be25f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:11.768846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af51033-9967-4d94-aa64-b6bdb48be25f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:11.772938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44946596-d6c2-4f23-bb45-c6eca0c6cefc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=l9A3A28xSrCE3-Yz_guPIg, audit_chain_id=['l9A3A28xSrCE3-Yz_guPIg']) at 0x7fe09e3f8ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:11.773661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44946596-d6c2-4f23-bb45-c6eca0c6cefc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:11.773951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44946596-d6c2-4f23-bb45-c6eca0c6cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:11.774235 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44946596-d6c2-4f23-bb45-c6eca0c6cefc admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:11.774869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44946596-d6c2-4f23-bb45-c6eca0c6cefc admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:11.776495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44946596-d6c2-4f23-bb45-c6eca0c6cefc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:11.786939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-44946596-d6c2-4f23-bb45-c6eca0c6cefc admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 18:38:11.788028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 365/729] 10.222.0.21 () {56 vars in 1150 bytes} [Mon Feb 28 18:38:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:11.794282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4f9b6-3a76-403d-84fe-591b1db41a1f None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:11.802847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4f9b6-3a76-403d-84fe-591b1db41a1f None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:11.807825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd3825-f63c-4726-aea2-75379bc5d140 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=l9A3A28xSrCE3-Yz_guPIg, audit_chain_id=['l9A3A28xSrCE3-Yz_guPIg']) at 0x7fe09e1834f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:11.808414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd3825-f63c-4726-aea2-75379bc5d140 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:11.808705 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd3825-f63c-4726-aea2-75379bc5d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:11.808989 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd3825-f63c-4726-aea2-75379bc5d140 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:11.809660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd3825-f63c-4726-aea2-75379bc5d140 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:11.809963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd3825-f63c-4726-aea2-75379bc5d140 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:11.811595 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd3825-f63c-4726-aea2-75379bc5d140 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:11.815939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 365/730] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Feb 28 18:38:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:11.821353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44946596-d6c2-4f23-bb45-c6eca0c6cefc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:11.830771 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44946596-d6c2-4f23-bb45-c6eca0c6cefc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:11.834932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6007c-6eca-4d43-a185-e53fee8fcd9a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=l9A3A28xSrCE3-Yz_guPIg, audit_chain_id=['l9A3A28xSrCE3-Yz_guPIg']) at 0x7fe09e188040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:11.835561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6007c-6eca-4d43-a185-e53fee8fcd9a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:11.835855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6007c-6eca-4d43-a185-e53fee8fcd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:11.836140 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6007c-6eca-4d43-a185-e53fee8fcd9a admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:11.836807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6007c-6eca-4d43-a185-e53fee8fcd9a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:11.837252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6007c-6eca-4d43-a185-e53fee8fcd9a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:11.838957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6007c-6eca-4d43-a185-e53fee8fcd9a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:11.843421 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 366/731] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Feb 28 18:38:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:13.949437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6f8f-45f8-4a02-b4f7-b22765fddfe4 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:13.950085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6f8f-45f8-4a02-b4f7-b22765fddfe4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:13.950085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf6f8f-45f8-4a02-b4f7-b22765fddfe4 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:13.951758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 366/732] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:13.957958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a10509-e62b-437e-b593-c99f4540cc60 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:13.958355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a10509-e62b-437e-b593-c99f4540cc60 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:13.958355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a10509-e62b-437e-b593-c99f4540cc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:13.981927 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f0a10509-e62b-437e-b593-c99f4540cc60 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:13.983090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f0a10509-e62b-437e-b593-c99f4540cc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:13.990198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 367/733] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:13 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:14.013994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf6f8f-45f8-4a02-b4f7-b22765fddfe4 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:14.027294 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf6f8f-45f8-4a02-b4f7-b22765fddfe4 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:14.031457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc0b3a-4323-46bd-b752-0e694064393d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8i13_f8TRHebH7MlnQ6_RQ, audit_chain_id=['8i13_f8TRHebH7MlnQ6_RQ']) at 0x7fe09e183df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:14.032072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0b3a-4323-46bd-b752-0e694064393d admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:14.032364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0b3a-4323-46bd-b752-0e694064393d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:14.032650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0b3a-4323-46bd-b752-0e694064393d admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:14.033340 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc0b3a-4323-46bd-b752-0e694064393d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:14.034959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc0b3a-4323-46bd-b752-0e694064393d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:14.143479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 367/734] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:38:14 2022] POST /identity/v3/services => generated 251 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:38:16.333658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f166064-9fbd-42dd-8354-6df34fc21ce8 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:16.334163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f166064-9fbd-42dd-8354-6df34fc21ce8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:16.334163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f166064-9fbd-42dd-8354-6df34fc21ce8 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:16.335858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 368/735] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:16.341671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac01f5-efec-448c-b0cf-2dc3e819110b None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:16.342132 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac01f5-efec-448c-b0cf-2dc3e819110b None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:16.342222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac01f5-efec-448c-b0cf-2dc3e819110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:16.364641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-43ac01f5-efec-448c-b0cf-2dc3e819110b None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:16.365794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-43ac01f5-efec-448c-b0cf-2dc3e819110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:16.384634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 368/736] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:16 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:16.408207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f166064-9fbd-42dd-8354-6df34fc21ce8 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:16.420866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f166064-9fbd-42dd-8354-6df34fc21ce8 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:16.425003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30b8a2-8608-4563-8155-bfa3b4c51d7d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9FhJgciKTH6yIA8FF2uwFw, audit_chain_id=['9FhJgciKTH6yIA8FF2uwFw']) at 0x7fe09e17f850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:16.425735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30b8a2-8608-4563-8155-bfa3b4c51d7d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:16.426030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30b8a2-8608-4563-8155-bfa3b4c51d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:16.426316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30b8a2-8608-4563-8155-bfa3b4c51d7d admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:16.426987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30b8a2-8608-4563-8155-bfa3b4c51d7d admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:16.428649 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30b8a2-8608-4563-8155-bfa3b4c51d7d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:16.439965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-be30b8a2-8608-4563-8155-bfa3b4c51d7d admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 18:38:16.441051 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 369/737] 10.222.0.21 () {56 vars in 1150 bytes} [Mon Feb 28 18:38:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:16.447618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac01f5-efec-448c-b0cf-2dc3e819110b None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:16.456376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac01f5-efec-448c-b0cf-2dc3e819110b None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:16.460862 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa42731-1e14-4706-9932-6701871a93b7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9FhJgciKTH6yIA8FF2uwFw, audit_chain_id=['9FhJgciKTH6yIA8FF2uwFw']) at 0x7fe09e15eac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:16.461472 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa42731-1e14-4706-9932-6701871a93b7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:16.461776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa42731-1e14-4706-9932-6701871a93b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:16.462184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa42731-1e14-4706-9932-6701871a93b7 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:16.462768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa42731-1e14-4706-9932-6701871a93b7 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:16.463098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa42731-1e14-4706-9932-6701871a93b7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:16.464754 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa42731-1e14-4706-9932-6701871a93b7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:16.469931 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 369/738] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Feb 28 18:38:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:38:16.475879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30b8a2-8608-4563-8155-bfa3b4c51d7d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:16.485918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30b8a2-8608-4563-8155-bfa3b4c51d7d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:16.490294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b81ed9-438f-44dc-a2cd-f41a19b5ecdd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9FhJgciKTH6yIA8FF2uwFw, audit_chain_id=['9FhJgciKTH6yIA8FF2uwFw']) at 0x7fe09e188fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:16.490887 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b81ed9-438f-44dc-a2cd-f41a19b5ecdd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:16.491220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b81ed9-438f-44dc-a2cd-f41a19b5ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:16.491504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b81ed9-438f-44dc-a2cd-f41a19b5ecdd admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:16.492190 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b81ed9-438f-44dc-a2cd-f41a19b5ecdd admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:16.492486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b81ed9-438f-44dc-a2cd-f41a19b5ecdd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:16.494140 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b81ed9-438f-44dc-a2cd-f41a19b5ecdd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:16.499169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 370/739] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Feb 28 18:38:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:16.505621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa42731-1e14-4706-9932-6701871a93b7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:16.520889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa42731-1e14-4706-9932-6701871a93b7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:16.528136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b61bd7-e8d5-4989-9793-515c071993b7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9FhJgciKTH6yIA8FF2uwFw, audit_chain_id=['9FhJgciKTH6yIA8FF2uwFw']) at 0x7fe09e4f3c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:16.529122 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b61bd7-e8d5-4989-9793-515c071993b7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:16.529622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b61bd7-e8d5-4989-9793-515c071993b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:16.530120 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b61bd7-e8d5-4989-9793-515c071993b7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:16.531489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b61bd7-e8d5-4989-9793-515c071993b7 admin admin] RBAC: Adding query filter params (interface=public, service_id=0ddb0380581d4b84906056d2b69493f2, region_id=RegionOne) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:16.532043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b61bd7-e8d5-4989-9793-515c071993b7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:16.534973 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b61bd7-e8d5-4989-9793-515c071993b7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:16.547619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 370/740] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Feb 28 18:38:16 2022] GET /identity/v3/endpoints?service_id=0ddb0380581d4b84906056d2b69493f2&interface=public®ion_id=RegionOne => generated 194 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:16.553788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b81ed9-438f-44dc-a2cd-f41a19b5ecdd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:16.564631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b81ed9-438f-44dc-a2cd-f41a19b5ecdd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:16.568838 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e50070-8c68-4f80-838e-ad7f3b8affa6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9FhJgciKTH6yIA8FF2uwFw, audit_chain_id=['9FhJgciKTH6yIA8FF2uwFw']) at 0x7fe09e143b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:16.569432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e50070-8c68-4f80-838e-ad7f3b8affa6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:16.569718 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e50070-8c68-4f80-838e-ad7f3b8affa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:16.569998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e50070-8c68-4f80-838e-ad7f3b8affa6 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:16.570651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e50070-8c68-4f80-838e-ad7f3b8affa6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:16.573072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e50070-8c68-4f80-838e-ad7f3b8affa6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:16.578890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 371/741] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:38:16 2022] GET /identity/v3/services => generated 1261 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:38:18.701248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523c40-e060-4ec7-a69c-db9fc4b294ae None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:18.701781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523c40-e060-4ec7-a69c-db9fc4b294ae None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:18.701865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523c40-e060-4ec7-a69c-db9fc4b294ae None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:18.703516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 371/742] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:18.708551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f54c-7789-49e5-ace9-33968726e253 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:18.708971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f54c-7789-49e5-ace9-33968726e253 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:18.709121 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f54c-7789-49e5-ace9-33968726e253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:18.731821 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-0010f54c-7789-49e5-ace9-33968726e253 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:18.732957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-0010f54c-7789-49e5-ace9-33968726e253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:18.739884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 372/743] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:18 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:18.763412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9523c40-e060-4ec7-a69c-db9fc4b294ae None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:18.775161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9523c40-e060-4ec7-a69c-db9fc4b294ae None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:18.779103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21202802-8ac9-491b-8c86-d263a84b33cb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=86uLuyJeTx2YKaxiLk9jng, audit_chain_id=['86uLuyJeTx2YKaxiLk9jng']) at 0x7fe09e1e6d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:18.779856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21202802-8ac9-491b-8c86-d263a84b33cb admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:18.780147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21202802-8ac9-491b-8c86-d263a84b33cb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:18.780428 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21202802-8ac9-491b-8c86-d263a84b33cb admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:18.781048 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21202802-8ac9-491b-8c86-d263a84b33cb admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:18.782624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21202802-8ac9-491b-8c86-d263a84b33cb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:18.793047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-21202802-8ac9-491b-8c86-d263a84b33cb admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 18:38:18.794084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 372/744] 10.222.0.21 () {56 vars in 1150 bytes} [Mon Feb 28 18:38:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:18.799924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f54c-7789-49e5-ace9-33968726e253 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:18.809517 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f54c-7789-49e5-ace9-33968726e253 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:18.813671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c036f-0ccb-4032-bb9f-32b0d44d5e51 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=86uLuyJeTx2YKaxiLk9jng, audit_chain_id=['86uLuyJeTx2YKaxiLk9jng']) at 0x7fe09e1b0760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:18.814254 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c036f-0ccb-4032-bb9f-32b0d44d5e51 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:18.814540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c036f-0ccb-4032-bb9f-32b0d44d5e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:18.814820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c036f-0ccb-4032-bb9f-32b0d44d5e51 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:18.815591 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c036f-0ccb-4032-bb9f-32b0d44d5e51 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:18.815894 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c036f-0ccb-4032-bb9f-32b0d44d5e51 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:18.817463 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c036f-0ccb-4032-bb9f-32b0d44d5e51 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:18.822778 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 373/745] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Feb 28 18:38:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:18.828410 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21202802-8ac9-491b-8c86-d263a84b33cb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:18.837946 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21202802-8ac9-491b-8c86-d263a84b33cb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:18.842317 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd56da4-7362-4afc-8d58-08a0a7ab0ffa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=86uLuyJeTx2YKaxiLk9jng, audit_chain_id=['86uLuyJeTx2YKaxiLk9jng']) at 0x7fe09e155310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:18.842902 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd56da4-7362-4afc-8d58-08a0a7ab0ffa admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:18.843226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd56da4-7362-4afc-8d58-08a0a7ab0ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:18.843512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd56da4-7362-4afc-8d58-08a0a7ab0ffa admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:18.844176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd56da4-7362-4afc-8d58-08a0a7ab0ffa admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:18.844480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd56da4-7362-4afc-8d58-08a0a7ab0ffa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:18.846038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd56da4-7362-4afc-8d58-08a0a7ab0ffa admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:18.850494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 373/746] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Feb 28 18:38:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:18.855847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c036f-0ccb-4032-bb9f-32b0d44d5e51 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:18.865119 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c036f-0ccb-4032-bb9f-32b0d44d5e51 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:18.869885 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ed891-b318-4880-8a9a-bc6659ebbb70 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=86uLuyJeTx2YKaxiLk9jng, audit_chain_id=['86uLuyJeTx2YKaxiLk9jng']) at 0x7fe09e1b0ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:18.870450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ed891-b318-4880-8a9a-bc6659ebbb70 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:18.870736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ed891-b318-4880-8a9a-bc6659ebbb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:18.871016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ed891-b318-4880-8a9a-bc6659ebbb70 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:18.871740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ed891-b318-4880-8a9a-bc6659ebbb70 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:18.873289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ed891-b318-4880-8a9a-bc6659ebbb70 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:18.966592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 374/747] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Feb 28 18:38:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:38:21.077476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbb174-ef43-4388-8f01-72f7ed4a78a8 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:21.077999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbb174-ef43-4388-8f01-72f7ed4a78a8 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:21.078196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbb174-ef43-4388-8f01-72f7ed4a78a8 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:21.079716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 374/748] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:21.084882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270ae56-4e8a-4159-adde-421af60307b2 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:21.085319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270ae56-4e8a-4159-adde-421af60307b2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:21.085455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270ae56-4e8a-4159-adde-421af60307b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:21.108928 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-6270ae56-4e8a-4159-adde-421af60307b2 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:21.110077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-6270ae56-4e8a-4159-adde-421af60307b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:21.126447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 375/749] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:21 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:21.148588 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbb174-ef43-4388-8f01-72f7ed4a78a8 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:21.161105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbb174-ef43-4388-8f01-72f7ed4a78a8 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:21.165685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c67f89-2e49-4296-8e3e-241eeacd1114 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TKlGVrfKSEW7h9RVtyYorA, audit_chain_id=['TKlGVrfKSEW7h9RVtyYorA']) at 0x7fe09e155040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:21.166388 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c67f89-2e49-4296-8e3e-241eeacd1114 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:21.166675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c67f89-2e49-4296-8e3e-241eeacd1114 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:21.166955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c67f89-2e49-4296-8e3e-241eeacd1114 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:21.167611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c67f89-2e49-4296-8e3e-241eeacd1114 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:21.169168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c67f89-2e49-4296-8e3e-241eeacd1114 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:21.179209 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-04c67f89-2e49-4296-8e3e-241eeacd1114 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Feb 28 18:38:21.180250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 375/750] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:21 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:21.186156 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270ae56-4e8a-4159-adde-421af60307b2 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:21.194800 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270ae56-4e8a-4159-adde-421af60307b2 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:21.199162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a21385-4ae5-4f56-8ec5-15a65b1ee938 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TKlGVrfKSEW7h9RVtyYorA, audit_chain_id=['TKlGVrfKSEW7h9RVtyYorA']) at 0x7fe09e3eb910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:21.199745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a21385-4ae5-4f56-8ec5-15a65b1ee938 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:21.200030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a21385-4ae5-4f56-8ec5-15a65b1ee938 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:21.200308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a21385-4ae5-4f56-8ec5-15a65b1ee938 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:21.200976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a21385-4ae5-4f56-8ec5-15a65b1ee938 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:21.201273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a21385-4ae5-4f56-8ec5-15a65b1ee938 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:21.202862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a21385-4ae5-4f56-8ec5-15a65b1ee938 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:21.207315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 376/751] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:21 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:21.213397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c67f89-2e49-4296-8e3e-241eeacd1114 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:21.223285 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c67f89-2e49-4296-8e3e-241eeacd1114 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:21.228023 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a28c01-d7bf-47dd-bdf1-e41a5598c261 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TKlGVrfKSEW7h9RVtyYorA, audit_chain_id=['TKlGVrfKSEW7h9RVtyYorA']) at 0x7fe09e118400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:21.228634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28c01-d7bf-47dd-bdf1-e41a5598c261 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:21.228888 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28c01-d7bf-47dd-bdf1-e41a5598c261 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:21.229172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28c01-d7bf-47dd-bdf1-e41a5598c261 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:21.229920 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a28c01-d7bf-47dd-bdf1-e41a5598c261 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:21.230222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a28c01-d7bf-47dd-bdf1-e41a5598c261 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:21.231809 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a28c01-d7bf-47dd-bdf1-e41a5598c261 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:21.235993 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 376/752] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:21 2022] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:38:23.334156 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579f2f9-c11d-455e-9447-25e8f297898f None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:23.334658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579f2f9-c11d-455e-9447-25e8f297898f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:23.334658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579f2f9-c11d-455e-9447-25e8f297898f None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:23.336333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 377/753] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:23.342288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc1635-6409-43ab-bc1f-ad6ad676f094 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:23.342729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc1635-6409-43ab-bc1f-ad6ad676f094 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:23.342857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc1635-6409-43ab-bc1f-ad6ad676f094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:23.365085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a4cc1635-6409-43ab-bc1f-ad6ad676f094 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:23.366220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a4cc1635-6409-43ab-bc1f-ad6ad676f094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:23.373301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 377/754] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:23 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:23.395395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579f2f9-c11d-455e-9447-25e8f297898f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:23.407799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579f2f9-c11d-455e-9447-25e8f297898f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:23.411739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52514599-b197-4161-b8cf-7525a37c7f32 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=w22D4LtlQ_Wpj_S2FDA_0g, audit_chain_id=['w22D4LtlQ_Wpj_S2FDA_0g']) at 0x7fe09e188730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:23.412314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514599-b197-4161-b8cf-7525a37c7f32 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:23.412598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514599-b197-4161-b8cf-7525a37c7f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:23.412876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514599-b197-4161-b8cf-7525a37c7f32 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:23.413565 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52514599-b197-4161-b8cf-7525a37c7f32 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:23.415736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52514599-b197-4161-b8cf-7525a37c7f32 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:23.494492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 378/755] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:38:23 2022] POST /identity/v3/services => generated 251 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:38:25.611936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaae40-944d-4e10-a37a-da8f246acc61 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:25.612465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaae40-944d-4e10-a37a-da8f246acc61 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:25.612551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaae40-944d-4e10-a37a-da8f246acc61 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:25.614181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 378/756] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:25.619726 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fa70e-8566-4ba3-bef9-3ab75b0cf8aa None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:25.620166 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fa70e-8566-4ba3-bef9-3ab75b0cf8aa None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:25.620301 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fa70e-8566-4ba3-bef9-3ab75b0cf8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:25.642599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-835fa70e-8566-4ba3-bef9-3ab75b0cf8aa None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:25.643769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-835fa70e-8566-4ba3-bef9-3ab75b0cf8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:25.660867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 379/757] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:25 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:25.683636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaae40-944d-4e10-a37a-da8f246acc61 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:25.695228 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaae40-944d-4e10-a37a-da8f246acc61 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:25.699465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f126173-58ba-47f7-acf2-b21bbc8807c5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N0Dq05vwR9yJrHr0p06JjQ, audit_chain_id=['N0Dq05vwR9yJrHr0p06JjQ']) at 0x7fe09e1c07c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:25.700180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f126173-58ba-47f7-acf2-b21bbc8807c5 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:25.700468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f126173-58ba-47f7-acf2-b21bbc8807c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:25.700751 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f126173-58ba-47f7-acf2-b21bbc8807c5 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:25.701370 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f126173-58ba-47f7-acf2-b21bbc8807c5 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:25.702941 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f126173-58ba-47f7-acf2-b21bbc8807c5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:25.713692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-1f126173-58ba-47f7-acf2-b21bbc8807c5 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Feb 28 18:38:25.714729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 379/758] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:25 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:25.721174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fa70e-8566-4ba3-bef9-3ab75b0cf8aa None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:25.731307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fa70e-8566-4ba3-bef9-3ab75b0cf8aa None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:25.735601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458889b5-9b0d-4e21-9dbe-6b8b8208a4fc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N0Dq05vwR9yJrHr0p06JjQ, audit_chain_id=['N0Dq05vwR9yJrHr0p06JjQ']) at 0x7fe09e8f9fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:25.736200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458889b5-9b0d-4e21-9dbe-6b8b8208a4fc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:25.736494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458889b5-9b0d-4e21-9dbe-6b8b8208a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:25.736783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458889b5-9b0d-4e21-9dbe-6b8b8208a4fc admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:25.737463 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458889b5-9b0d-4e21-9dbe-6b8b8208a4fc admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:25.737761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458889b5-9b0d-4e21-9dbe-6b8b8208a4fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:25.739403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458889b5-9b0d-4e21-9dbe-6b8b8208a4fc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:25.744774 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 380/759] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:25 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:25.750572 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f126173-58ba-47f7-acf2-b21bbc8807c5 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:25.759999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f126173-58ba-47f7-acf2-b21bbc8807c5 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:25.764120 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aad4f6-80df-493f-aac8-da0b6184de64 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N0Dq05vwR9yJrHr0p06JjQ, audit_chain_id=['N0Dq05vwR9yJrHr0p06JjQ']) at 0x7fe09e1188b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:25.764703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aad4f6-80df-493f-aac8-da0b6184de64 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:25.764990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aad4f6-80df-493f-aac8-da0b6184de64 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:25.765270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aad4f6-80df-493f-aac8-da0b6184de64 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:25.765930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aad4f6-80df-493f-aac8-da0b6184de64 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:25.766231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aad4f6-80df-493f-aac8-da0b6184de64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:25.767813 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aad4f6-80df-493f-aac8-da0b6184de64 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:25.772434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 380/760] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:25 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:25.778456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458889b5-9b0d-4e21-9dbe-6b8b8208a4fc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:25.787666 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458889b5-9b0d-4e21-9dbe-6b8b8208a4fc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:25.792769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea617160-d51d-4148-a936-ad4e22cd224a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N0Dq05vwR9yJrHr0p06JjQ, audit_chain_id=['N0Dq05vwR9yJrHr0p06JjQ']) at 0x7fe09e3f32b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:25.793344 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617160-d51d-4148-a936-ad4e22cd224a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:25.793631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617160-d51d-4148-a936-ad4e22cd224a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:25.793909 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617160-d51d-4148-a936-ad4e22cd224a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:25.794647 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea617160-d51d-4148-a936-ad4e22cd224a admin admin] RBAC: Adding query filter params (interface=public, service_id=25056defefec492081f7146f37a3d616, region_id=RegionOne) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:25.794951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea617160-d51d-4148-a936-ad4e22cd224a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:25.796557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea617160-d51d-4148-a936-ad4e22cd224a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:25.801598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 381/761] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Feb 28 18:38:25 2022] GET /identity/v3/endpoints?service_id=25056defefec492081f7146f37a3d616&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:25.807083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aad4f6-80df-493f-aac8-da0b6184de64 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:25.816212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aad4f6-80df-493f-aac8-da0b6184de64 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:25.820401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6b1a1-d2bc-4eec-a9eb-c1dd6c6727d3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N0Dq05vwR9yJrHr0p06JjQ, audit_chain_id=['N0Dq05vwR9yJrHr0p06JjQ']) at 0x7fe09e183a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:25.821192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6b1a1-d2bc-4eec-a9eb-c1dd6c6727d3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:25.821712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6b1a1-d2bc-4eec-a9eb-c1dd6c6727d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:25.822035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6b1a1-d2bc-4eec-a9eb-c1dd6c6727d3 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:25.822618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6b1a1-d2bc-4eec-a9eb-c1dd6c6727d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:25.824196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6b1a1-d2bc-4eec-a9eb-c1dd6c6727d3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:25.830110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 381/762] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:38:25 2022] GET /identity/v3/services => generated 1500 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:38:27.963717 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe37529-a043-448c-b9c7-ab3ad166ac1e None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:27.964194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe37529-a043-448c-b9c7-ab3ad166ac1e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:27.964299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe37529-a043-448c-b9c7-ab3ad166ac1e None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:27.966252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 382/763] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:27.971535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe3c8c-3169-4e6f-b2f2-69285d6a187d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:27.971934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe3c8c-3169-4e6f-b2f2-69285d6a187d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:27.972115 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe3c8c-3169-4e6f-b2f2-69285d6a187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:27.995251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-abfe3c8c-3169-4e6f-b2f2-69285d6a187d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:27.996383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-abfe3c8c-3169-4e6f-b2f2-69285d6a187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:28.003374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 382/764] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:27 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:28.026354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe37529-a043-448c-b9c7-ab3ad166ac1e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:28.038022 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe37529-a043-448c-b9c7-ab3ad166ac1e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:28.042292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39152eed-2c5b-4eaa-8208-7121a32ad20d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-sJJjT6sTlOffrCy0GGNjg, audit_chain_id=['-sJJjT6sTlOffrCy0GGNjg']) at 0x7fe09e188940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:28.043058 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39152eed-2c5b-4eaa-8208-7121a32ad20d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:28.043378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39152eed-2c5b-4eaa-8208-7121a32ad20d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:28.043660 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39152eed-2c5b-4eaa-8208-7121a32ad20d admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:28.044275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39152eed-2c5b-4eaa-8208-7121a32ad20d admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:28.045862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39152eed-2c5b-4eaa-8208-7121a32ad20d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:28.056957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-39152eed-2c5b-4eaa-8208-7121a32ad20d admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Feb 28 18:38:28.057992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 383/765] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:28 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:28.064161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe3c8c-3169-4e6f-b2f2-69285d6a187d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:28.073423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe3c8c-3169-4e6f-b2f2-69285d6a187d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:28.077598 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465daa19-877e-4a07-beb5-3e5fa644390b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-sJJjT6sTlOffrCy0GGNjg, audit_chain_id=['-sJJjT6sTlOffrCy0GGNjg']) at 0x7fe09e1e68b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:28.078189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465daa19-877e-4a07-beb5-3e5fa644390b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:28.078479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465daa19-877e-4a07-beb5-3e5fa644390b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:28.078762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465daa19-877e-4a07-beb5-3e5fa644390b admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:28.079467 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465daa19-877e-4a07-beb5-3e5fa644390b admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:28.079770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465daa19-877e-4a07-beb5-3e5fa644390b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:28.081353 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465daa19-877e-4a07-beb5-3e5fa644390b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:28.086196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 383/766] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:28 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:28.091889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39152eed-2c5b-4eaa-8208-7121a32ad20d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:28.101173 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39152eed-2c5b-4eaa-8208-7121a32ad20d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:28.106048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbfb63-40a6-47a9-bca2-edb054290804 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-sJJjT6sTlOffrCy0GGNjg, audit_chain_id=['-sJJjT6sTlOffrCy0GGNjg']) at 0x7fe09e198280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:28.106624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfb63-40a6-47a9-bca2-edb054290804 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:28.106907 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfb63-40a6-47a9-bca2-edb054290804 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:28.107221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfb63-40a6-47a9-bca2-edb054290804 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:28.107879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbfb63-40a6-47a9-bca2-edb054290804 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:28.108176 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbfb63-40a6-47a9-bca2-edb054290804 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:28.109735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbfb63-40a6-47a9-bca2-edb054290804 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:28.114251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 384/767] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:28 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:28.120403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465daa19-877e-4a07-beb5-3e5fa644390b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:28.129423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465daa19-877e-4a07-beb5-3e5fa644390b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:28.133492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860cce6-e181-4e1a-bff2-a1206b9a908e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-sJJjT6sTlOffrCy0GGNjg, audit_chain_id=['-sJJjT6sTlOffrCy0GGNjg']) at 0x7fe09e212b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:28.134142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860cce6-e181-4e1a-bff2-a1206b9a908e admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:28.134432 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860cce6-e181-4e1a-bff2-a1206b9a908e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:28.134713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860cce6-e181-4e1a-bff2-a1206b9a908e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:28.135437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860cce6-e181-4e1a-bff2-a1206b9a908e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:28.136975 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860cce6-e181-4e1a-bff2-a1206b9a908e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:28.207673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 384/768] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Feb 28 18:38:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:38:30.350917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35259924-58e0-4314-ba29-848ec7bb80bf None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:30.351476 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35259924-58e0-4314-ba29-848ec7bb80bf None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:30.351476 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35259924-58e0-4314-ba29-848ec7bb80bf None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:30.353646 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 385/769] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:30.359037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5e8a7-f519-48b2-b735-59d4ef371464 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:30.359451 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5e8a7-f519-48b2-b735-59d4ef371464 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:30.359650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5e8a7-f519-48b2-b735-59d4ef371464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:30.381237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-0af5e8a7-f519-48b2-b735-59d4ef371464 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:30.382376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0af5e8a7-f519-48b2-b735-59d4ef371464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:30.399852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 385/770] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:30 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:30.421879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35259924-58e0-4314-ba29-848ec7bb80bf None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:30.434985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35259924-58e0-4314-ba29-848ec7bb80bf None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:30.439053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebc717-000f-4975-abef-2b228cd114b0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=40X8Pb0_R_CThgrQfuZ5Ag, audit_chain_id=['40X8Pb0_R_CThgrQfuZ5Ag']) at 0x7fe09e198130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:30.439796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebc717-000f-4975-abef-2b228cd114b0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:30.440087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebc717-000f-4975-abef-2b228cd114b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:30.440373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebc717-000f-4975-abef-2b228cd114b0 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:30.440997 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebc717-000f-4975-abef-2b228cd114b0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:30.442593 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebc717-000f-4975-abef-2b228cd114b0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:30.453744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-10ebc717-000f-4975-abef-2b228cd114b0 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 18:38:30.454794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 386/771] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:30.460717 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5e8a7-f519-48b2-b735-59d4ef371464 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:30.470599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5e8a7-f519-48b2-b735-59d4ef371464 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:30.474948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a2d55-468e-475b-9f49-5a7615d9cc88 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=40X8Pb0_R_CThgrQfuZ5Ag, audit_chain_id=['40X8Pb0_R_CThgrQfuZ5Ag']) at 0x7fe09e14ad00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:30.475574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a2d55-468e-475b-9f49-5a7615d9cc88 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:30.475864 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a2d55-468e-475b-9f49-5a7615d9cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:30.476143 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a2d55-468e-475b-9f49-5a7615d9cc88 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:30.476810 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a2d55-468e-475b-9f49-5a7615d9cc88 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:30.477155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a2d55-468e-475b-9f49-5a7615d9cc88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:30.479030 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a2d55-468e-475b-9f49-5a7615d9cc88 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:30.483742 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 386/772] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:30.489522 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebc717-000f-4975-abef-2b228cd114b0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:30.501477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebc717-000f-4975-abef-2b228cd114b0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:30.506045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281514b-e9be-492f-9ba8-a0e19652bc40 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=40X8Pb0_R_CThgrQfuZ5Ag, audit_chain_id=['40X8Pb0_R_CThgrQfuZ5Ag']) at 0x7fe09e15bb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:30.506626 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281514b-e9be-492f-9ba8-a0e19652bc40 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:30.506911 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281514b-e9be-492f-9ba8-a0e19652bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:30.507230 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281514b-e9be-492f-9ba8-a0e19652bc40 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:30.507905 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281514b-e9be-492f-9ba8-a0e19652bc40 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:30.508734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281514b-e9be-492f-9ba8-a0e19652bc40 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:30.510783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281514b-e9be-492f-9ba8-a0e19652bc40 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:30.515017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 387/773] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:32.631080 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe75c-3683-40b1-bb86-06d937fe3f39 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:32.631651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe75c-3683-40b1-bb86-06d937fe3f39 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:32.631744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbe75c-3683-40b1-bb86-06d937fe3f39 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:32.633991 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 387/774] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:32.639279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5191030-91fb-4470-901b-0b9ca0086dfe None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:32.639680 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5191030-91fb-4470-901b-0b9ca0086dfe None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:32.639851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5191030-91fb-4470-901b-0b9ca0086dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:32.662105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e5191030-91fb-4470-901b-0b9ca0086dfe None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:32.663286 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e5191030-91fb-4470-901b-0b9ca0086dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:32.670395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 388/775] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:32 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:32.693171 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbe75c-3683-40b1-bb86-06d937fe3f39 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:32.705977 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbe75c-3683-40b1-bb86-06d937fe3f39 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:32.709964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fc874-14f1-437b-8c92-ffb295fddece admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2liMsO6OSP-DLR4eDyETzw, audit_chain_id=['2liMsO6OSP-DLR4eDyETzw']) at 0x7fe09e4ef340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:32.710555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fc874-14f1-437b-8c92-ffb295fddece admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:32.710847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fc874-14f1-437b-8c92-ffb295fddece admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:32.711154 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fc874-14f1-437b-8c92-ffb295fddece admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:32.712876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fc874-14f1-437b-8c92-ffb295fddece admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:32.714469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fc874-14f1-437b-8c92-ffb295fddece admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:32.799665 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 388/776] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:38:32 2022] POST /identity/v3/services => generated 251 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:38:34.893776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6289d-b429-464d-8e0e-e29fcf8b104f None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:34.894329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6289d-b429-464d-8e0e-e29fcf8b104f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:34.894329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6289d-b429-464d-8e0e-e29fcf8b104f None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:34.896062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 389/777] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:34.901430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d4f4-ee28-42b5-89a0-d274eddb1f09 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:34.901814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d4f4-ee28-42b5-89a0-d274eddb1f09 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:34.902002 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d4f4-ee28-42b5-89a0-d274eddb1f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:34.924018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-5bb8d4f4-ee28-42b5-89a0-d274eddb1f09 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:34.925150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-5bb8d4f4-ee28-42b5-89a0-d274eddb1f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:34.942360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 389/778] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:34 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:34.964986 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6289d-b429-464d-8e0e-e29fcf8b104f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:34.977594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6289d-b429-464d-8e0e-e29fcf8b104f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:34.981759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9644241-feb1-4713-a6aa-20680424e0d6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=90wB1ZzLRMajwZTmEqcVww, audit_chain_id=['90wB1ZzLRMajwZTmEqcVww']) at 0x7fe09e3e7340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:34.982467 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9644241-feb1-4713-a6aa-20680424e0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:34.982751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9644241-feb1-4713-a6aa-20680424e0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:34.983031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9644241-feb1-4713-a6aa-20680424e0d6 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:34.983677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9644241-feb1-4713-a6aa-20680424e0d6 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:34.985246 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9644241-feb1-4713-a6aa-20680424e0d6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:34.996088 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-b9644241-feb1-4713-a6aa-20680424e0d6 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 18:38:34.997104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 390/779] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:35.003027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8d4f4-ee28-42b5-89a0-d274eddb1f09 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:35.011746 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8d4f4-ee28-42b5-89a0-d274eddb1f09 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:35.015843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d0e9b-9032-4e39-bd3b-123698800112 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=90wB1ZzLRMajwZTmEqcVww, audit_chain_id=['90wB1ZzLRMajwZTmEqcVww']) at 0x7fe09e155c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:35.016425 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0e9b-9032-4e39-bd3b-123698800112 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:35.016711 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0e9b-9032-4e39-bd3b-123698800112 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:35.016991 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0e9b-9032-4e39-bd3b-123698800112 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:35.017657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d0e9b-9032-4e39-bd3b-123698800112 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:35.017953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d0e9b-9032-4e39-bd3b-123698800112 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:35.019552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d0e9b-9032-4e39-bd3b-123698800112 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:35.024101 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 390/780] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:38:35.029573 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9644241-feb1-4713-a6aa-20680424e0d6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:35.038876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9644241-feb1-4713-a6aa-20680424e0d6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:35.043543 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705dca1-9974-43a3-8e2c-e41b051dfe78 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=90wB1ZzLRMajwZTmEqcVww, audit_chain_id=['90wB1ZzLRMajwZTmEqcVww']) at 0x7fe09e143c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:35.044110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705dca1-9974-43a3-8e2c-e41b051dfe78 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:35.044393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705dca1-9974-43a3-8e2c-e41b051dfe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:35.044668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705dca1-9974-43a3-8e2c-e41b051dfe78 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:35.045322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705dca1-9974-43a3-8e2c-e41b051dfe78 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:35.045615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705dca1-9974-43a3-8e2c-e41b051dfe78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:35.047182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705dca1-9974-43a3-8e2c-e41b051dfe78 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:35.051678 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 391/781] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:35.057925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d0e9b-9032-4e39-bd3b-123698800112 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:35.066951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d0e9b-9032-4e39-bd3b-123698800112 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:35.071623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68efc6-dac1-4a6a-b329-5f78bd767ebb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=90wB1ZzLRMajwZTmEqcVww, audit_chain_id=['90wB1ZzLRMajwZTmEqcVww']) at 0x7fe09e14a6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:35.072199 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68efc6-dac1-4a6a-b329-5f78bd767ebb admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:35.072489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68efc6-dac1-4a6a-b329-5f78bd767ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:35.072774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68efc6-dac1-4a6a-b329-5f78bd767ebb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:35.073511 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68efc6-dac1-4a6a-b329-5f78bd767ebb admin admin] RBAC: Adding query filter params (interface=public, service_id=cb2dab2762a24060aa3d49ea6911bc05, region_id=RegionOne) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:35.073823 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68efc6-dac1-4a6a-b329-5f78bd767ebb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:35.075402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68efc6-dac1-4a6a-b329-5f78bd767ebb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:35.080456 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 391/782] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Feb 28 18:38:35 2022] GET /identity/v3/endpoints?service_id=cb2dab2762a24060aa3d49ea6911bc05&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:35.085767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705dca1-9974-43a3-8e2c-e41b051dfe78 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:35.095826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705dca1-9974-43a3-8e2c-e41b051dfe78 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:35.099990 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e74da7-2cf7-4c3d-bcb7-9ba05b61ca98 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=90wB1ZzLRMajwZTmEqcVww, audit_chain_id=['90wB1ZzLRMajwZTmEqcVww']) at 0x7fe09e3c4dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:35.100564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e74da7-2cf7-4c3d-bcb7-9ba05b61ca98 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:35.100851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e74da7-2cf7-4c3d-bcb7-9ba05b61ca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:35.101134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e74da7-2cf7-4c3d-bcb7-9ba05b61ca98 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:35.101813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e74da7-2cf7-4c3d-bcb7-9ba05b61ca98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:35.103542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e74da7-2cf7-4c3d-bcb7-9ba05b61ca98 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:35.109467 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 392/783] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:38:35 2022] GET /identity/v3/services => generated 1739 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:38:37.202413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237db9dc-761c-4789-8703-3d4f098477d5 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:37.202935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237db9dc-761c-4789-8703-3d4f098477d5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:37.203053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237db9dc-761c-4789-8703-3d4f098477d5 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:37.204681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 392/784] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:37.209997 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a78fb0-7992-4ede-be46-c1cdef86c931 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:37.210416 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a78fb0-7992-4ede-be46-c1cdef86c931 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:37.210514 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a78fb0-7992-4ede-be46-c1cdef86c931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:37.233403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-84a78fb0-7992-4ede-be46-c1cdef86c931 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:37.234542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-84a78fb0-7992-4ede-be46-c1cdef86c931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:37.241506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 393/785] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:37 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:37.265198 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237db9dc-761c-4789-8703-3d4f098477d5 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:37.277251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237db9dc-761c-4789-8703-3d4f098477d5 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:37.281306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f764fd-7e8d-486b-a31e-055bbe42fca7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=46HMKXbtRmCxkkUrDK8r3g, audit_chain_id=['46HMKXbtRmCxkkUrDK8r3g']) at 0x7fe09e269970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:37.282034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f764fd-7e8d-486b-a31e-055bbe42fca7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:37.282323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f764fd-7e8d-486b-a31e-055bbe42fca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:37.282605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f764fd-7e8d-486b-a31e-055bbe42fca7 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:37.283257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f764fd-7e8d-486b-a31e-055bbe42fca7 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:37.284826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f764fd-7e8d-486b-a31e-055bbe42fca7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:37.295568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-10f764fd-7e8d-486b-a31e-055bbe42fca7 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 18:38:37.296657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 393/786] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:37.302850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a78fb0-7992-4ede-be46-c1cdef86c931 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:37.314419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a78fb0-7992-4ede-be46-c1cdef86c931 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:37.318832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d2317-75ef-4501-8230-e64478b7b90a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=46HMKXbtRmCxkkUrDK8r3g, audit_chain_id=['46HMKXbtRmCxkkUrDK8r3g']) at 0x7fe09e3f8ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:37.319503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2317-75ef-4501-8230-e64478b7b90a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:37.319796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2317-75ef-4501-8230-e64478b7b90a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:37.320077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2317-75ef-4501-8230-e64478b7b90a admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:37.320814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d2317-75ef-4501-8230-e64478b7b90a admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:37.321116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d2317-75ef-4501-8230-e64478b7b90a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:37.322965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d2317-75ef-4501-8230-e64478b7b90a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:37.328383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 394/787] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:37.334470 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f764fd-7e8d-486b-a31e-055bbe42fca7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:37.345252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f764fd-7e8d-486b-a31e-055bbe42fca7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:37.349666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d490c-6e0f-4b7a-a6f2-3036aabb39a5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=46HMKXbtRmCxkkUrDK8r3g, audit_chain_id=['46HMKXbtRmCxkkUrDK8r3g']) at 0x7fe09e21e250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:37.350286 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d490c-6e0f-4b7a-a6f2-3036aabb39a5 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:37.350582 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d490c-6e0f-4b7a-a6f2-3036aabb39a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:37.350870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d490c-6e0f-4b7a-a6f2-3036aabb39a5 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:37.351600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d490c-6e0f-4b7a-a6f2-3036aabb39a5 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:37.352521 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d490c-6e0f-4b7a-a6f2-3036aabb39a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:37.354735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d490c-6e0f-4b7a-a6f2-3036aabb39a5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:37.360160 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 394/788] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:38:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:38:37.366296 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d2317-75ef-4501-8230-e64478b7b90a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:37.377308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d2317-75ef-4501-8230-e64478b7b90a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:37.381942 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8da623-9537-4089-958e-88268446ddea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=46HMKXbtRmCxkkUrDK8r3g, audit_chain_id=['46HMKXbtRmCxkkUrDK8r3g']) at 0x7fe09e3d1340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:37.382943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da623-9537-4089-958e-88268446ddea admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:37.383516 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da623-9537-4089-958e-88268446ddea admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:37.384034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da623-9537-4089-958e-88268446ddea admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:37.385306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8da623-9537-4089-958e-88268446ddea admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:37.387932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8da623-9537-4089-958e-88268446ddea admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:37.488851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 395/789] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Feb 28 18:38:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:38:39.672814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f4d2-ccc7-4ae6-8ff6-2598d63cd1d7 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:39.673373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f4d2-ccc7-4ae6-8ff6-2598d63cd1d7 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:39.673373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f4d2-ccc7-4ae6-8ff6-2598d63cd1d7 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:39.675060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 395/790] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:38:39.680632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad7f04-5a5f-43fa-9f6e-ca7c646f0a37 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:39.681074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad7f04-5a5f-43fa-9f6e-ca7c646f0a37 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:39.681187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad7f04-5a5f-43fa-9f6e-ca7c646f0a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:39.703856 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c3ad7f04-5a5f-43fa-9f6e-ca7c646f0a37 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:39.705004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c3ad7f04-5a5f-43fa-9f6e-ca7c646f0a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:39.722947 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 396/791] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:39 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:39.746776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1f4d2-ccc7-4ae6-8ff6-2598d63cd1d7 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:39.759337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1f4d2-ccc7-4ae6-8ff6-2598d63cd1d7 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:39.763508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7126a-1e91-4489-a2e7-772899b61875 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XJZOpLI5TR-Dlkjp4yQVmg, audit_chain_id=['XJZOpLI5TR-Dlkjp4yQVmg']) at 0x7fe09e21e160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:39.764100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7126a-1e91-4489-a2e7-772899b61875 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:39.764395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7126a-1e91-4489-a2e7-772899b61875 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:39.764683 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7126a-1e91-4489-a2e7-772899b61875 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:39.765343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7126a-1e91-4489-a2e7-772899b61875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:39.767211 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7126a-1e91-4489-a2e7-772899b61875 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:39.768563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.common [None req-b3e7126a-1e91-4489-a2e7-772899b61875 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 28 18:38:39.813520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.sql.core [None req-b3e7126a-1e91-4489-a2e7-772899b61875 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 28 18:38:39.813520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 28 18:38:39.813520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [parameters: {'id': '09fdecfac6b94b07a1896a07183c0963', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 28 18:38:39.813520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=67132) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Feb 28 18:38:39.827919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-b3e7126a-1e91-4489-a2e7-772899b61875 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 09fdecfac6b94b07a1896a07183c0963.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 09fdecfac6b94b07a1896a07183c0963. Feb 28 18:38:39.829213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 396/792] 10.222.0.21 () {60 vars in 1161 bytes} [Mon Feb 28 18:38:39 2022] POST /identity/v3/projects => generated 262 bytes in 83 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:38:39.835422 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad7f04-5a5f-43fa-9f6e-ca7c646f0a37 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:39.844866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad7f04-5a5f-43fa-9f6e-ca7c646f0a37 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:39.849269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9732588-adea-4f3c-adfb-c137b734b084 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XJZOpLI5TR-Dlkjp4yQVmg, audit_chain_id=['XJZOpLI5TR-Dlkjp4yQVmg']) at 0x7fe09e1f3e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:39.849988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732588-adea-4f3c-adfb-c137b734b084 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:39.850282 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732588-adea-4f3c-adfb-c137b734b084 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:39.850563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732588-adea-4f3c-adfb-c137b734b084 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:39.858779 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9732588-adea-4f3c-adfb-c137b734b084 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:39.860759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9732588-adea-4f3c-adfb-c137b734b084 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:39.875095 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-c9732588-adea-4f3c-adfb-c137b734b084 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:38:39.876192 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 397/793] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:39.882232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7126a-1e91-4489-a2e7-772899b61875 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:39.892960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7126a-1e91-4489-a2e7-772899b61875 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:39.897215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7d2f8-e928-4ecb-a026-de7c91135c52 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XJZOpLI5TR-Dlkjp4yQVmg, audit_chain_id=['XJZOpLI5TR-Dlkjp4yQVmg']) at 0x7fe09e1c0f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:39.897820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7d2f8-e928-4ecb-a026-de7c91135c52 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:39.898111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7d2f8-e928-4ecb-a026-de7c91135c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:39.898401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7d2f8-e928-4ecb-a026-de7c91135c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:39.899248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7d2f8-e928-4ecb-a026-de7c91135c52 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:39.899556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7d2f8-e928-4ecb-a026-de7c91135c52 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:39.901657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7d2f8-e928-4ecb-a026-de7c91135c52 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:39.918177 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 397/794] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:38:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:42.077013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b7787-df6c-422e-a165-a48c31d4bd0b None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:42.077532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b7787-df6c-422e-a165-a48c31d4bd0b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:42.077615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b7787-df6c-422e-a165-a48c31d4bd0b None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:42.079258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 398/795] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:42.084640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b23ede-8fe1-4112-9980-576dd2ae7d9d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:42.085009 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b23ede-8fe1-4112-9980-576dd2ae7d9d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:42.085224 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b23ede-8fe1-4112-9980-576dd2ae7d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:42.110605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-15b23ede-8fe1-4112-9980-576dd2ae7d9d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:42.112116 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-15b23ede-8fe1-4112-9980-576dd2ae7d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:42.119418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 398/796] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:42 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:42.143572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b7787-df6c-422e-a165-a48c31d4bd0b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:42.156033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b7787-df6c-422e-a165-a48c31d4bd0b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:42.160139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5977cd3-06ad-4573-956e-c782ec3af8e8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nvPc84W4SWeBCAB48YLqgg, audit_chain_id=['nvPc84W4SWeBCAB48YLqgg']) at 0x7fe09e3e7340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:42.160727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5977cd3-06ad-4573-956e-c782ec3af8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:42.161019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5977cd3-06ad-4573-956e-c782ec3af8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:42.161302 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5977cd3-06ad-4573-956e-c782ec3af8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:42.161946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5977cd3-06ad-4573-956e-c782ec3af8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:42.163813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5977cd3-06ad-4573-956e-c782ec3af8e8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:42.165668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.common [None req-d5977cd3-06ad-4573-956e-c782ec3af8e8 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 28 18:38:42.235981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.sql.core [None req-d5977cd3-06ad-4573-956e-c782ec3af8e8 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 28 18:38:42.235981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 28 18:38:42.235981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [parameters: {'user_id': 'c481989833ac48ee8aa1d28d5e34c800', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 28 18:38:42.235981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=67131) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Feb 28 18:38:42.248671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-d5977cd3-06ad-4573-956e-c782ec3af8e8 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 28 18:38:42.249895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 399/797] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 18:38:42 2022] POST /identity/v3/users => generated 160 bytes in 107 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:42.255878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b23ede-8fe1-4112-9980-576dd2ae7d9d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:42.264724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b23ede-8fe1-4112-9980-576dd2ae7d9d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:42.268940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bfc7f-c012-41be-9236-9615093d2f7f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nvPc84W4SWeBCAB48YLqgg, audit_chain_id=['nvPc84W4SWeBCAB48YLqgg']) at 0x7fe09e123640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:42.274694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bfc7f-c012-41be-9236-9615093d2f7f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:42.274694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bfc7f-c012-41be-9236-9615093d2f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:42.274694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bfc7f-c012-41be-9236-9615093d2f7f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:42.282772 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bfc7f-c012-41be-9236-9615093d2f7f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:42.284793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bfc7f-c012-41be-9236-9615093d2f7f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:42.302274 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-e52bfc7f-c012-41be-9236-9615093d2f7f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 18:38:42.303381 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 399/798] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:38:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:38:42.309471 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5977cd3-06ad-4573-956e-c782ec3af8e8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:42.320548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5977cd3-06ad-4573-956e-c782ec3af8e8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:42.324938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f4b48-c78b-4fe3-a9e3-cb7e60ee5ea0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nvPc84W4SWeBCAB48YLqgg, audit_chain_id=['nvPc84W4SWeBCAB48YLqgg']) at 0x7fe09e1df5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:42.325524 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f4b48-c78b-4fe3-a9e3-cb7e60ee5ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:42.325812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f4b48-c78b-4fe3-a9e3-cb7e60ee5ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:42.326092 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f4b48-c78b-4fe3-a9e3-cb7e60ee5ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:42.326846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f4b48-c78b-4fe3-a9e3-cb7e60ee5ea0 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:42.327202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f4b48-c78b-4fe3-a9e3-cb7e60ee5ea0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:42.329284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f4b48-c78b-4fe3-a9e3-cb7e60ee5ea0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:42.360661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 400/799] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 18:38:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:44.677648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb72a-9236-405d-a4cf-28dcd6d3c231 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:44.678173 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb72a-9236-405d-a4cf-28dcd6d3c231 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:44.678262 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb72a-9236-405d-a4cf-28dcd6d3c231 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:44.680494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 400/800] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:44.685865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f9811-a351-4b77-98f4-6dd24ae51b6f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:44.686299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f9811-a351-4b77-98f4-6dd24ae51b6f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:44.686445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f9811-a351-4b77-98f4-6dd24ae51b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:44.708896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d59f9811-a351-4b77-98f4-6dd24ae51b6f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:44.710382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d59f9811-a351-4b77-98f4-6dd24ae51b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:44.717854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 401/801] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:44 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:44.742020 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cb72a-9236-405d-a4cf-28dcd6d3c231 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:44.754397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cb72a-9236-405d-a4cf-28dcd6d3c231 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:44.758758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77eac5-05f1-4b7d-97a7-c4a3ab031939 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=w-DpKhT4TgGInVtDnDNAcA, audit_chain_id=['w-DpKhT4TgGInVtDnDNAcA']) at 0x7fe09e106ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:44.759493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77eac5-05f1-4b7d-97a7-c4a3ab031939 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:44.759784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77eac5-05f1-4b7d-97a7-c4a3ab031939 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:44.760066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77eac5-05f1-4b7d-97a7-c4a3ab031939 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:44.771614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77eac5-05f1-4b7d-97a7-c4a3ab031939 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:44.773613 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77eac5-05f1-4b7d-97a7-c4a3ab031939 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:44.790612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-0e77eac5-05f1-4b7d-97a7-c4a3ab031939 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:44.791698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 401/802] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:44.797487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f9811-a351-4b77-98f4-6dd24ae51b6f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:44.808358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f9811-a351-4b77-98f4-6dd24ae51b6f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:44.812595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b1db6-5042-4c98-a9da-a6d29307b735 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=w-DpKhT4TgGInVtDnDNAcA, audit_chain_id=['w-DpKhT4TgGInVtDnDNAcA']) at 0x7fe09e3e9c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:44.813185 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b1db6-5042-4c98-a9da-a6d29307b735 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:44.813477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b1db6-5042-4c98-a9da-a6d29307b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:44.813759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b1db6-5042-4c98-a9da-a6d29307b735 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:44.814442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b1db6-5042-4c98-a9da-a6d29307b735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:44.814738 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b1db6-5042-4c98-a9da-a6d29307b735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:44.816347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b1db6-5042-4c98-a9da-a6d29307b735 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:44.828897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 402/803] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:44.834466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77eac5-05f1-4b7d-97a7-c4a3ab031939 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:44.844754 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77eac5-05f1-4b7d-97a7-c4a3ab031939 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:44.848982 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f95257-83ac-4877-ac8e-6f0b73960c5c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=w-DpKhT4TgGInVtDnDNAcA, audit_chain_id=['w-DpKhT4TgGInVtDnDNAcA']) at 0x7fe09e123f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:44.849574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95257-83ac-4877-ac8e-6f0b73960c5c admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:44.849866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95257-83ac-4877-ac8e-6f0b73960c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:44.850150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95257-83ac-4877-ac8e-6f0b73960c5c admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:44.850803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f95257-83ac-4877-ac8e-6f0b73960c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:44.853921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f95257-83ac-4877-ac8e-6f0b73960c5c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:44.948208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 402/804] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:38:44 2022] POST /identity/v3/users => generated 249 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:38:47.091485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e733d-c50a-4be6-bc81-7553b7458977 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.092089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e733d-c50a-4be6-bc81-7553b7458977 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.092089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e733d-c50a-4be6-bc81-7553b7458977 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.093815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 403/805] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:47.099753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb173f07-3357-4a22-8066-a1760065cc7d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.100195 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb173f07-3357-4a22-8066-a1760065cc7d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.100405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb173f07-3357-4a22-8066-a1760065cc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.127468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-fb173f07-3357-4a22-8066-a1760065cc7d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:47.128617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-fb173f07-3357-4a22-8066-a1760065cc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:47.135684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 403/806] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:47 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:47.164243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e733d-c50a-4be6-bc81-7553b7458977 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.176107 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e733d-c50a-4be6-bc81-7553b7458977 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.180995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7dee9-32f4-455f-a663-47e2c5c0dcc2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e3e9400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.181719 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7dee9-32f4-455f-a663-47e2c5c0dcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.182011 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7dee9-32f4-455f-a663-47e2c5c0dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.182296 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7dee9-32f4-455f-a663-47e2c5c0dcc2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.193664 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7dee9-32f4-455f-a663-47e2c5c0dcc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:38:47.200545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-c3c7dee9-32f4-455f-a663-47e2c5c0dcc2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:38:47.201663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 404/807] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:47.209050 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb173f07-3357-4a22-8066-a1760065cc7d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.219453 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb173f07-3357-4a22-8066-a1760065cc7d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.228770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd07ad3-ccbb-49c6-be34-aebde0690890 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e1e6940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.229368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd07ad3-ccbb-49c6-be34-aebde0690890 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.229658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd07ad3-ccbb-49c6-be34-aebde0690890 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.229941 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd07ad3-ccbb-49c6-be34-aebde0690890 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.230650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd07ad3-ccbb-49c6-be34-aebde0690890 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:47.230948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd07ad3-ccbb-49c6-be34-aebde0690890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:47.232606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd07ad3-ccbb-49c6-be34-aebde0690890 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:47.243751 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 404/808] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:47.249632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7dee9-32f4-455f-a663-47e2c5c0dcc2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.261358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7dee9-32f4-455f-a663-47e2c5c0dcc2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.265422 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50141ab-113c-4e1a-9ba2-cce6bd1873dc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e3ebb50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.266138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50141ab-113c-4e1a-9ba2-cce6bd1873dc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.266424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50141ab-113c-4e1a-9ba2-cce6bd1873dc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.266704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50141ab-113c-4e1a-9ba2-cce6bd1873dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.278842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50141ab-113c-4e1a-9ba2-cce6bd1873dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:47.280709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50141ab-113c-4e1a-9ba2-cce6bd1873dc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:47.297499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-d50141ab-113c-4e1a-9ba2-cce6bd1873dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:47.298589 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 405/809] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:47.306015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd07ad3-ccbb-49c6-be34-aebde0690890 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.315560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd07ad3-ccbb-49c6-be34-aebde0690890 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.319743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803739a-2fb3-410c-86a4-0b1019efc5bc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e705610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.320962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803739a-2fb3-410c-86a4-0b1019efc5bc admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.321252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803739a-2fb3-410c-86a4-0b1019efc5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.321723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803739a-2fb3-410c-86a4-0b1019efc5bc admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.322659 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803739a-2fb3-410c-86a4-0b1019efc5bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:47.323824 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803739a-2fb3-410c-86a4-0b1019efc5bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:47.324678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803739a-2fb3-410c-86a4-0b1019efc5bc admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:47.341836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 405/810] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:47.345203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50141ab-113c-4e1a-9ba2-cce6bd1873dc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.355338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50141ab-113c-4e1a-9ba2-cce6bd1873dc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.360576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bf3fe-da18-4e53-875a-6ae854182bd4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e1df5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.361494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf3fe-da18-4e53-875a-6ae854182bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.361984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf3fe-da18-4e53-875a-6ae854182bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.362445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf3fe-da18-4e53-875a-6ae854182bd4 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.380334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bf3fe-da18-4e53-875a-6ae854182bd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:47.382350 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bf3fe-da18-4e53-875a-6ae854182bd4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:47.403530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-da3bf3fe-da18-4e53-875a-6ae854182bd4 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 18:38:47.405230 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 406/811] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:38:47.410998 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803739a-2fb3-410c-86a4-0b1019efc5bc admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.421179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803739a-2fb3-410c-86a4-0b1019efc5bc admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.425623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f086c60-7fe7-4ccc-9f55-7c0fb7a1dd08 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e21e100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.426232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f086c60-7fe7-4ccc-9f55-7c0fb7a1dd08 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.426523 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f086c60-7fe7-4ccc-9f55-7c0fb7a1dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.426810 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f086c60-7fe7-4ccc-9f55-7c0fb7a1dd08 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.427646 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f086c60-7fe7-4ccc-9f55-7c0fb7a1dd08 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:47.427952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f086c60-7fe7-4ccc-9f55-7c0fb7a1dd08 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:47.430763 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f086c60-7fe7-4ccc-9f55-7c0fb7a1dd08 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:47.462651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 406/812] 10.222.0.21 () {56 vars in 1160 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:47.468767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bf3fe-da18-4e53-875a-6ae854182bd4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.479010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bf3fe-da18-4e53-875a-6ae854182bd4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.483157 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4066ae-cd6b-47f1-8431-47a85f623288 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e1c8e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.483727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4066ae-cd6b-47f1-8431-47a85f623288 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.484011 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4066ae-cd6b-47f1-8431-47a85f623288 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.484287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4066ae-cd6b-47f1-8431-47a85f623288 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.496548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4066ae-cd6b-47f1-8431-47a85f623288 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:47.498289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4066ae-cd6b-47f1-8431-47a85f623288 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:47.507400 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 407/813] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:38:47.513749 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f086c60-7fe7-4ccc-9f55-7c0fb7a1dd08 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.524874 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f086c60-7fe7-4ccc-9f55-7c0fb7a1dd08 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.530393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb74a9c-2576-472e-97c4-7b9ffc600b72 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e1dd7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.532010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb74a9c-2576-472e-97c4-7b9ffc600b72 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.532315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb74a9c-2576-472e-97c4-7b9ffc600b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.533353 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb74a9c-2576-472e-97c4-7b9ffc600b72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.545981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb74a9c-2576-472e-97c4-7b9ffc600b72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:47.547836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb74a9c-2576-472e-97c4-7b9ffc600b72 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:47.567374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-7bb74a9c-2576-472e-97c4-7b9ffc600b72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:47.568508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 407/814] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:47.575038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4066ae-cd6b-47f1-8431-47a85f623288 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.585625 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4066ae-cd6b-47f1-8431-47a85f623288 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.590333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb6b7f-ee92-4d64-ae99-26216e591442 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e1b0d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.590918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6b7f-ee92-4d64-ae99-26216e591442 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.591238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6b7f-ee92-4d64-ae99-26216e591442 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.591518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6b7f-ee92-4d64-ae99-26216e591442 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.592210 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb6b7f-ee92-4d64-ae99-26216e591442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:47.592505 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb6b7f-ee92-4d64-ae99-26216e591442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:47.594186 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb6b7f-ee92-4d64-ae99-26216e591442 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:47.610782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 408/815] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:47.616622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb74a9c-2576-472e-97c4-7b9ffc600b72 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.626929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb74a9c-2576-472e-97c4-7b9ffc600b72 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.631067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e28f5-973a-448a-ad7b-56c1c165e17c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e1834f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.631813 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e28f5-973a-448a-ad7b-56c1c165e17c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.632101 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e28f5-973a-448a-ad7b-56c1c165e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.632392 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e28f5-973a-448a-ad7b-56c1c165e17c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.640814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e28f5-973a-448a-ad7b-56c1c165e17c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:47.642753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e28f5-973a-448a-ad7b-56c1c165e17c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:47.656293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-bd8e28f5-973a-448a-ad7b-56c1c165e17c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:38:47.657385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 408/816] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:47.663227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb6b7f-ee92-4d64-ae99-26216e591442 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.673424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb6b7f-ee92-4d64-ae99-26216e591442 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.677790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebfc01-575e-4455-82e8-e65b4e469b9a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e1b0f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.678371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebfc01-575e-4455-82e8-e65b4e469b9a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.678657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebfc01-575e-4455-82e8-e65b4e469b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.678937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebfc01-575e-4455-82e8-e65b4e469b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.680267 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebfc01-575e-4455-82e8-e65b4e469b9a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:47.680638 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebfc01-575e-4455-82e8-e65b4e469b9a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:47.682389 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebfc01-575e-4455-82e8-e65b4e469b9a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:47.694986 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 409/817] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:47.700947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e28f5-973a-448a-ad7b-56c1c165e17c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:47.710176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e28f5-973a-448a-ad7b-56c1c165e17c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:47.714341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bbc0d-1404-4c2e-8369-081970ec0605 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rPnFK_sHRAqQgG2Yqo4NEQ, audit_chain_id=['rPnFK_sHRAqQgG2Yqo4NEQ']) at 0x7fe09e123940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:47.715262 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bbc0d-1404-4c2e-8369-081970ec0605 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:47.715531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bbc0d-1404-4c2e-8369-081970ec0605 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:47.715814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bbc0d-1404-4c2e-8369-081970ec0605 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:47.716582 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bbc0d-1404-4c2e-8369-081970ec0605 admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=65a9c92fb5144e3dacc922eede1131fd) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:47.716888 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bbc0d-1404-4c2e-8369-081970ec0605 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:47.718710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bbc0d-1404-4c2e-8369-081970ec0605 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:47.723927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 409/818] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:38:47 2022] GET /identity/v3/role_assignments?user.id=65a9c92fb5144e3dacc922eede1131fd&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:49.843747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48085c-c8e3-4c62-b6b6-42002fe00dbc None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:49.844308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48085c-c8e3-4c62-b6b6-42002fe00dbc None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:49.844308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48085c-c8e3-4c62-b6b6-42002fe00dbc None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:49.845994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 410/819] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:49.851991 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97076f82-2972-43a9-a8a2-a11c525daf3e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:49.852506 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97076f82-2972-43a9-a8a2-a11c525daf3e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:49.852610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97076f82-2972-43a9-a8a2-a11c525daf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:49.874356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-97076f82-2972-43a9-a8a2-a11c525daf3e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:49.875536 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-97076f82-2972-43a9-a8a2-a11c525daf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:49.882360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 410/820] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:49 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:49.907336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48085c-c8e3-4c62-b6b6-42002fe00dbc None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:49.920228 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48085c-c8e3-4c62-b6b6-42002fe00dbc None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:49.924355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb86ed9-e759-4d66-a085-8d32a5087af3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K0SYammlQ0KOSstsZqkN_Q, audit_chain_id=['K0SYammlQ0KOSstsZqkN_Q']) at 0x7fe09e3dcfd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:49.925071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb86ed9-e759-4d66-a085-8d32a5087af3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:49.925361 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb86ed9-e759-4d66-a085-8d32a5087af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:49.925646 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb86ed9-e759-4d66-a085-8d32a5087af3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:49.937865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb86ed9-e759-4d66-a085-8d32a5087af3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:38:49.944266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-2cb86ed9-e759-4d66-a085-8d32a5087af3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:38:49.946034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 411/821] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:38:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:49.951878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97076f82-2972-43a9-a8a2-a11c525daf3e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:49.960797 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97076f82-2972-43a9-a8a2-a11c525daf3e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:49.965252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba18057-f304-4ec8-8759-86032fbf70cb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K0SYammlQ0KOSstsZqkN_Q, audit_chain_id=['K0SYammlQ0KOSstsZqkN_Q']) at 0x7fe09e269d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:49.965851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba18057-f304-4ec8-8759-86032fbf70cb admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:49.966142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba18057-f304-4ec8-8759-86032fbf70cb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:49.966445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba18057-f304-4ec8-8759-86032fbf70cb admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:49.967178 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba18057-f304-4ec8-8759-86032fbf70cb admin admin] RBAC: Adding query filter params (name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:49.967484 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba18057-f304-4ec8-8759-86032fbf70cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:49.969133 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba18057-f304-4ec8-8759-86032fbf70cb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:49.977806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 411/822] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:38:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:49.983312 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb86ed9-e759-4d66-a085-8d32a5087af3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:49.994299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb86ed9-e759-4d66-a085-8d32a5087af3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:49.998530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640298a4-eb80-4317-85d5-0c9bb663bce4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K0SYammlQ0KOSstsZqkN_Q, audit_chain_id=['K0SYammlQ0KOSstsZqkN_Q']) at 0x7fe09e1b0ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:49.999260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640298a4-eb80-4317-85d5-0c9bb663bce4 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:49.999551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640298a4-eb80-4317-85d5-0c9bb663bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:49.999831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640298a4-eb80-4317-85d5-0c9bb663bce4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:50.011288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640298a4-eb80-4317-85d5-0c9bb663bce4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:50.013108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640298a4-eb80-4317-85d5-0c9bb663bce4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:50.030325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-640298a4-eb80-4317-85d5-0c9bb663bce4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:50.031409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 412/823] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:50.036981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba18057-f304-4ec8-8759-86032fbf70cb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:50.046808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba18057-f304-4ec8-8759-86032fbf70cb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:50.051050 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7cf2c-af28-4b76-a3a0-db432aa2d838 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K0SYammlQ0KOSstsZqkN_Q, audit_chain_id=['K0SYammlQ0KOSstsZqkN_Q']) at 0x7fe09e4e0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:50.051675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7cf2c-af28-4b76-a3a0-db432aa2d838 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:50.051966 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7cf2c-af28-4b76-a3a0-db432aa2d838 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:50.052246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7cf2c-af28-4b76-a3a0-db432aa2d838 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:50.052922 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7cf2c-af28-4b76-a3a0-db432aa2d838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:50.053221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7cf2c-af28-4b76-a3a0-db432aa2d838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:50.055340 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7cf2c-af28-4b76-a3a0-db432aa2d838 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:50.067547 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 412/824] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:50.073013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640298a4-eb80-4317-85d5-0c9bb663bce4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:50.082171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640298a4-eb80-4317-85d5-0c9bb663bce4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:50.086378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a6f1c-8b11-4dd8-b75c-ea9c91a5b2ac admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K0SYammlQ0KOSstsZqkN_Q, audit_chain_id=['K0SYammlQ0KOSstsZqkN_Q']) at 0x7fe09e3e0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:50.087080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6f1c-8b11-4dd8-b75c-ea9c91a5b2ac admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:50.087400 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6f1c-8b11-4dd8-b75c-ea9c91a5b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:50.087678 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6f1c-8b11-4dd8-b75c-ea9c91a5b2ac admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:50.100350 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a6f1c-8b11-4dd8-b75c-ea9c91a5b2ac admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:50.102894 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a6f1c-8b11-4dd8-b75c-ea9c91a5b2ac admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:50.120718 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-c15a6f1c-8b11-4dd8-b75c-ea9c91a5b2ac admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 18:38:50.121748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 413/825] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:38:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:50.127360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7cf2c-af28-4b76-a3a0-db432aa2d838 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:50.136546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7cf2c-af28-4b76-a3a0-db432aa2d838 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:50.140776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6c56e-e043-4712-a072-088b5ab3c62b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K0SYammlQ0KOSstsZqkN_Q, audit_chain_id=['K0SYammlQ0KOSstsZqkN_Q']) at 0x7fe09e155220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:50.141366 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c56e-e043-4712-a072-088b5ab3c62b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:50.141656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c56e-e043-4712-a072-088b5ab3c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:50.141938 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c56e-e043-4712-a072-088b5ab3c62b admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:50.142804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6c56e-e043-4712-a072-088b5ab3c62b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:50.143124 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6c56e-e043-4712-a072-088b5ab3c62b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:50.144953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6c56e-e043-4712-a072-088b5ab3c62b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:50.174276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 413/826] 10.222.0.21 () {56 vars in 1160 bytes} [Mon Feb 28 18:38:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:50.180528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a6f1c-8b11-4dd8-b75c-ea9c91a5b2ac admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:50.189993 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a6f1c-8b11-4dd8-b75c-ea9c91a5b2ac admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:50.194144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfa8ca-5afb-4b24-a62a-19c8b902ba95 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K0SYammlQ0KOSstsZqkN_Q, audit_chain_id=['K0SYammlQ0KOSstsZqkN_Q']) at 0x7fe09e3eb550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:50.194847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfa8ca-5afb-4b24-a62a-19c8b902ba95 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:50.195253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfa8ca-5afb-4b24-a62a-19c8b902ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:50.195530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfa8ca-5afb-4b24-a62a-19c8b902ba95 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:50.206900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfa8ca-5afb-4b24-a62a-19c8b902ba95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:50.208732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfa8ca-5afb-4b24-a62a-19c8b902ba95 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:50.225238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-4cbfa8ca-5afb-4b24-a62a-19c8b902ba95 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:50.226959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 414/827] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:50.232837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6c56e-e043-4712-a072-088b5ab3c62b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:50.242615 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6c56e-e043-4712-a072-088b5ab3c62b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:50.246857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24f3f8-ea6d-44a2-a6fc-bc5990dfd596 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K0SYammlQ0KOSstsZqkN_Q, audit_chain_id=['K0SYammlQ0KOSstsZqkN_Q']) at 0x7fe09df1da60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:50.247473 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f3f8-ea6d-44a2-a6fc-bc5990dfd596 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:50.247764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f3f8-ea6d-44a2-a6fc-bc5990dfd596 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:50.248046 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f3f8-ea6d-44a2-a6fc-bc5990dfd596 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:50.248723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24f3f8-ea6d-44a2-a6fc-bc5990dfd596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:50.249024 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24f3f8-ea6d-44a2-a6fc-bc5990dfd596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:50.250621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24f3f8-ea6d-44a2-a6fc-bc5990dfd596 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:50.262853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 414/828] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:50.268302 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfa8ca-5afb-4b24-a62a-19c8b902ba95 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:50.277961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfa8ca-5afb-4b24-a62a-19c8b902ba95 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:50.282126 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94e7e2-5ee2-45fc-9924-42ddf76f8a06 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K0SYammlQ0KOSstsZqkN_Q, audit_chain_id=['K0SYammlQ0KOSstsZqkN_Q']) at 0x7fe09e1599a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:50.282825 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94e7e2-5ee2-45fc-9924-42ddf76f8a06 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:50.283122 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94e7e2-5ee2-45fc-9924-42ddf76f8a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:50.283423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94e7e2-5ee2-45fc-9924-42ddf76f8a06 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:50.293018 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94e7e2-5ee2-45fc-9924-42ddf76f8a06 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:50.294941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94e7e2-5ee2-45fc-9924-42ddf76f8a06 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:50.308136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-9c94e7e2-5ee2-45fc-9924-42ddf76f8a06 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:38:50.309177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 415/829] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:38:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:50.314811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24f3f8-ea6d-44a2-a6fc-bc5990dfd596 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:50.324434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24f3f8-ea6d-44a2-a6fc-bc5990dfd596 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:50.328649 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e1840-d971-452e-b12d-1aa3728ea3e1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K0SYammlQ0KOSstsZqkN_Q, audit_chain_id=['K0SYammlQ0KOSstsZqkN_Q']) at 0x7fe09e3b5f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:50.329227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1840-d971-452e-b12d-1aa3728ea3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:50.329518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1840-d971-452e-b12d-1aa3728ea3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:50.329800 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1840-d971-452e-b12d-1aa3728ea3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:50.330538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e1840-d971-452e-b12d-1aa3728ea3e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:50.330838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e1840-d971-452e-b12d-1aa3728ea3e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:50.332684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e1840-d971-452e-b12d-1aa3728ea3e1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:50.345819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 415/830] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:38:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:50.352162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94e7e2-5ee2-45fc-9924-42ddf76f8a06 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:50.361403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94e7e2-5ee2-45fc-9924-42ddf76f8a06 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:50.365530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d97dcb-9d99-422e-83b2-872877d3d578 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K0SYammlQ0KOSstsZqkN_Q, audit_chain_id=['K0SYammlQ0KOSstsZqkN_Q']) at 0x7fe09e411f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:50.366323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97dcb-9d99-422e-83b2-872877d3d578 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:50.366606 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97dcb-9d99-422e-83b2-872877d3d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:50.367524 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97dcb-9d99-422e-83b2-872877d3d578 admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/65a9c92fb5144e3dacc922eede1131fd/roles/9a37fbff179849e58437f2fad75ce546` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:50.387383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d97dcb-9d99-422e-83b2-872877d3d578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=65a9c92fb5144e3dacc922eede1131fd, role_id=9a37fbff179849e58437f2fad75ce546)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:50.389967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d97dcb-9d99-422e-83b2-872877d3d578 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:50.467688 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 416/831] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:38:50 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/65a9c92fb5144e3dacc922eede1131fd/roles/9a37fbff179849e58437f2fad75ce546 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:38:52.552954 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8559e-1488-423e-b0bf-b9a70171b57d None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:52.553485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8559e-1488-423e-b0bf-b9a70171b57d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:52.553590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8559e-1488-423e-b0bf-b9a70171b57d None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:52.556229 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 416/832] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:52.561358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2549a9-d0b5-4891-8692-00a5ecee27d1 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:52.561734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2549a9-d0b5-4891-8692-00a5ecee27d1 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:52.561933 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2549a9-d0b5-4891-8692-00a5ecee27d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:52.584121 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-3c2549a9-d0b5-4891-8692-00a5ecee27d1 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:52.585258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3c2549a9-d0b5-4891-8692-00a5ecee27d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:52.647800 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 417/833] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:52 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:52.670677 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8559e-1488-423e-b0bf-b9a70171b57d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:52.683405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8559e-1488-423e-b0bf-b9a70171b57d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:52.687448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea8ed-5a02-4449-85bd-0e80293e9912 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e1a14c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:52.688165 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea8ed-5a02-4449-85bd-0e80293e9912 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:52.688458 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea8ed-5a02-4449-85bd-0e80293e9912 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:52.688744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea8ed-5a02-4449-85bd-0e80293e9912 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:52.700798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbea8ed-5a02-4449-85bd-0e80293e9912 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:38:52.707107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-1cbea8ed-5a02-4449-85bd-0e80293e9912 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:38:52.708218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 417/834] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:38:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:52.714381 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2549a9-d0b5-4891-8692-00a5ecee27d1 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:52.723359 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2549a9-d0b5-4891-8692-00a5ecee27d1 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:52.727901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a50232-a3cc-4c98-afa2-f77c7a17f255 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e3b0580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:52.728489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a50232-a3cc-4c98-afa2-f77c7a17f255 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:52.728785 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a50232-a3cc-4c98-afa2-f77c7a17f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:52.729068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a50232-a3cc-4c98-afa2-f77c7a17f255 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:52.729780 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a50232-a3cc-4c98-afa2-f77c7a17f255 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:52.730080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a50232-a3cc-4c98-afa2-f77c7a17f255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:52.731722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a50232-a3cc-4c98-afa2-f77c7a17f255 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:52.740014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 418/835] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:38:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:52.745874 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea8ed-5a02-4449-85bd-0e80293e9912 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:52.755540 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea8ed-5a02-4449-85bd-0e80293e9912 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:52.760964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242ee3b-4248-49c7-8086-9075192b4156 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e14a970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:52.761669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242ee3b-4248-49c7-8086-9075192b4156 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:52.761960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242ee3b-4248-49c7-8086-9075192b4156 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:52.762247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242ee3b-4248-49c7-8086-9075192b4156 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:52.773780 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242ee3b-4248-49c7-8086-9075192b4156 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:52.775631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242ee3b-4248-49c7-8086-9075192b4156 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:52.792819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-5242ee3b-4248-49c7-8086-9075192b4156 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:52.793888 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 418/836] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:52.799383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a50232-a3cc-4c98-afa2-f77c7a17f255 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:52.809202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a50232-a3cc-4c98-afa2-f77c7a17f255 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:52.813337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4dd4e-a25a-45f4-8edd-9b5455992bec admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e3f3280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:52.813913 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4dd4e-a25a-45f4-8edd-9b5455992bec admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:52.814200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4dd4e-a25a-45f4-8edd-9b5455992bec admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:52.814483 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4dd4e-a25a-45f4-8edd-9b5455992bec admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:52.815197 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4dd4e-a25a-45f4-8edd-9b5455992bec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:52.815497 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4dd4e-a25a-45f4-8edd-9b5455992bec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:52.817081 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4dd4e-a25a-45f4-8edd-9b5455992bec admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:52.831016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 419/837] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:52.836651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242ee3b-4248-49c7-8086-9075192b4156 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:52.845974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242ee3b-4248-49c7-8086-9075192b4156 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:52.850103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3981c-6397-44f9-acb6-ef7392325cad admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e1a18e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:52.850811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3981c-6397-44f9-acb6-ef7392325cad admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:52.851731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3981c-6397-44f9-acb6-ef7392325cad admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:52.852041 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3981c-6397-44f9-acb6-ef7392325cad admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:52.864401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3981c-6397-44f9-acb6-ef7392325cad admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:52.866379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3981c-6397-44f9-acb6-ef7392325cad admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:52.884004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-75f3981c-6397-44f9-acb6-ef7392325cad admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 18:38:52.885070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 419/838] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:38:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:52.890653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4dd4e-a25a-45f4-8edd-9b5455992bec admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:52.900895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4dd4e-a25a-45f4-8edd-9b5455992bec admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:52.905081 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd704ca0-8303-4b17-9bc6-14a865968763 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e204f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:52.905689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd704ca0-8303-4b17-9bc6-14a865968763 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:52.905972 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd704ca0-8303-4b17-9bc6-14a865968763 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:52.906248 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd704ca0-8303-4b17-9bc6-14a865968763 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:52.907049 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd704ca0-8303-4b17-9bc6-14a865968763 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:52.907379 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd704ca0-8303-4b17-9bc6-14a865968763 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:52.909187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd704ca0-8303-4b17-9bc6-14a865968763 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:52.939456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 420/839] 10.222.0.21 () {56 vars in 1160 bytes} [Mon Feb 28 18:38:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:52.945252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3981c-6397-44f9-acb6-ef7392325cad admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:52.954700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3981c-6397-44f9-acb6-ef7392325cad admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:52.958925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0077f-080e-447b-b49c-addaec4eaefd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e105f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:52.959549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0077f-080e-447b-b49c-addaec4eaefd admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:52.959841 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0077f-080e-447b-b49c-addaec4eaefd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:52.960129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0077f-080e-447b-b49c-addaec4eaefd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:52.969390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0077f-080e-447b-b49c-addaec4eaefd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:52.971150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0077f-080e-447b-b49c-addaec4eaefd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:52.981007 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 420/840] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:38:52 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:38:52.986863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd704ca0-8303-4b17-9bc6-14a865968763 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:52.996837 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd704ca0-8303-4b17-9bc6-14a865968763 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:53.000999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba9340-49eb-417b-84b9-02676b92b65d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e204310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:53.001708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba9340-49eb-417b-84b9-02676b92b65d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:53.001995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba9340-49eb-417b-84b9-02676b92b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:53.002274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba9340-49eb-417b-84b9-02676b92b65d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:53.013794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba9340-49eb-417b-84b9-02676b92b65d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:53.015640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba9340-49eb-417b-84b9-02676b92b65d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:53.031992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-e3ba9340-49eb-417b-84b9-02676b92b65d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:38:53.033059 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 421/841] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:53.039159 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0077f-080e-447b-b49c-addaec4eaefd admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:53.047789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0077f-080e-447b-b49c-addaec4eaefd admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:53.052007 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55736d-9c34-4b4e-9883-d620855623f0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e123100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:53.052595 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55736d-9c34-4b4e-9883-d620855623f0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:53.052884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55736d-9c34-4b4e-9883-d620855623f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:53.053168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55736d-9c34-4b4e-9883-d620855623f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:53.053852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55736d-9c34-4b4e-9883-d620855623f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:53.054176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55736d-9c34-4b4e-9883-d620855623f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:53.056431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55736d-9c34-4b4e-9883-d620855623f0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:53.068640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 421/842] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:53.074070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba9340-49eb-417b-84b9-02676b92b65d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:53.083294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba9340-49eb-417b-84b9-02676b92b65d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:53.087548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466ded-63a6-4700-a7da-58e1b4754d66 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e198e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:53.088249 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466ded-63a6-4700-a7da-58e1b4754d66 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:53.088537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466ded-63a6-4700-a7da-58e1b4754d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:53.088814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca466ded-63a6-4700-a7da-58e1b4754d66 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:53.097282 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca466ded-63a6-4700-a7da-58e1b4754d66 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:53.099274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca466ded-63a6-4700-a7da-58e1b4754d66 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:53.113074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-ca466ded-63a6-4700-a7da-58e1b4754d66 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:38:53.114110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 422/843] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:38:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:53.120364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55736d-9c34-4b4e-9883-d620855623f0 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:53.129552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55736d-9c34-4b4e-9883-d620855623f0 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:53.133971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db20e0-58e2-4129-8306-682a7ff52c5f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e269a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:53.134558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db20e0-58e2-4129-8306-682a7ff52c5f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:53.134849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db20e0-58e2-4129-8306-682a7ff52c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:53.135161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db20e0-58e2-4129-8306-682a7ff52c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:53.135901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db20e0-58e2-4129-8306-682a7ff52c5f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:53.136206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db20e0-58e2-4129-8306-682a7ff52c5f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:53.138012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db20e0-58e2-4129-8306-682a7ff52c5f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:53.150430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 422/844] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:38:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:53.156477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466ded-63a6-4700-a7da-58e1b4754d66 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:53.166674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca466ded-63a6-4700-a7da-58e1b4754d66 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:53.170919 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f5f56-167a-486a-95e4-fa340a7a16d2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lrUe5FSCTHK6E-Dwm6HcHQ, audit_chain_id=['lrUe5FSCTHK6E-Dwm6HcHQ']) at 0x7fe09e1df6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:53.171535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5f56-167a-486a-95e4-fa340a7a16d2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:53.171826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5f56-167a-486a-95e4-fa340a7a16d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:53.172111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5f56-167a-486a-95e4-fa340a7a16d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:53.172885 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f5f56-167a-486a-95e4-fa340a7a16d2 admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=65a9c92fb5144e3dacc922eede1131fd) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:53.173192 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f5f56-167a-486a-95e4-fa340a7a16d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:53.175011 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f5f56-167a-486a-95e4-fa340a7a16d2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:53.181684 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 423/845] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:38:53 2022] GET /identity/v3/role_assignments?user.id=65a9c92fb5144e3dacc922eede1131fd&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:55.304871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1769-973f-42f1-8f79-174581fff5f4 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:55.305384 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1769-973f-42f1-8f79-174581fff5f4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:55.305485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1769-973f-42f1-8f79-174581fff5f4 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:55.307151 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 423/846] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:55.312378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060866c-bc38-4f65-9754-f70bc65f0021 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:55.312800 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060866c-bc38-4f65-9754-f70bc65f0021 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:55.312945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060866c-bc38-4f65-9754-f70bc65f0021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:55.334946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f060866c-bc38-4f65-9754-f70bc65f0021 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:55.336372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f060866c-bc38-4f65-9754-f70bc65f0021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:55.343539 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 424/847] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:55 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:38:55.366260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c1769-973f-42f1-8f79-174581fff5f4 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:55.378531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c1769-973f-42f1-8f79-174581fff5f4 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:55.382611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59ad5a-b0e7-4bbd-8875-a12b749bd3db admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NjBiu8AWRsSBkkTtUCkZdQ, audit_chain_id=['NjBiu8AWRsSBkkTtUCkZdQ']) at 0x7fe09e1ddfd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:55.383444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ad5a-b0e7-4bbd-8875-a12b749bd3db admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:55.383731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ad5a-b0e7-4bbd-8875-a12b749bd3db admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:55.384012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ad5a-b0e7-4bbd-8875-a12b749bd3db admin admin] PATH_INFO: `/v3/services/network` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:55.384627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59ad5a-b0e7-4bbd-8875-a12b749bd3db admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:55.386185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59ad5a-b0e7-4bbd-8875-a12b749bd3db admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:55.396294 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-dc59ad5a-b0e7-4bbd-8875-a12b749bd3db admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 18:38:55.397332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 424/848] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:38:55 2022] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:55.403052 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060866c-bc38-4f65-9754-f70bc65f0021 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:55.411730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060866c-bc38-4f65-9754-f70bc65f0021 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:55.416480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fd29b-e180-47f0-97cb-1a0e6060f0ca admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NjBiu8AWRsSBkkTtUCkZdQ, audit_chain_id=['NjBiu8AWRsSBkkTtUCkZdQ']) at 0x7fe09e272bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:55.417066 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd29b-e180-47f0-97cb-1a0e6060f0ca admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:55.417351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd29b-e180-47f0-97cb-1a0e6060f0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:55.417630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd29b-e180-47f0-97cb-1a0e6060f0ca admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:55.418294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fd29b-e180-47f0-97cb-1a0e6060f0ca admin admin] RBAC: Adding query filter params (name=network) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:55.418590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fd29b-e180-47f0-97cb-1a0e6060f0ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:55.420204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fd29b-e180-47f0-97cb-1a0e6060f0ca admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:55.424926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 425/849] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:38:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:55.431149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59ad5a-b0e7-4bbd-8875-a12b749bd3db admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:55.440319 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59ad5a-b0e7-4bbd-8875-a12b749bd3db admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:55.444417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838169ee-c723-4d8a-89c3-0f49b7fa025b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NjBiu8AWRsSBkkTtUCkZdQ, audit_chain_id=['NjBiu8AWRsSBkkTtUCkZdQ']) at 0x7fe09e14a070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:55.445020 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838169ee-c723-4d8a-89c3-0f49b7fa025b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:55.445303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838169ee-c723-4d8a-89c3-0f49b7fa025b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:55.445583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838169ee-c723-4d8a-89c3-0f49b7fa025b admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:55.446239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838169ee-c723-4d8a-89c3-0f49b7fa025b admin admin] RBAC: Adding query filter params (type=network) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:38:55.446542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838169ee-c723-4d8a-89c3-0f49b7fa025b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:55.448115 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838169ee-c723-4d8a-89c3-0f49b7fa025b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:55.452326 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 425/850] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:38:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:38:57.583629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168630f3-ae84-4b8a-a11b-901a4a03556a None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:57.584188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168630f3-ae84-4b8a-a11b-901a4a03556a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:57.584188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168630f3-ae84-4b8a-a11b-901a4a03556a None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:57.586025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 426/851] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:57.591712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39023f9-89ef-45bb-86a1-8e7015e0cd6e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:57.592129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39023f9-89ef-45bb-86a1-8e7015e0cd6e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:57.592282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39023f9-89ef-45bb-86a1-8e7015e0cd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:57.615085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f39023f9-89ef-45bb-86a1-8e7015e0cd6e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:57.616268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f39023f9-89ef-45bb-86a1-8e7015e0cd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:57.624669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 426/852] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:57 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:57.648268 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168630f3-ae84-4b8a-a11b-901a4a03556a None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:57.660096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168630f3-ae84-4b8a-a11b-901a4a03556a None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:57.664695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b4cb1-8e05-4ccb-bdc0-df5e634f1b8f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Mzm4ILhoSfCnr02RnGbkhA, audit_chain_id=['Mzm4ILhoSfCnr02RnGbkhA']) at 0x7fe09e472310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:57.665271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4cb1-8e05-4ccb-bdc0-df5e634f1b8f admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:57.665558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4cb1-8e05-4ccb-bdc0-df5e634f1b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:57.665840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4cb1-8e05-4ccb-bdc0-df5e634f1b8f admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:57.666528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b4cb1-8e05-4ccb-bdc0-df5e634f1b8f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:57.668203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b4cb1-8e05-4ccb-bdc0-df5e634f1b8f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:57.738768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 427/853] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:38:57 2022] POST /identity/v3/services => generated 240 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:38:59.882672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebdd53-58a7-47cf-bb41-ede226430720 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:59.883283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebdd53-58a7-47cf-bb41-ede226430720 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:59.883283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebdd53-58a7-47cf-bb41-ede226430720 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:59.884938 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 427/854] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:59.890368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740f5ad-8913-4eda-add1-4235173b9ea3 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:59.890795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740f5ad-8913-4eda-add1-4235173b9ea3 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:59.890941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740f5ad-8913-4eda-add1-4235173b9ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:59.913182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-4740f5ad-8913-4eda-add1-4235173b9ea3 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:59.914859 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4740f5ad-8913-4eda-add1-4235173b9ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:59.932979 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 428/855] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:59 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:59.956221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebdd53-58a7-47cf-bb41-ede226430720 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:59.969096 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebdd53-58a7-47cf-bb41-ede226430720 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:59.973297 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc23838-8699-4c97-b2ce-5d8d47dd9f3a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QEfm5UyQRn-qce_po42j4w, audit_chain_id=['QEfm5UyQRn-qce_po42j4w']) at 0x7fe09e123130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:59.974013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23838-8699-4c97-b2ce-5d8d47dd9f3a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:59.974303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23838-8699-4c97-b2ce-5d8d47dd9f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:59.974583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23838-8699-4c97-b2ce-5d8d47dd9f3a admin admin] PATH_INFO: `/v3/services/network` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:59.975246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc23838-8699-4c97-b2ce-5d8d47dd9f3a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:59.977412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc23838-8699-4c97-b2ce-5d8d47dd9f3a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:38:59.987546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-adc23838-8699-4c97-b2ce-5d8d47dd9f3a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 18:38:59.988611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 428/856] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:38:59 2022] GET /identity/v3/services/network => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:38:59.995940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740f5ad-8913-4eda-add1-4235173b9ea3 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:00.004616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740f5ad-8913-4eda-add1-4235173b9ea3 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:00.009065 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14552203-ce70-473e-b350-cf065afd9042 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QEfm5UyQRn-qce_po42j4w, audit_chain_id=['QEfm5UyQRn-qce_po42j4w']) at 0x7fe09e3c4940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:00.009650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552203-ce70-473e-b350-cf065afd9042 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:00.009939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552203-ce70-473e-b350-cf065afd9042 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:00.010220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552203-ce70-473e-b350-cf065afd9042 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:00.010890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14552203-ce70-473e-b350-cf065afd9042 admin admin] RBAC: Adding query filter params (name=network) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:00.011220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14552203-ce70-473e-b350-cf065afd9042 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:00.012804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14552203-ce70-473e-b350-cf065afd9042 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:00.017464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 429/857] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:38:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:00.023417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc23838-8699-4c97-b2ce-5d8d47dd9f3a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:00.032429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc23838-8699-4c97-b2ce-5d8d47dd9f3a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:00.036796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3373df-d045-480a-9ed5-68e6df091b9b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QEfm5UyQRn-qce_po42j4w, audit_chain_id=['QEfm5UyQRn-qce_po42j4w']) at 0x7fe09e14a790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:00.037382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3373df-d045-480a-9ed5-68e6df091b9b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:00.037673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3373df-d045-480a-9ed5-68e6df091b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:00.037956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3373df-d045-480a-9ed5-68e6df091b9b admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:00.039343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3373df-d045-480a-9ed5-68e6df091b9b admin admin] RBAC: Adding query filter params (type=network) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:00.039343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3373df-d045-480a-9ed5-68e6df091b9b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:00.041248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3373df-d045-480a-9ed5-68e6df091b9b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:00.046053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 429/858] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:39:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:00.051993 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14552203-ce70-473e-b350-cf065afd9042 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:00.061314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14552203-ce70-473e-b350-cf065afd9042 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:00.065557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e535d1-25cc-4427-9a00-1965d351c668 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QEfm5UyQRn-qce_po42j4w, audit_chain_id=['QEfm5UyQRn-qce_po42j4w']) at 0x7fe09e272550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:00.066135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e535d1-25cc-4427-9a00-1965d351c668 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:00.066426 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e535d1-25cc-4427-9a00-1965d351c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:00.066710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e535d1-25cc-4427-9a00-1965d351c668 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:00.067489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e535d1-25cc-4427-9a00-1965d351c668 admin admin] RBAC: Adding query filter params (interface=public, service_id=076a98274e2f4fd9850e85203f21a2f2, region_id=RegionOne) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:00.067799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e535d1-25cc-4427-9a00-1965d351c668 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:00.069371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e535d1-25cc-4427-9a00-1965d351c668 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:00.074559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 430/859] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Feb 28 18:39:00 2022] GET /identity/v3/endpoints?service_id=076a98274e2f4fd9850e85203f21a2f2&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:00.079884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3373df-d045-480a-9ed5-68e6df091b9b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:00.089949 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3373df-d045-480a-9ed5-68e6df091b9b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:00.094152 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47ff41-8685-4e16-b5d0-518b13d21a4c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QEfm5UyQRn-qce_po42j4w, audit_chain_id=['QEfm5UyQRn-qce_po42j4w']) at 0x7fe0a2701c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:00.094742 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47ff41-8685-4e16-b5d0-518b13d21a4c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:00.095031 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47ff41-8685-4e16-b5d0-518b13d21a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:00.095479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47ff41-8685-4e16-b5d0-518b13d21a4c admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:00.096125 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47ff41-8685-4e16-b5d0-518b13d21a4c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:00.097666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47ff41-8685-4e16-b5d0-518b13d21a4c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:00.104547 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 430/860] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:39:00 2022] GET /identity/v3/services => generated 1967 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:39:02.204553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614cc25-406d-4de3-8424-31559eaa83e8 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:02.205095 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614cc25-406d-4de3-8424-31559eaa83e8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:02.205242 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614cc25-406d-4de3-8424-31559eaa83e8 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:02.206818 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 431/861] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:02.211990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9a7b1-ef35-42b8-8916-aeb9ca961c01 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:02.212426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9a7b1-ef35-42b8-8916-aeb9ca961c01 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:02.212556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9a7b1-ef35-42b8-8916-aeb9ca961c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:02.235038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-24c9a7b1-ef35-42b8-8916-aeb9ca961c01 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:02.236235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-24c9a7b1-ef35-42b8-8916-aeb9ca961c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:02.243802 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 431/862] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:02 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:39:02.266139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614cc25-406d-4de3-8424-31559eaa83e8 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:02.278616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614cc25-406d-4de3-8424-31559eaa83e8 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:02.282635 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158b68-fe37-4183-9c19-a8c135b312bf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vjxfHuw4Sdi1YAxynrhx5w, audit_chain_id=['vjxfHuw4Sdi1YAxynrhx5w']) at 0x7fe09e198970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:02.283365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158b68-fe37-4183-9c19-a8c135b312bf admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:02.283651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158b68-fe37-4183-9c19-a8c135b312bf admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:02.283930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158b68-fe37-4183-9c19-a8c135b312bf admin admin] PATH_INFO: `/v3/services/network` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:02.284547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158b68-fe37-4183-9c19-a8c135b312bf admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:02.286119 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158b68-fe37-4183-9c19-a8c135b312bf admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:02.296769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-cc158b68-fe37-4183-9c19-a8c135b312bf admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 18:39:02.297799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 432/863] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:39:02 2022] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:02.303627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9a7b1-ef35-42b8-8916-aeb9ca961c01 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:02.312095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9a7b1-ef35-42b8-8916-aeb9ca961c01 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:02.316235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede858f-0fac-49bf-b82f-0dbfa27cc312 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vjxfHuw4Sdi1YAxynrhx5w, audit_chain_id=['vjxfHuw4Sdi1YAxynrhx5w']) at 0x7fe09df24c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:02.316818 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede858f-0fac-49bf-b82f-0dbfa27cc312 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:02.317109 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede858f-0fac-49bf-b82f-0dbfa27cc312 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:02.317389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede858f-0fac-49bf-b82f-0dbfa27cc312 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:02.318056 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede858f-0fac-49bf-b82f-0dbfa27cc312 admin admin] RBAC: Adding query filter params (name=network) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:02.318359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede858f-0fac-49bf-b82f-0dbfa27cc312 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:02.320123 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede858f-0fac-49bf-b82f-0dbfa27cc312 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:02.324673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 432/864] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:39:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:02.330076 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158b68-fe37-4183-9c19-a8c135b312bf admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:02.340134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158b68-fe37-4183-9c19-a8c135b312bf admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:02.344281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9d504-881b-458c-8507-e2c40f8e10c3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vjxfHuw4Sdi1YAxynrhx5w, audit_chain_id=['vjxfHuw4Sdi1YAxynrhx5w']) at 0x7fe09e3dcaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:02.344847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9d504-881b-458c-8507-e2c40f8e10c3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:02.345132 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9d504-881b-458c-8507-e2c40f8e10c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:02.345410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9d504-881b-458c-8507-e2c40f8e10c3 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:02.346062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9d504-881b-458c-8507-e2c40f8e10c3 admin admin] RBAC: Adding query filter params (type=network) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:02.346362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9d504-881b-458c-8507-e2c40f8e10c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:02.347950 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9d504-881b-458c-8507-e2c40f8e10c3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:02.353016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 433/865] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 18:39:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:02.358274 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede858f-0fac-49bf-b82f-0dbfa27cc312 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:02.368176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede858f-0fac-49bf-b82f-0dbfa27cc312 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:02.372404 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a558-cbf0-40e9-9fa6-f2007df4dc68 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vjxfHuw4Sdi1YAxynrhx5w, audit_chain_id=['vjxfHuw4Sdi1YAxynrhx5w']) at 0x7fe09df246d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:02.372974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a558-cbf0-40e9-9fa6-f2007df4dc68 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:02.373265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a558-cbf0-40e9-9fa6-f2007df4dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:02.373550 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a558-cbf0-40e9-9fa6-f2007df4dc68 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:02.374238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a558-cbf0-40e9-9fa6-f2007df4dc68 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:02.375825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a558-cbf0-40e9-9fa6-f2007df4dc68 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:02.462412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 433/866] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Feb 28 18:39:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:39:04.739557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120be0be-2a96-4eae-921c-b61b015c0f10 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:04.740171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120be0be-2a96-4eae-921c-b61b015c0f10 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:04.740171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120be0be-2a96-4eae-921c-b61b015c0f10 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:04.741886 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 434/867] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:04.747411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55663c3e-a55d-48b4-9fe3-5cde7279ea24 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:04.747858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55663c3e-a55d-48b4-9fe3-5cde7279ea24 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:04.747985 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55663c3e-a55d-48b4-9fe3-5cde7279ea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:04.770836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-55663c3e-a55d-48b4-9fe3-5cde7279ea24 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:04.772010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-55663c3e-a55d-48b4-9fe3-5cde7279ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:04.792220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 434/868] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:04.815166 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120be0be-2a96-4eae-921c-b61b015c0f10 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:04.827815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120be0be-2a96-4eae-921c-b61b015c0f10 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:04.831965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c045c-53b5-4158-bde3-cbf7440812cc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PutFMGf7TnaFYvXiKW2EIg, audit_chain_id=['PutFMGf7TnaFYvXiKW2EIg']) at 0x7fe09e3dc580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:04.832556 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c045c-53b5-4158-bde3-cbf7440812cc admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:04.832847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c045c-53b5-4158-bde3-cbf7440812cc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:04.833126 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c045c-53b5-4158-bde3-cbf7440812cc admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:04.833836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c045c-53b5-4158-bde3-cbf7440812cc admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:04.836018 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c045c-53b5-4158-bde3-cbf7440812cc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:04.876405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.sql.core [None req-381c045c-53b5-4158-bde3-cbf7440812cc admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<<null>>' for key 'role.ixu_role_name_domain_id'") Feb 28 18:39:04.876405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 28 18:39:04.876405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [parameters: {'id': '47e4d571c3fa49d48a20c5c5fbe60ce2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 28 18:39:04.876405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=67131) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Feb 28 18:39:04.883228 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-381c045c-53b5-4158-bde3-cbf7440812cc admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 28 18:39:04.884429 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 435/869] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 18:39:04 2022] POST /identity/v3/roles => generated 144 bytes in 70 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:04.890836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55663c3e-a55d-48b4-9fe3-5cde7279ea24 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:04.900557 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55663c3e-a55d-48b4-9fe3-5cde7279ea24 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:04.904905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a32fd-8a60-42fd-9315-86d81cb1eae4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PutFMGf7TnaFYvXiKW2EIg, audit_chain_id=['PutFMGf7TnaFYvXiKW2EIg']) at 0x7fe09e106a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:04.905648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a32fd-8a60-42fd-9315-86d81cb1eae4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:04.905940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a32fd-8a60-42fd-9315-86d81cb1eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:04.906223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a32fd-8a60-42fd-9315-86d81cb1eae4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:04.918315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a32fd-8a60-42fd-9315-86d81cb1eae4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:39:04.924965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-372a32fd-8a60-42fd-9315-86d81cb1eae4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:39:04.926131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 435/870] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 18:39:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:04.932730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c045c-53b5-4158-bde3-cbf7440812cc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:04.946366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c045c-53b5-4158-bde3-cbf7440812cc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:04.950803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193b43f-8177-45ae-a620-e4bea5686981 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PutFMGf7TnaFYvXiKW2EIg, audit_chain_id=['PutFMGf7TnaFYvXiKW2EIg']) at 0x7fe09e16e7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:04.951434 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b43f-8177-45ae-a620-e4bea5686981 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:04.951724 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b43f-8177-45ae-a620-e4bea5686981 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:04.952007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b43f-8177-45ae-a620-e4bea5686981 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:04.952735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b43f-8177-45ae-a620-e4bea5686981 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:04.953042 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b43f-8177-45ae-a620-e4bea5686981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:04.954642 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b43f-8177-45ae-a620-e4bea5686981 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:04.965281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 436/871] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:39:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:07.150471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f14e1a-2a1a-4258-918c-7a7549cf302c None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:07.151006 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f14e1a-2a1a-4258-918c-7a7549cf302c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:07.151155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f14e1a-2a1a-4258-918c-7a7549cf302c None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:07.152778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 436/872] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:07.158442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eca15-a8a9-4853-a70b-db5cc71a255e None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:07.158894 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eca15-a8a9-4853-a70b-db5cc71a255e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:07.159105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eca15-a8a9-4853-a70b-db5cc71a255e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:07.182470 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-de2eca15-a8a9-4853-a70b-db5cc71a255e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:07.183659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-de2eca15-a8a9-4853-a70b-db5cc71a255e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:07.190760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 437/873] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:07.215936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f14e1a-2a1a-4258-918c-7a7549cf302c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:07.228955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f14e1a-2a1a-4258-918c-7a7549cf302c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:07.233066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c613d7-409d-428b-b6d4-8905de35743c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cOk_qYfrQFS0BDi39gUkQg, audit_chain_id=['cOk_qYfrQFS0BDi39gUkQg']) at 0x7fe09e1556a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:07.233785 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c613d7-409d-428b-b6d4-8905de35743c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:07.234076 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c613d7-409d-428b-b6d4-8905de35743c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:07.234362 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c613d7-409d-428b-b6d4-8905de35743c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:07.246488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c613d7-409d-428b-b6d4-8905de35743c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:07.248359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c613d7-409d-428b-b6d4-8905de35743c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:07.265779 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-b7c613d7-409d-428b-b6d4-8905de35743c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:07.266909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 437/874] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:07.273502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2eca15-a8a9-4853-a70b-db5cc71a255e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:07.282338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2eca15-a8a9-4853-a70b-db5cc71a255e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:07.286569 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8056b-7bef-4bf4-b213-51a1e3e37a8c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cOk_qYfrQFS0BDi39gUkQg, audit_chain_id=['cOk_qYfrQFS0BDi39gUkQg']) at 0x7fe09e687fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:07.287183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8056b-7bef-4bf4-b213-51a1e3e37a8c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:07.287544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8056b-7bef-4bf4-b213-51a1e3e37a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:07.288765 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8056b-7bef-4bf4-b213-51a1e3e37a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:07.288984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8056b-7bef-4bf4-b213-51a1e3e37a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:07.289289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8056b-7bef-4bf4-b213-51a1e3e37a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:07.290878 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8056b-7bef-4bf4-b213-51a1e3e37a8c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:07.303535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 438/875] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:07.309350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c613d7-409d-428b-b6d4-8905de35743c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:07.318787 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c613d7-409d-428b-b6d4-8905de35743c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:07.323623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba177a23-285d-4751-b722-3772cb7d8af8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cOk_qYfrQFS0BDi39gUkQg, audit_chain_id=['cOk_qYfrQFS0BDi39gUkQg']) at 0x7fe09e155fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:07.324230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba177a23-285d-4751-b722-3772cb7d8af8 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:07.324526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba177a23-285d-4751-b722-3772cb7d8af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:07.324815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba177a23-285d-4751-b722-3772cb7d8af8 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:07.325466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba177a23-285d-4751-b722-3772cb7d8af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:07.327405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba177a23-285d-4751-b722-3772cb7d8af8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:07.399765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 438/876] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:39:07 2022] POST /identity/v3/users => generated 247 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:39:09.578699 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2836766-ac60-435d-ac4d-cb96885b1aa3 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:09.579296 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2836766-ac60-435d-ac4d-cb96885b1aa3 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:09.579296 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2836766-ac60-435d-ac4d-cb96885b1aa3 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:09.581053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 439/877] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:09.587012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99f15-1433-49cf-afe9-2afcd5842577 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:09.587479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99f15-1433-49cf-afe9-2afcd5842577 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:09.587606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99f15-1433-49cf-afe9-2afcd5842577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:09.610193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3dd99f15-1433-49cf-afe9-2afcd5842577 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:09.611351 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3dd99f15-1433-49cf-afe9-2afcd5842577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:09.618928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 439/878] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:39:09.641951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2836766-ac60-435d-ac4d-cb96885b1aa3 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:09.654231 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2836766-ac60-435d-ac4d-cb96885b1aa3 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:09.658379 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3b319-fe33-448e-ab64-a059752e89b2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09e4721f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:09.659099 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3b319-fe33-448e-ab64-a059752e89b2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:09.659418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3b319-fe33-448e-ab64-a059752e89b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:09.659697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3b319-fe33-448e-ab64-a059752e89b2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:09.671357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3b319-fe33-448e-ab64-a059752e89b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:39:09.677615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-20b3b319-fe33-448e-ab64-a059752e89b2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:39:09.679618 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 440/879] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:09.685590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd99f15-1433-49cf-afe9-2afcd5842577 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:09.694266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd99f15-1433-49cf-afe9-2afcd5842577 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:09.698619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366149c7-7fc6-42fc-b91c-07efa8c45ba2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09e705250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:09.699313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366149c7-7fc6-42fc-b91c-07efa8c45ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:09.699606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366149c7-7fc6-42fc-b91c-07efa8c45ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:09.699887 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366149c7-7fc6-42fc-b91c-07efa8c45ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:09.700598 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366149c7-7fc6-42fc-b91c-07efa8c45ba2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:09.700898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366149c7-7fc6-42fc-b91c-07efa8c45ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:09.702476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366149c7-7fc6-42fc-b91c-07efa8c45ba2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:09.711048 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 440/880] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:39:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:09.717139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3b319-fe33-448e-ab64-a059752e89b2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:09.728007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3b319-fe33-448e-ab64-a059752e89b2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:09.732224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b70a5-4a64-44df-8eeb-99155b2680f4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09e1cc1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:09.732928 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b70a5-4a64-44df-8eeb-99155b2680f4 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:09.733214 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b70a5-4a64-44df-8eeb-99155b2680f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:09.733495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b70a5-4a64-44df-8eeb-99155b2680f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:09.745407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b70a5-4a64-44df-8eeb-99155b2680f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:09.747245 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b70a5-4a64-44df-8eeb-99155b2680f4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:09.770952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-3c8b70a5-4a64-44df-8eeb-99155b2680f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:09.773454 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 441/881] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:09.779170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366149c7-7fc6-42fc-b91c-07efa8c45ba2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:09.789798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366149c7-7fc6-42fc-b91c-07efa8c45ba2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:09.794084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b602b-aea0-48ab-9d73-b228cd74b2f1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09df24070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:09.794704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b602b-aea0-48ab-9d73-b228cd74b2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:09.794996 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b602b-aea0-48ab-9d73-b228cd74b2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:09.795314 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b602b-aea0-48ab-9d73-b228cd74b2f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:09.795999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b602b-aea0-48ab-9d73-b228cd74b2f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:09.796300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b602b-aea0-48ab-9d73-b228cd74b2f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:09.797867 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b602b-aea0-48ab-9d73-b228cd74b2f1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:09.810671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 441/882] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:09.816709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b70a5-4a64-44df-8eeb-99155b2680f4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:09.826330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b70a5-4a64-44df-8eeb-99155b2680f4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:09.830595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29c891-5973-4243-8f53-a8986fbe8d9a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09e1cc400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:09.831290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29c891-5973-4243-8f53-a8986fbe8d9a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:09.831575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29c891-5973-4243-8f53-a8986fbe8d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:09.831851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29c891-5973-4243-8f53-a8986fbe8d9a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:09.846816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29c891-5973-4243-8f53-a8986fbe8d9a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:09.848855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29c891-5973-4243-8f53-a8986fbe8d9a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:09.867337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-fa29c891-5973-4243-8f53-a8986fbe8d9a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:39:09.868443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 442/883] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:09.874325 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b602b-aea0-48ab-9d73-b228cd74b2f1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:09.883793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b602b-aea0-48ab-9d73-b228cd74b2f1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:09.888166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decd9da-3e3e-4bc1-b8d6-18bb93cde03a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09e55f970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:09.888757 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decd9da-3e3e-4bc1-b8d6-18bb93cde03a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:09.889043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decd9da-3e3e-4bc1-b8d6-18bb93cde03a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:09.889323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decd9da-3e3e-4bc1-b8d6-18bb93cde03a admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:09.890101 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decd9da-3e3e-4bc1-b8d6-18bb93cde03a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:09.890401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decd9da-3e3e-4bc1-b8d6-18bb93cde03a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:09.892301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decd9da-3e3e-4bc1-b8d6-18bb93cde03a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:09.921765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 442/884] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Feb 28 18:39:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:39:09.927515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29c891-5973-4243-8f53-a8986fbe8d9a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:09.937126 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29c891-5973-4243-8f53-a8986fbe8d9a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:09.941772 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd75ac-e1da-424b-b49f-fc41773c0432 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09e3dce80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:09.942377 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd75ac-e1da-424b-b49f-fc41773c0432 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:09.942666 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd75ac-e1da-424b-b49f-fc41773c0432 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:09.942947 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd75ac-e1da-424b-b49f-fc41773c0432 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:09.951250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd75ac-e1da-424b-b49f-fc41773c0432 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:09.952980 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd75ac-e1da-424b-b49f-fc41773c0432 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:09.963091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 443/885] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:39:09 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:09.969658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decd9da-3e3e-4bc1-b8d6-18bb93cde03a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:09.980507 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decd9da-3e3e-4bc1-b8d6-18bb93cde03a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:09.984824 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2232bdd-dd37-4da4-aef0-09f3317ed143 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09e21e2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:09.985544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2232bdd-dd37-4da4-aef0-09f3317ed143 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:09.985838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2232bdd-dd37-4da4-aef0-09f3317ed143 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:09.986126 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2232bdd-dd37-4da4-aef0-09f3317ed143 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:09.998258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2232bdd-dd37-4da4-aef0-09f3317ed143 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:10.000119 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2232bdd-dd37-4da4-aef0-09f3317ed143 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:10.017267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-d2232bdd-dd37-4da4-aef0-09f3317ed143 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:10.018354 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 443/886] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:10.024775 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd75ac-e1da-424b-b49f-fc41773c0432 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:10.033462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd75ac-e1da-424b-b49f-fc41773c0432 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:10.039670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1c275-bf48-4d40-948f-3ee48229ba1e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09e1c8df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:10.040254 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c275-bf48-4d40-948f-3ee48229ba1e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:10.040537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c275-bf48-4d40-948f-3ee48229ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:10.040814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c275-bf48-4d40-948f-3ee48229ba1e admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:10.041491 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1c275-bf48-4d40-948f-3ee48229ba1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:10.041847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1c275-bf48-4d40-948f-3ee48229ba1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:10.043541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1c275-bf48-4d40-948f-3ee48229ba1e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:10.055650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 444/887] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:10.061455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2232bdd-dd37-4da4-aef0-09f3317ed143 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:10.070765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2232bdd-dd37-4da4-aef0-09f3317ed143 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:10.074946 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae223a7-e5b8-4322-92c9-0ca0c78b9038 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09e14a190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:10.075691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae223a7-e5b8-4322-92c9-0ca0c78b9038 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:10.075984 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae223a7-e5b8-4322-92c9-0ca0c78b9038 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:10.076268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae223a7-e5b8-4322-92c9-0ca0c78b9038 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:10.084692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae223a7-e5b8-4322-92c9-0ca0c78b9038 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:10.087067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae223a7-e5b8-4322-92c9-0ca0c78b9038 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:10.101788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-dae223a7-e5b8-4322-92c9-0ca0c78b9038 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:39:10.102920 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 444/888] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:10.109179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1c275-bf48-4d40-948f-3ee48229ba1e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:10.118775 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1c275-bf48-4d40-948f-3ee48229ba1e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:10.122969 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cbb35-f821-4fce-ab42-eea151dde6dc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09e1c8fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:10.123579 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cbb35-f821-4fce-ab42-eea151dde6dc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:10.123864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cbb35-f821-4fce-ab42-eea151dde6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:10.124139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cbb35-f821-4fce-ab42-eea151dde6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:10.124874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cbb35-f821-4fce-ab42-eea151dde6dc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:10.125171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cbb35-f821-4fce-ab42-eea151dde6dc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:10.126987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cbb35-f821-4fce-ab42-eea151dde6dc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:10.143972 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 445/889] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:10.153201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae223a7-e5b8-4322-92c9-0ca0c78b9038 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:10.162638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae223a7-e5b8-4322-92c9-0ca0c78b9038 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:10.167477 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323b4fa-7579-4f54-b35a-a111acd5ceb8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YzPdd0eeSf6fTL1qiob1yg, audit_chain_id=['YzPdd0eeSf6fTL1qiob1yg']) at 0x7fe09e55f970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:10.168105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323b4fa-7579-4f54-b35a-a111acd5ceb8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:10.168400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323b4fa-7579-4f54-b35a-a111acd5ceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:10.168687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323b4fa-7579-4f54-b35a-a111acd5ceb8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:10.169468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323b4fa-7579-4f54-b35a-a111acd5ceb8 admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=5bf96e3d5ba3483896dcb079f8e7b0bb) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:10.169776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323b4fa-7579-4f54-b35a-a111acd5ceb8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:10.171706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323b4fa-7579-4f54-b35a-a111acd5ceb8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:10.177086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 445/890] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:39:10 2022] GET /identity/v3/role_assignments?user.id=5bf96e3d5ba3483896dcb079f8e7b0bb&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:12.296596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add0f8e-5a62-45f3-937d-dfdf91c61172 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.297148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add0f8e-5a62-45f3-937d-dfdf91c61172 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.297148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add0f8e-5a62-45f3-937d-dfdf91c61172 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.298777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 446/891] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:12.304130 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800756b5-96ff-4a02-89e6-04753f7887dc None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.304551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800756b5-96ff-4a02-89e6-04753f7887dc None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.304695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800756b5-96ff-4a02-89e6-04753f7887dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.328083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-800756b5-96ff-4a02-89e6-04753f7887dc None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:12.329226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-800756b5-96ff-4a02-89e6-04753f7887dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:12.336796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 446/892] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:12.361548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add0f8e-5a62-45f3-937d-dfdf91c61172 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:12.373338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add0f8e-5a62-45f3-937d-dfdf91c61172 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:12.377429 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b1165-a8d1-4303-adc4-bd384234b436 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jb9UNYmmRV28GWyzcjd1LQ, audit_chain_id=['Jb9UNYmmRV28GWyzcjd1LQ']) at 0x7fe09e1b8cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:12.378139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b1165-a8d1-4303-adc4-bd384234b436 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.378422 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b1165-a8d1-4303-adc4-bd384234b436 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.378698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b1165-a8d1-4303-adc4-bd384234b436 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.390178 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b1165-a8d1-4303-adc4-bd384234b436 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:39:12.396465 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-496b1165-a8d1-4303-adc4-bd384234b436 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:39:12.398134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 447/893] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:39:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:12.404306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800756b5-96ff-4a02-89e6-04753f7887dc None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:12.412914 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800756b5-96ff-4a02-89e6-04753f7887dc None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:12.417190 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3720e9-de9c-43d0-8567-81a998100842 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jb9UNYmmRV28GWyzcjd1LQ, audit_chain_id=['Jb9UNYmmRV28GWyzcjd1LQ']) at 0x7fe09e1c0f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:12.417784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3720e9-de9c-43d0-8567-81a998100842 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.418071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3720e9-de9c-43d0-8567-81a998100842 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.418351 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3720e9-de9c-43d0-8567-81a998100842 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.419059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3720e9-de9c-43d0-8567-81a998100842 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:12.419391 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3720e9-de9c-43d0-8567-81a998100842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:12.420959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3720e9-de9c-43d0-8567-81a998100842 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:12.429352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 447/894] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:39:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:12.436886 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b1165-a8d1-4303-adc4-bd384234b436 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:12.449351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b1165-a8d1-4303-adc4-bd384234b436 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:12.453657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcdb08-b8af-4a00-9081-56ccf61d926b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jb9UNYmmRV28GWyzcjd1LQ, audit_chain_id=['Jb9UNYmmRV28GWyzcjd1LQ']) at 0x7fe09e1ccca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:12.454378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdb08-b8af-4a00-9081-56ccf61d926b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.454670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdb08-b8af-4a00-9081-56ccf61d926b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.454956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcdb08-b8af-4a00-9081-56ccf61d926b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.467263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcdb08-b8af-4a00-9081-56ccf61d926b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:12.469092 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcdb08-b8af-4a00-9081-56ccf61d926b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:12.486053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-e8dcdb08-b8af-4a00-9081-56ccf61d926b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:12.487185 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 448/895] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:12.493387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3720e9-de9c-43d0-8567-81a998100842 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:12.502691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3720e9-de9c-43d0-8567-81a998100842 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:12.508178 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59edf07-59c7-4ac4-a047-17b52e9211d3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jb9UNYmmRV28GWyzcjd1LQ, audit_chain_id=['Jb9UNYmmRV28GWyzcjd1LQ']) at 0x7fe09e155280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:12.508762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59edf07-59c7-4ac4-a047-17b52e9211d3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.509052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59edf07-59c7-4ac4-a047-17b52e9211d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.509331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59edf07-59c7-4ac4-a047-17b52e9211d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.510079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59edf07-59c7-4ac4-a047-17b52e9211d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:12.510380 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59edf07-59c7-4ac4-a047-17b52e9211d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:12.511985 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59edf07-59c7-4ac4-a047-17b52e9211d3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:12.525475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 448/896] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:12.531322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcdb08-b8af-4a00-9081-56ccf61d926b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:12.541623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcdb08-b8af-4a00-9081-56ccf61d926b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:12.546000 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97554ea-b3ef-4cf6-be88-7c12223d0bc4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jb9UNYmmRV28GWyzcjd1LQ, audit_chain_id=['Jb9UNYmmRV28GWyzcjd1LQ']) at 0x7fe09e143280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:12.546775 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97554ea-b3ef-4cf6-be88-7c12223d0bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.547013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97554ea-b3ef-4cf6-be88-7c12223d0bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.547349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97554ea-b3ef-4cf6-be88-7c12223d0bc4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.560675 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97554ea-b3ef-4cf6-be88-7c12223d0bc4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:12.562678 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97554ea-b3ef-4cf6-be88-7c12223d0bc4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:12.581251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-a97554ea-b3ef-4cf6-be88-7c12223d0bc4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:39:12.582421 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 449/897] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:12.591078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59edf07-59c7-4ac4-a047-17b52e9211d3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:12.600634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59edf07-59c7-4ac4-a047-17b52e9211d3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:12.604916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa995f-1374-447e-806f-f8a833050c7e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jb9UNYmmRV28GWyzcjd1LQ, audit_chain_id=['Jb9UNYmmRV28GWyzcjd1LQ']) at 0x7fe09e55ffd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:12.605514 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa995f-1374-447e-806f-f8a833050c7e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.605806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa995f-1374-447e-806f-f8a833050c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.606089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa995f-1374-447e-806f-f8a833050c7e admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.606875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa995f-1374-447e-806f-f8a833050c7e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:12.607204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa995f-1374-447e-806f-f8a833050c7e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:12.609043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa995f-1374-447e-806f-f8a833050c7e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:12.638822 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 449/898] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Feb 28 18:39:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:12.644790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97554ea-b3ef-4cf6-be88-7c12223d0bc4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:12.655642 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97554ea-b3ef-4cf6-be88-7c12223d0bc4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:12.659987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801ef1d-0ebf-46eb-a54c-b5478ed53463 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jb9UNYmmRV28GWyzcjd1LQ, audit_chain_id=['Jb9UNYmmRV28GWyzcjd1LQ']) at 0x7fe09e188850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:12.660700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801ef1d-0ebf-46eb-a54c-b5478ed53463 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.660989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801ef1d-0ebf-46eb-a54c-b5478ed53463 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.661272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801ef1d-0ebf-46eb-a54c-b5478ed53463 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.673750 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801ef1d-0ebf-46eb-a54c-b5478ed53463 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:12.675657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801ef1d-0ebf-46eb-a54c-b5478ed53463 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:12.692876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-c801ef1d-0ebf-46eb-a54c-b5478ed53463 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:12.693959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 450/899] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:12.700774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa995f-1374-447e-806f-f8a833050c7e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:12.711149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa995f-1374-447e-806f-f8a833050c7e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:12.715614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef48dc6-fff0-4802-986e-78de626611d4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jb9UNYmmRV28GWyzcjd1LQ, audit_chain_id=['Jb9UNYmmRV28GWyzcjd1LQ']) at 0x7fe09df255e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:12.716202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48dc6-fff0-4802-986e-78de626611d4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.716485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48dc6-fff0-4802-986e-78de626611d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.716760 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48dc6-fff0-4802-986e-78de626611d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.717434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef48dc6-fff0-4802-986e-78de626611d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:12.717846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef48dc6-fff0-4802-986e-78de626611d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:12.719445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef48dc6-fff0-4802-986e-78de626611d4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:12.731686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 450/900] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:12.737869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801ef1d-0ebf-46eb-a54c-b5478ed53463 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:12.748169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801ef1d-0ebf-46eb-a54c-b5478ed53463 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:12.752498 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507898c1-7be0-4f28-8041-96150071f666 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jb9UNYmmRV28GWyzcjd1LQ, audit_chain_id=['Jb9UNYmmRV28GWyzcjd1LQ']) at 0x7fe09e1432b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:12.753217 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507898c1-7be0-4f28-8041-96150071f666 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.753504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507898c1-7be0-4f28-8041-96150071f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.753785 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507898c1-7be0-4f28-8041-96150071f666 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.763171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507898c1-7be0-4f28-8041-96150071f666 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:12.765107 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507898c1-7be0-4f28-8041-96150071f666 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:12.778752 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-507898c1-7be0-4f28-8041-96150071f666 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:39:12.779855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 451/901] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:12.786108 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef48dc6-fff0-4802-986e-78de626611d4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:12.796476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef48dc6-fff0-4802-986e-78de626611d4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:12.800915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77588731-0fd1-4ed1-883e-380c0344bd0f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jb9UNYmmRV28GWyzcjd1LQ, audit_chain_id=['Jb9UNYmmRV28GWyzcjd1LQ']) at 0x7fe09e118e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:12.801474 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588731-0fd1-4ed1-883e-380c0344bd0f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.801765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588731-0fd1-4ed1-883e-380c0344bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.802047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588731-0fd1-4ed1-883e-380c0344bd0f admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.802785 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77588731-0fd1-4ed1-883e-380c0344bd0f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:12.803089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77588731-0fd1-4ed1-883e-380c0344bd0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:12.806057 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77588731-0fd1-4ed1-883e-380c0344bd0f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:12.823363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 451/902] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:39:12.830313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507898c1-7be0-4f28-8041-96150071f666 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:12.840240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507898c1-7be0-4f28-8041-96150071f666 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:12.844471 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a267c-2a59-44c3-9104-da1a3be0bc98 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jb9UNYmmRV28GWyzcjd1LQ, audit_chain_id=['Jb9UNYmmRV28GWyzcjd1LQ']) at 0x7fe09e3e4f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:12.845278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a267c-2a59-44c3-9104-da1a3be0bc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:12.845562 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a267c-2a59-44c3-9104-da1a3be0bc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:12.845844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a267c-2a59-44c3-9104-da1a3be0bc98 admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/5bf96e3d5ba3483896dcb079f8e7b0bb/roles/9a37fbff179849e58437f2fad75ce546` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:12.865282 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a267c-2a59-44c3-9104-da1a3be0bc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=5bf96e3d5ba3483896dcb079f8e7b0bb, role_id=9a37fbff179849e58437f2fad75ce546)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:12.868783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a267c-2a59-44c3-9104-da1a3be0bc98 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:12.942100 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 452/903] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:39:12 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/5bf96e3d5ba3483896dcb079f8e7b0bb/roles/9a37fbff179849e58437f2fad75ce546 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:39:15.060057 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9a247-4f47-4a49-8214-47b3c17bf079 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.060800 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9a247-4f47-4a49-8214-47b3c17bf079 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.060800 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9a247-4f47-4a49-8214-47b3c17bf079 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.063162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 452/904] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:15.067882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349101c-46cb-411c-8398-7b7cf817376b None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.068308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349101c-46cb-411c-8398-7b7cf817376b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.068445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349101c-46cb-411c-8398-7b7cf817376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.092610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b349101c-46cb-411c-8398-7b7cf817376b None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:15.093768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b349101c-46cb-411c-8398-7b7cf817376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:15.158461 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 453/905] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:15.184044 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9a247-4f47-4a49-8214-47b3c17bf079 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.197205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9a247-4f47-4a49-8214-47b3c17bf079 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.201515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ded6a7-179b-48cf-b90d-34f6912fe96a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09df25af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.202242 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded6a7-179b-48cf-b90d-34f6912fe96a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.202531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded6a7-179b-48cf-b90d-34f6912fe96a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.202811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded6a7-179b-48cf-b90d-34f6912fe96a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.214969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ded6a7-179b-48cf-b90d-34f6912fe96a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:39:15.221263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-e2ded6a7-179b-48cf-b90d-34f6912fe96a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:39:15.222401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 453/906] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:15.229442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349101c-46cb-411c-8398-7b7cf817376b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.238137 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349101c-46cb-411c-8398-7b7cf817376b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.243161 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c917ed-f155-487f-8472-831448cffbfc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09e1df850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.243752 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c917ed-f155-487f-8472-831448cffbfc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.244036 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c917ed-f155-487f-8472-831448cffbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.244314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c917ed-f155-487f-8472-831448cffbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.245026 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c917ed-f155-487f-8472-831448cffbfc admin admin] RBAC: Adding query filter params (name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:15.245313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c917ed-f155-487f-8472-831448cffbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:15.246898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c917ed-f155-487f-8472-831448cffbfc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:15.255284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 454/907] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:15.262159 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ded6a7-179b-48cf-b90d-34f6912fe96a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.272164 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ded6a7-179b-48cf-b90d-34f6912fe96a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.276549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360e276-4394-4dd9-a03f-9a9201803ce0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09e118040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.277267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360e276-4394-4dd9-a03f-9a9201803ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.277556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360e276-4394-4dd9-a03f-9a9201803ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.277838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360e276-4394-4dd9-a03f-9a9201803ce0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.290448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360e276-4394-4dd9-a03f-9a9201803ce0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:15.293852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360e276-4394-4dd9-a03f-9a9201803ce0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:15.316106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-9360e276-4394-4dd9-a03f-9a9201803ce0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:15.317264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 454/908] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:39:15.323898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c917ed-f155-487f-8472-831448cffbfc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.333535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c917ed-f155-487f-8472-831448cffbfc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.337930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f5b6a-9de9-42e9-ab09-4b0be76e1a87 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09e159a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.338517 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f5b6a-9de9-42e9-ab09-4b0be76e1a87 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.338803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f5b6a-9de9-42e9-ab09-4b0be76e1a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.339363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f5b6a-9de9-42e9-ab09-4b0be76e1a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.340045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f5b6a-9de9-42e9-ab09-4b0be76e1a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:15.340339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f5b6a-9de9-42e9-ab09-4b0be76e1a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:15.341933 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f5b6a-9de9-42e9-ab09-4b0be76e1a87 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:15.356544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 455/909] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:15.362312 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360e276-4394-4dd9-a03f-9a9201803ce0 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.372386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360e276-4394-4dd9-a03f-9a9201803ce0 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.376625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3b11-ca76-42ed-a1d5-312702b158fe admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09e14a250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.377339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3b11-ca76-42ed-a1d5-312702b158fe admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.377628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3b11-ca76-42ed-a1d5-312702b158fe admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.377910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3b11-ca76-42ed-a1d5-312702b158fe admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.390592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b3b11-ca76-42ed-a1d5-312702b158fe admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:15.392617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b3b11-ca76-42ed-a1d5-312702b158fe admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:15.410508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-892b3b11-ca76-42ed-a1d5-312702b158fe admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:39:15.411643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 455/910] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:15.418333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f5b6a-9de9-42e9-ab09-4b0be76e1a87 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.428078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f5b6a-9de9-42e9-ab09-4b0be76e1a87 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.433005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033ae36-4dbd-43e2-b9e8-10f20dd86c99 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09e16e6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.433592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033ae36-4dbd-43e2-b9e8-10f20dd86c99 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.433872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033ae36-4dbd-43e2-b9e8-10f20dd86c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.434148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033ae36-4dbd-43e2-b9e8-10f20dd86c99 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.434928 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033ae36-4dbd-43e2-b9e8-10f20dd86c99 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:15.435258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033ae36-4dbd-43e2-b9e8-10f20dd86c99 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:15.437108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033ae36-4dbd-43e2-b9e8-10f20dd86c99 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:15.466110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 456/911] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:39:15.471955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3b11-ca76-42ed-a1d5-312702b158fe admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.482005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3b11-ca76-42ed-a1d5-312702b158fe admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.486265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28213d6-c9aa-4562-acfb-b0ad4400e542 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09e21e2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.486844 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28213d6-c9aa-4562-acfb-b0ad4400e542 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.487166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28213d6-c9aa-4562-acfb-b0ad4400e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.487452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28213d6-c9aa-4562-acfb-b0ad4400e542 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.495789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28213d6-c9aa-4562-acfb-b0ad4400e542 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:15.497525 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28213d6-c9aa-4562-acfb-b0ad4400e542 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:15.506862 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 456/912] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:15.512753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033ae36-4dbd-43e2-b9e8-10f20dd86c99 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.522534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033ae36-4dbd-43e2-b9e8-10f20dd86c99 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.526949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53ed32-2de7-4d32-a340-1525130ac0d0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09e3de9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.527722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ed32-2de7-4d32-a340-1525130ac0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.528009 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ed32-2de7-4d32-a340-1525130ac0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.528292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ed32-2de7-4d32-a340-1525130ac0d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.541206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53ed32-2de7-4d32-a340-1525130ac0d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:15.543031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53ed32-2de7-4d32-a340-1525130ac0d0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:15.562544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-fc53ed32-2de7-4d32-a340-1525130ac0d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:15.563736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 457/913] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:15.569722 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28213d6-c9aa-4562-acfb-b0ad4400e542 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.578415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28213d6-c9aa-4562-acfb-b0ad4400e542 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.582803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248f78-5c65-45cb-b91f-7af39fba4107 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09e106b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.583425 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248f78-5c65-45cb-b91f-7af39fba4107 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.583719 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248f78-5c65-45cb-b91f-7af39fba4107 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.584004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248f78-5c65-45cb-b91f-7af39fba4107 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.584689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6248f78-5c65-45cb-b91f-7af39fba4107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:15.584990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6248f78-5c65-45cb-b91f-7af39fba4107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:15.586685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6248f78-5c65-45cb-b91f-7af39fba4107 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:15.599366 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 457/914] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:15.605652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53ed32-2de7-4d32-a340-1525130ac0d0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.615221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53ed32-2de7-4d32-a340-1525130ac0d0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.620052 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109150d-cb46-4e7f-b6ea-693dfe15aec2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09e1fbbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.620758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109150d-cb46-4e7f-b6ea-693dfe15aec2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.621047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109150d-cb46-4e7f-b6ea-693dfe15aec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.621321 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109150d-cb46-4e7f-b6ea-693dfe15aec2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.629949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109150d-cb46-4e7f-b6ea-693dfe15aec2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:15.632249 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109150d-cb46-4e7f-b6ea-693dfe15aec2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:15.645938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-2109150d-cb46-4e7f-b6ea-693dfe15aec2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:39:15.647012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 458/915] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:15.652899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248f78-5c65-45cb-b91f-7af39fba4107 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.662302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248f78-5c65-45cb-b91f-7af39fba4107 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.667370 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777040-2744-4cf4-9e73-b937ca9215fb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09e55f610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.667957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777040-2744-4cf4-9e73-b937ca9215fb admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.668241 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777040-2744-4cf4-9e73-b937ca9215fb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.668518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777040-2744-4cf4-9e73-b937ca9215fb admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.669253 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777040-2744-4cf4-9e73-b937ca9215fb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:15.669551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777040-2744-4cf4-9e73-b937ca9215fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:15.671393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777040-2744-4cf4-9e73-b937ca9215fb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:15.684803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 458/916] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:15.691436 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109150d-cb46-4e7f-b6ea-693dfe15aec2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:15.701579 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109150d-cb46-4e7f-b6ea-693dfe15aec2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:15.706462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dca464-1587-46f9-92ec-c9d3c21a1e4a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TtNytIuITbG68-oQ1gzWAg, audit_chain_id=['TtNytIuITbG68-oQ1gzWAg']) at 0x7fe09e3c4a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:15.707029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dca464-1587-46f9-92ec-c9d3c21a1e4a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:15.707353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dca464-1587-46f9-92ec-c9d3c21a1e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:15.707635 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dca464-1587-46f9-92ec-c9d3c21a1e4a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:15.708412 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dca464-1587-46f9-92ec-c9d3c21a1e4a admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=5bf96e3d5ba3483896dcb079f8e7b0bb) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:15.708718 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dca464-1587-46f9-92ec-c9d3c21a1e4a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:15.710797 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dca464-1587-46f9-92ec-c9d3c21a1e4a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:15.716982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 459/917] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:39:15 2022] GET /identity/v3/role_assignments?user.id=5bf96e3d5ba3483896dcb079f8e7b0bb&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:17.884748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ad4f-9b50-4849-83f6-77708b2165ce None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:17.885315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ad4f-9b50-4849-83f6-77708b2165ce None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:17.885315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ad4f-9b50-4849-83f6-77708b2165ce None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:17.886978 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 459/918] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:17.892062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a875c9-aac7-4bbf-b269-257a5edb175f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:17.892447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a875c9-aac7-4bbf-b269-257a5edb175f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:17.892628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a875c9-aac7-4bbf-b269-257a5edb175f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:17.915547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-07a875c9-aac7-4bbf-b269-257a5edb175f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:17.916699 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-07a875c9-aac7-4bbf-b269-257a5edb175f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:17.923734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 460/919] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:17.947170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442ad4f-9b50-4849-83f6-77708b2165ce None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:17.959175 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442ad4f-9b50-4849-83f6-77708b2165ce None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:17.964805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d233ce1-c6cd-4e83-b1ca-03734ef0f895 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09e118be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:17.965529 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d233ce1-c6cd-4e83-b1ca-03734ef0f895 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:17.965821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d233ce1-c6cd-4e83-b1ca-03734ef0f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:17.966107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d233ce1-c6cd-4e83-b1ca-03734ef0f895 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:17.977725 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d233ce1-c6cd-4e83-b1ca-03734ef0f895 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:39:17.983954 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-2d233ce1-c6cd-4e83-b1ca-03734ef0f895 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:39:17.985087 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 460/920] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:17.991691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a875c9-aac7-4bbf-b269-257a5edb175f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:18.000663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a875c9-aac7-4bbf-b269-257a5edb175f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:18.005506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07663a84-1f3f-478d-9c32-67495215b4b2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09e47e880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:18.007058 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07663a84-1f3f-478d-9c32-67495215b4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.007713 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07663a84-1f3f-478d-9c32-67495215b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.007957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07663a84-1f3f-478d-9c32-67495215b4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.009036 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07663a84-1f3f-478d-9c32-67495215b4b2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:18.009346 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07663a84-1f3f-478d-9c32-67495215b4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:18.010943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07663a84-1f3f-478d-9c32-67495215b4b2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:18.019719 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 461/921] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:39:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:18.026085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d233ce1-c6cd-4e83-b1ca-03734ef0f895 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:18.035822 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d233ce1-c6cd-4e83-b1ca-03734ef0f895 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:18.040535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04db2c9-9226-45e5-9107-c155c9c73c79 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09e15e640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:18.041245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db2c9-9226-45e5-9107-c155c9c73c79 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.041531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db2c9-9226-45e5-9107-c155c9c73c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.041813 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db2c9-9226-45e5-9107-c155c9c73c79 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.053356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04db2c9-9226-45e5-9107-c155c9c73c79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:18.055283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04db2c9-9226-45e5-9107-c155c9c73c79 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:18.071908 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-e04db2c9-9226-45e5-9107-c155c9c73c79 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:18.072999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 461/922] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:18.079131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07663a84-1f3f-478d-9c32-67495215b4b2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:18.090269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07663a84-1f3f-478d-9c32-67495215b4b2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:18.094949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a892e3-5f9e-44bd-84e3-4cb8e22699dc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09e3d1af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:18.095079 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a892e3-5f9e-44bd-84e3-4cb8e22699dc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.096209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a892e3-5f9e-44bd-84e3-4cb8e22699dc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.096209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a892e3-5f9e-44bd-84e3-4cb8e22699dc admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.096411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a892e3-5f9e-44bd-84e3-4cb8e22699dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:18.096580 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a892e3-5f9e-44bd-84e3-4cb8e22699dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:18.098163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a892e3-5f9e-44bd-84e3-4cb8e22699dc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:18.111060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 462/923] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:39:18.117130 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04db2c9-9226-45e5-9107-c155c9c73c79 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:18.126480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04db2c9-9226-45e5-9107-c155c9c73c79 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:18.130842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf2172-5c86-4cd6-a5e8-71ddb32ebf58 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09e21e250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:18.131806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf2172-5c86-4cd6-a5e8-71ddb32ebf58 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.132114 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf2172-5c86-4cd6-a5e8-71ddb32ebf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.132403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf2172-5c86-4cd6-a5e8-71ddb32ebf58 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.144935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf2172-5c86-4cd6-a5e8-71ddb32ebf58 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:18.147606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf2172-5c86-4cd6-a5e8-71ddb32ebf58 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:18.165492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-bfbf2172-5c86-4cd6-a5e8-71ddb32ebf58 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:39:18.166584 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 462/924] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:18.172423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a892e3-5f9e-44bd-84e3-4cb8e22699dc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:18.181992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a892e3-5f9e-44bd-84e3-4cb8e22699dc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:18.186259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739e91-0d87-44c4-80d8-60bd83fa1674 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09e472310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:18.186843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739e91-0d87-44c4-80d8-60bd83fa1674 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.187142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739e91-0d87-44c4-80d8-60bd83fa1674 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.187427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739e91-0d87-44c4-80d8-60bd83fa1674 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.188206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739e91-0d87-44c4-80d8-60bd83fa1674 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:18.188503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739e91-0d87-44c4-80d8-60bd83fa1674 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:18.190320 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739e91-0d87-44c4-80d8-60bd83fa1674 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:18.219613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 463/925] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Feb 28 18:39:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:18.225942 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf2172-5c86-4cd6-a5e8-71ddb32ebf58 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:18.235501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf2172-5c86-4cd6-a5e8-71ddb32ebf58 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:18.239759 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe8eca-60f6-45ea-8703-81de812c20a1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09e194b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:18.240336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe8eca-60f6-45ea-8703-81de812c20a1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.240628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe8eca-60f6-45ea-8703-81de812c20a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.240910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe8eca-60f6-45ea-8703-81de812c20a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.248702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe8eca-60f6-45ea-8703-81de812c20a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:18.250493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe8eca-60f6-45ea-8703-81de812c20a1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:18.260711 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 463/926] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:39:18 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:18.266586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739e91-0d87-44c4-80d8-60bd83fa1674 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:18.276657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739e91-0d87-44c4-80d8-60bd83fa1674 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:18.280870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86033c7-0c20-4b20-a146-60694f98f577 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09e4d61c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:18.281581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86033c7-0c20-4b20-a146-60694f98f577 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.281920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86033c7-0c20-4b20-a146-60694f98f577 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.282203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86033c7-0c20-4b20-a146-60694f98f577 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.294503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86033c7-0c20-4b20-a146-60694f98f577 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:18.296420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86033c7-0c20-4b20-a146-60694f98f577 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:18.313354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-e86033c7-0c20-4b20-a146-60694f98f577 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:18.314453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 464/927] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:18.320924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe8eca-60f6-45ea-8703-81de812c20a1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:18.329681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe8eca-60f6-45ea-8703-81de812c20a1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:18.334022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851524a5-3f2e-4c7b-8da9-434de0c82344 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09df3b970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:18.335463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851524a5-3f2e-4c7b-8da9-434de0c82344 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.335852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851524a5-3f2e-4c7b-8da9-434de0c82344 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.336184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851524a5-3f2e-4c7b-8da9-434de0c82344 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.336933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851524a5-3f2e-4c7b-8da9-434de0c82344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:18.337281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851524a5-3f2e-4c7b-8da9-434de0c82344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:18.339383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851524a5-3f2e-4c7b-8da9-434de0c82344 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:18.353105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 464/928] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:18.358923 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86033c7-0c20-4b20-a146-60694f98f577 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:18.368700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86033c7-0c20-4b20-a146-60694f98f577 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:18.373226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07c92d-4369-4130-9097-662edd7f4385 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09e1983d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:18.373944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07c92d-4369-4130-9097-662edd7f4385 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.374227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07c92d-4369-4130-9097-662edd7f4385 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.374504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07c92d-4369-4130-9097-662edd7f4385 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.384105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07c92d-4369-4130-9097-662edd7f4385 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:18.386071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07c92d-4369-4130-9097-662edd7f4385 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:18.400679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-0a07c92d-4369-4130-9097-662edd7f4385 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:39:18.401754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 465/929] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:18.408194 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851524a5-3f2e-4c7b-8da9-434de0c82344 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:18.418738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851524a5-3f2e-4c7b-8da9-434de0c82344 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:18.423347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45973d45-714e-477d-9b83-133fb402c980 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09e155b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:18.423987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45973d45-714e-477d-9b83-133fb402c980 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.424310 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45973d45-714e-477d-9b83-133fb402c980 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.424627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45973d45-714e-477d-9b83-133fb402c980 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.425413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45973d45-714e-477d-9b83-133fb402c980 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:18.425757 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45973d45-714e-477d-9b83-133fb402c980 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:18.427673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45973d45-714e-477d-9b83-133fb402c980 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:18.440870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 465/930] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:39:18.448217 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07c92d-4369-4130-9097-662edd7f4385 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:18.457862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07c92d-4369-4130-9097-662edd7f4385 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:18.463209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3ad36-0cc4-4fee-acb7-9a863b9e9cc8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nb5xFN4tS7S7dlj8KfgtcQ, audit_chain_id=['nb5xFN4tS7S7dlj8KfgtcQ']) at 0x7fe09e1882e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:18.464037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ad36-0cc4-4fee-acb7-9a863b9e9cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.464383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ad36-0cc4-4fee-acb7-9a863b9e9cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.464713 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ad36-0cc4-4fee-acb7-9a863b9e9cc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.465531 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3ad36-0cc4-4fee-acb7-9a863b9e9cc8 admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=5bf96e3d5ba3483896dcb079f8e7b0bb) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:18.465875 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3ad36-0cc4-4fee-acb7-9a863b9e9cc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:18.469232 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3ad36-0cc4-4fee-acb7-9a863b9e9cc8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:18.479613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 466/931] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:39:18 2022] GET /identity/v3/role_assignments?user.id=5bf96e3d5ba3483896dcb079f8e7b0bb&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:39:20.593025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f714a-2b09-4e83-bce7-d3c9836e387b None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:20.593587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f714a-2b09-4e83-bce7-d3c9836e387b None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:20.593587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f714a-2b09-4e83-bce7-d3c9836e387b None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:20.595688 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 466/932] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:20.601923 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a164d8-d03e-4b8e-9764-c451f26c5fce None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:20.602373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a164d8-d03e-4b8e-9764-c451f26c5fce None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:20.602487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a164d8-d03e-4b8e-9764-c451f26c5fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:20.625376 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-96a164d8-d03e-4b8e-9764-c451f26c5fce None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:20.626534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-96a164d8-d03e-4b8e-9764-c451f26c5fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:20.634086 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 467/933] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:39:20.657314 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f714a-2b09-4e83-bce7-d3c9836e387b None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:20.669642 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f714a-2b09-4e83-bce7-d3c9836e387b None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:20.674016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29042-16da-4f82-9d00-abd9ba64f73e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=B6FrTkTcRpi1C03xXDKJpA, audit_chain_id=['B6FrTkTcRpi1C03xXDKJpA']) at 0x7fe09df3b790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:20.674716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29042-16da-4f82-9d00-abd9ba64f73e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:20.675004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29042-16da-4f82-9d00-abd9ba64f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:20.675309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29042-16da-4f82-9d00-abd9ba64f73e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:20.687324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f29042-16da-4f82-9d00-abd9ba64f73e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:39:20.693550 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-b4f29042-16da-4f82-9d00-abd9ba64f73e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:39:20.694897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 467/934] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:20.701169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a164d8-d03e-4b8e-9764-c451f26c5fce None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:20.710014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a164d8-d03e-4b8e-9764-c451f26c5fce None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:20.714845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb953517-735c-4933-adba-ab69420709c6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=B6FrTkTcRpi1C03xXDKJpA, audit_chain_id=['B6FrTkTcRpi1C03xXDKJpA']) at 0x7fe09e3bfd00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:20.715478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb953517-735c-4933-adba-ab69420709c6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:20.715766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb953517-735c-4933-adba-ab69420709c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:20.716050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb953517-735c-4933-adba-ab69420709c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:20.716766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb953517-735c-4933-adba-ab69420709c6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:20.717060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb953517-735c-4933-adba-ab69420709c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:20.718661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb953517-735c-4933-adba-ab69420709c6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:20.728330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 468/935] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:39:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:20.734078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29042-16da-4f82-9d00-abd9ba64f73e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:20.744561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29042-16da-4f82-9d00-abd9ba64f73e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:20.748777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d5f6c-afa7-4714-94d8-491e321acea6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=B6FrTkTcRpi1C03xXDKJpA, audit_chain_id=['B6FrTkTcRpi1C03xXDKJpA']) at 0x7fe09e1066d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:20.749498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d5f6c-afa7-4714-94d8-491e321acea6 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:20.749791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d5f6c-afa7-4714-94d8-491e321acea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:20.750074 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d5f6c-afa7-4714-94d8-491e321acea6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:20.761407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d5f6c-afa7-4714-94d8-491e321acea6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:20.763258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d5f6c-afa7-4714-94d8-491e321acea6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:20.780430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-fe4d5f6c-afa7-4714-94d8-491e321acea6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:20.781558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 468/936] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:20.787434 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb953517-735c-4933-adba-ab69420709c6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:20.797548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb953517-735c-4933-adba-ab69420709c6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:20.801737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b03f9-204c-4b37-a883-373d8d2142e1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=B6FrTkTcRpi1C03xXDKJpA, audit_chain_id=['B6FrTkTcRpi1C03xXDKJpA']) at 0x7fe09df0b880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:20.802327 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b03f9-204c-4b37-a883-373d8d2142e1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:20.802614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b03f9-204c-4b37-a883-373d8d2142e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:20.802895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b03f9-204c-4b37-a883-373d8d2142e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:20.804214 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b03f9-204c-4b37-a883-373d8d2142e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:20.804516 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b03f9-204c-4b37-a883-373d8d2142e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:20.806098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b03f9-204c-4b37-a883-373d8d2142e1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:20.820170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 469/937] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:20.826039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d5f6c-afa7-4714-94d8-491e321acea6 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:20.835510 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d5f6c-afa7-4714-94d8-491e321acea6 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:20.840033 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c7cbd-f70a-46a7-b18f-940acfab74d2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=B6FrTkTcRpi1C03xXDKJpA, audit_chain_id=['B6FrTkTcRpi1C03xXDKJpA']) at 0x7fe09e1237c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:20.840754 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c7cbd-f70a-46a7-b18f-940acfab74d2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:20.841039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c7cbd-f70a-46a7-b18f-940acfab74d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:20.841320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c7cbd-f70a-46a7-b18f-940acfab74d2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:20.854661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c7cbd-f70a-46a7-b18f-940acfab74d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:20.856630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c7cbd-f70a-46a7-b18f-940acfab74d2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:20.874569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-ba0c7cbd-f70a-46a7-b18f-940acfab74d2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:39:20.875723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 469/938] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:20.882786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b03f9-204c-4b37-a883-373d8d2142e1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:20.892409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b03f9-204c-4b37-a883-373d8d2142e1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:20.896717 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d50690-67a4-4d93-b3b6-092662989656 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=B6FrTkTcRpi1C03xXDKJpA, audit_chain_id=['B6FrTkTcRpi1C03xXDKJpA']) at 0x7fe09e198ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:20.897455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d50690-67a4-4d93-b3b6-092662989656 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:20.897743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d50690-67a4-4d93-b3b6-092662989656 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:20.898028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d50690-67a4-4d93-b3b6-092662989656 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:20.898819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d50690-67a4-4d93-b3b6-092662989656 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:20.899137 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d50690-67a4-4d93-b3b6-092662989656 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:20.900987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d50690-67a4-4d93-b3b6-092662989656 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:20.933486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 470/939] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Feb 28 18:39:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:39:20.939237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c7cbd-f70a-46a7-b18f-940acfab74d2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:20.950016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c7cbd-f70a-46a7-b18f-940acfab74d2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:20.954325 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97804ea3-ad6b-44d5-b685-3c215e6698be admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=B6FrTkTcRpi1C03xXDKJpA, audit_chain_id=['B6FrTkTcRpi1C03xXDKJpA']) at 0x7fe09e1947c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:20.955050 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804ea3-ad6b-44d5-b685-3c215e6698be admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:20.955372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804ea3-ad6b-44d5-b685-3c215e6698be admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:20.955988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804ea3-ad6b-44d5-b685-3c215e6698be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:20.968446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97804ea3-ad6b-44d5-b685-3c215e6698be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:20.970269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97804ea3-ad6b-44d5-b685-3c215e6698be admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:20.987731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-97804ea3-ad6b-44d5-b685-3c215e6698be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:20.988874 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 470/940] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:20.995405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d50690-67a4-4d93-b3b6-092662989656 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:21.004927 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d50690-67a4-4d93-b3b6-092662989656 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:21.009356 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e29eb8-7ec9-4a4f-93ec-14bf51cc91fe admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=B6FrTkTcRpi1C03xXDKJpA, audit_chain_id=['B6FrTkTcRpi1C03xXDKJpA']) at 0x7fe09e57ef40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:21.009941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29eb8-7ec9-4a4f-93ec-14bf51cc91fe admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:21.010226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29eb8-7ec9-4a4f-93ec-14bf51cc91fe admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:21.010504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29eb8-7ec9-4a4f-93ec-14bf51cc91fe admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:21.011224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e29eb8-7ec9-4a4f-93ec-14bf51cc91fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:21.011521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e29eb8-7ec9-4a4f-93ec-14bf51cc91fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:21.013100 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e29eb8-7ec9-4a4f-93ec-14bf51cc91fe admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:21.026171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 471/941] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:21.031988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97804ea3-ad6b-44d5-b685-3c215e6698be admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:21.042162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97804ea3-ad6b-44d5-b685-3c215e6698be admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:21.046382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386259a4-8629-4549-8fe4-1a9cfa5c91a4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=B6FrTkTcRpi1C03xXDKJpA, audit_chain_id=['B6FrTkTcRpi1C03xXDKJpA']) at 0x7fe09e123dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:21.047094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386259a4-8629-4549-8fe4-1a9cfa5c91a4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:21.047408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386259a4-8629-4549-8fe4-1a9cfa5c91a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:21.047685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386259a4-8629-4549-8fe4-1a9cfa5c91a4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:21.056449 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386259a4-8629-4549-8fe4-1a9cfa5c91a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:21.058374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386259a4-8629-4549-8fe4-1a9cfa5c91a4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:21.071818 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-386259a4-8629-4549-8fe4-1a9cfa5c91a4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:39:21.072900 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 471/942] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:21.078853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e29eb8-7ec9-4a4f-93ec-14bf51cc91fe admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:21.089203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e29eb8-7ec9-4a4f-93ec-14bf51cc91fe admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:21.093456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39164711-b38e-46b8-98e8-b43de89854c2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=B6FrTkTcRpi1C03xXDKJpA, audit_chain_id=['B6FrTkTcRpi1C03xXDKJpA']) at 0x7fe09e1d7250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:21.094037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164711-b38e-46b8-98e8-b43de89854c2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:21.094348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164711-b38e-46b8-98e8-b43de89854c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:21.094629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164711-b38e-46b8-98e8-b43de89854c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:21.095607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39164711-b38e-46b8-98e8-b43de89854c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:21.095728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39164711-b38e-46b8-98e8-b43de89854c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:21.097508 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39164711-b38e-46b8-98e8-b43de89854c2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:21.110513 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 472/943] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:21.116404 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386259a4-8629-4549-8fe4-1a9cfa5c91a4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:21.125773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386259a4-8629-4549-8fe4-1a9cfa5c91a4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:21.129975 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91767e3-7ac6-4210-a870-0dc0ef5e7a8d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=B6FrTkTcRpi1C03xXDKJpA, audit_chain_id=['B6FrTkTcRpi1C03xXDKJpA']) at 0x7fe09e106fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:21.130792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91767e3-7ac6-4210-a870-0dc0ef5e7a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:21.131083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91767e3-7ac6-4210-a870-0dc0ef5e7a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:21.131514 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91767e3-7ac6-4210-a870-0dc0ef5e7a8d admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/5bf96e3d5ba3483896dcb079f8e7b0bb/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:21.133316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91767e3-7ac6-4210-a870-0dc0ef5e7a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=5bf96e3d5ba3483896dcb079f8e7b0bb, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:21.135948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91767e3-7ac6-4210-a870-0dc0ef5e7a8d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:21.233480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 472/944] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:39:21 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/5bf96e3d5ba3483896dcb079f8e7b0bb/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:39:23.357844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56448f7-d1f7-4f1a-a282-f577216c0192 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.358364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56448f7-d1f7-4f1a-a282-f577216c0192 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.358364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56448f7-d1f7-4f1a-a282-f577216c0192 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.360039 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 473/945] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:23.365334 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f665f-0bf2-417d-9be7-2442c2c00584 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.365789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f665f-0bf2-417d-9be7-2442c2c00584 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.365952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f665f-0bf2-417d-9be7-2442c2c00584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.388031 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-180f665f-0bf2-417d-9be7-2442c2c00584 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:23.389164 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-180f665f-0bf2-417d-9be7-2442c2c00584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:23.452506 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 473/946] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:23.477025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56448f7-d1f7-4f1a-a282-f577216c0192 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.488796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56448f7-d1f7-4f1a-a282-f577216c0192 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.492856 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdb4bf-3cb2-4121-931b-706625a6d0bc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e1f38e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.493563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdb4bf-3cb2-4121-931b-706625a6d0bc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.493851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdb4bf-3cb2-4121-931b-706625a6d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.494134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdb4bf-3cb2-4121-931b-706625a6d0bc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.505182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdb4bf-3cb2-4121-931b-706625a6d0bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:39:23.511501 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-48bdb4bf-3cb2-4121-931b-706625a6d0bc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:39:23.512583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 474/947] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:23.518839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f665f-0bf2-417d-9be7-2442c2c00584 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.527950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f665f-0bf2-417d-9be7-2442c2c00584 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.532078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062a220-1e7a-4113-ba7e-d940b92da712 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e183e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.532669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062a220-1e7a-4113-ba7e-d940b92da712 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.532959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062a220-1e7a-4113-ba7e-d940b92da712 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.533237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062a220-1e7a-4113-ba7e-d940b92da712 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.533952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062a220-1e7a-4113-ba7e-d940b92da712 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:23.534245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062a220-1e7a-4113-ba7e-d940b92da712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:23.535889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062a220-1e7a-4113-ba7e-d940b92da712 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:23.544916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 474/948] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:23.550575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdb4bf-3cb2-4121-931b-706625a6d0bc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.561353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdb4bf-3cb2-4121-931b-706625a6d0bc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.565587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3f7c4-2a85-465e-83b2-8c58ef688b16 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e1cce20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.566292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3f7c4-2a85-465e-83b2-8c58ef688b16 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.566579 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3f7c4-2a85-465e-83b2-8c58ef688b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.566864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3f7c4-2a85-465e-83b2-8c58ef688b16 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.578854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3f7c4-2a85-465e-83b2-8c58ef688b16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:23.580706 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3f7c4-2a85-465e-83b2-8c58ef688b16 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:23.598334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-17c3f7c4-2a85-465e-83b2-8c58ef688b16 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:23.599432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 475/949] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:23.605878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062a220-1e7a-4113-ba7e-d940b92da712 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.615075 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062a220-1e7a-4113-ba7e-d940b92da712 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.619831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d095-ca64-4c92-ab0a-3d6e2cd355f7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e212fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.620416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d095-ca64-4c92-ab0a-3d6e2cd355f7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.620706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d095-ca64-4c92-ab0a-3d6e2cd355f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.620987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d095-ca64-4c92-ab0a-3d6e2cd355f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.621671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d095-ca64-4c92-ab0a-3d6e2cd355f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:23.621969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d095-ca64-4c92-ab0a-3d6e2cd355f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:23.623574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d095-ca64-4c92-ab0a-3d6e2cd355f7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:23.636184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 475/950] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:23.641675 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3f7c4-2a85-465e-83b2-8c58ef688b16 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.651571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3f7c4-2a85-465e-83b2-8c58ef688b16 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.655806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf82cdc-2924-47d8-9d41-ddd13d44cc34 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e1d7a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.656515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf82cdc-2924-47d8-9d41-ddd13d44cc34 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.656804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf82cdc-2924-47d8-9d41-ddd13d44cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.657086 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf82cdc-2924-47d8-9d41-ddd13d44cc34 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.669915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf82cdc-2924-47d8-9d41-ddd13d44cc34 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:23.671935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf82cdc-2924-47d8-9d41-ddd13d44cc34 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:23.690512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-faf82cdc-2924-47d8-9d41-ddd13d44cc34 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:39:23.691610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 476/951] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:23.697821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d095-ca64-4c92-ab0a-3d6e2cd355f7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.707088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d095-ca64-4c92-ab0a-3d6e2cd355f7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.712090 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a537599-16c9-4be9-9160-5eb49a6f9daa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e7052e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.712678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a537599-16c9-4be9-9160-5eb49a6f9daa admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.712964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a537599-16c9-4be9-9160-5eb49a6f9daa admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.713243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a537599-16c9-4be9-9160-5eb49a6f9daa admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.714288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a537599-16c9-4be9-9160-5eb49a6f9daa admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:23.714594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a537599-16c9-4be9-9160-5eb49a6f9daa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:23.716461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a537599-16c9-4be9-9160-5eb49a6f9daa admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:23.745386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 476/952] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:23.751127 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf82cdc-2924-47d8-9d41-ddd13d44cc34 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.760980 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf82cdc-2924-47d8-9d41-ddd13d44cc34 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.765177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb5131-2c66-4201-ba8f-a69bf6202fd7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e1ccc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.765747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb5131-2c66-4201-ba8f-a69bf6202fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.766035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb5131-2c66-4201-ba8f-a69bf6202fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.766315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb5131-2c66-4201-ba8f-a69bf6202fd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.774552 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb5131-2c66-4201-ba8f-a69bf6202fd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:23.776305 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb5131-2c66-4201-ba8f-a69bf6202fd7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:23.785203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 477/953] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:23.791869 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a537599-16c9-4be9-9160-5eb49a6f9daa admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.800988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a537599-16c9-4be9-9160-5eb49a6f9daa admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.806065 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a9da9-96af-419d-82a8-6fe6e9e2a712 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e194b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.806776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9da9-96af-419d-82a8-6fe6e9e2a712 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.807066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9da9-96af-419d-82a8-6fe6e9e2a712 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.807454 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9da9-96af-419d-82a8-6fe6e9e2a712 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.818941 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a9da9-96af-419d-82a8-6fe6e9e2a712 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:23.820749 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a9da9-96af-419d-82a8-6fe6e9e2a712 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:23.837235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-263a9da9-96af-419d-82a8-6fe6e9e2a712 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:39:23.838303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 477/954] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:23.844187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb5131-2c66-4201-ba8f-a69bf6202fd7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.853628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb5131-2c66-4201-ba8f-a69bf6202fd7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.857938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b8633-c404-4b3c-908a-45286a462f5b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e1b0760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.858519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b8633-c404-4b3c-908a-45286a462f5b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.858806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b8633-c404-4b3c-908a-45286a462f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.859085 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b8633-c404-4b3c-908a-45286a462f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.859792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b8633-c404-4b3c-908a-45286a462f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:23.860090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b8633-c404-4b3c-908a-45286a462f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:23.861648 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b8633-c404-4b3c-908a-45286a462f5b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:23.874340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 478/955] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:23.879969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a9da9-96af-419d-82a8-6fe6e9e2a712 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.889552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a9da9-96af-419d-82a8-6fe6e9e2a712 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.893645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ee502-9236-45e8-ac05-c1ef3161786d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e269ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.894346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ee502-9236-45e8-ac05-c1ef3161786d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.894637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ee502-9236-45e8-ac05-c1ef3161786d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.894918 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ee502-9236-45e8-ac05-c1ef3161786d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.903409 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ee502-9236-45e8-ac05-c1ef3161786d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:23.905327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ee502-9236-45e8-ac05-c1ef3161786d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:23.918898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-0a8ee502-9236-45e8-ac05-c1ef3161786d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:39:23.920010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 478/956] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:23.925874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b8633-c404-4b3c-908a-45286a462f5b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.935960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b8633-c404-4b3c-908a-45286a462f5b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.940213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53945982-f956-4024-9065-1973db7d75b5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e1b0190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.940795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53945982-f956-4024-9065-1973db7d75b5 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.941082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53945982-f956-4024-9065-1973db7d75b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.941364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53945982-f956-4024-9065-1973db7d75b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.942104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53945982-f956-4024-9065-1973db7d75b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:23.942406 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53945982-f956-4024-9065-1973db7d75b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:23.944371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53945982-f956-4024-9065-1973db7d75b5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:23.957236 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 479/957] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:23.963309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ee502-9236-45e8-ac05-c1ef3161786d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:23.972916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ee502-9236-45e8-ac05-c1ef3161786d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:23.977886 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4980317-faaa-4fa2-8249-34314c748c54 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a_zyQJlsRAqj7MKHfcZTFw, audit_chain_id=['a_zyQJlsRAqj7MKHfcZTFw']) at 0x7fe09e705250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:23.978459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4980317-faaa-4fa2-8249-34314c748c54 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:23.978747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4980317-faaa-4fa2-8249-34314c748c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:23.979026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4980317-faaa-4fa2-8249-34314c748c54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:23.979826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4980317-faaa-4fa2-8249-34314c748c54 admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=5bf96e3d5ba3483896dcb079f8e7b0bb) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:23.980133 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4980317-faaa-4fa2-8249-34314c748c54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:23.981934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4980317-faaa-4fa2-8249-34314c748c54 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:23.987605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 479/958] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:39:23 2022] GET /identity/v3/role_assignments?user.id=5bf96e3d5ba3483896dcb079f8e7b0bb&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:26.125732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcf7af-bce5-41a7-95e9-cd2985641e6a None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:26.126287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcf7af-bce5-41a7-95e9-cd2985641e6a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:26.126287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcf7af-bce5-41a7-95e9-cd2985641e6a None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:26.128017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 480/959] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:26.133803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7addd90-bea2-4fa3-97b5-5a9f2ea1919a None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:26.134239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7addd90-bea2-4fa3-97b5-5a9f2ea1919a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:26.134380 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7addd90-bea2-4fa3-97b5-5a9f2ea1919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:26.157580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-b7addd90-bea2-4fa3-97b5-5a9f2ea1919a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:26.158724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b7addd90-bea2-4fa3-97b5-5a9f2ea1919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:26.166324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 480/960] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:26.188987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcf7af-bce5-41a7-95e9-cd2985641e6a None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:26.201426 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcf7af-bce5-41a7-95e9-cd2985641e6a None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:26.205578 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454495b-615d-4198-a91c-e2c6045d76fe admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjSkCWY9RvW3Gn4Knwwcxw, audit_chain_id=['QjSkCWY9RvW3Gn4Knwwcxw']) at 0x7fe09df0bdf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:26.206240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454495b-615d-4198-a91c-e2c6045d76fe admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:26.206528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454495b-615d-4198-a91c-e2c6045d76fe admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:26.206809 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454495b-615d-4198-a91c-e2c6045d76fe admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:26.207474 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454495b-615d-4198-a91c-e2c6045d76fe admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:26.209090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454495b-615d-4198-a91c-e2c6045d76fe admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:26.220395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-7454495b-615d-4198-a91c-e2c6045d76fe admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 18:39:26.221437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 481/961] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Feb 28 18:39:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:26.227548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7addd90-bea2-4fa3-97b5-5a9f2ea1919a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:26.236158 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7addd90-bea2-4fa3-97b5-5a9f2ea1919a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:26.240826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e9f33-6ca7-4f74-ab3c-3ca51491bdd0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjSkCWY9RvW3Gn4Knwwcxw, audit_chain_id=['QjSkCWY9RvW3Gn4Knwwcxw']) at 0x7fe09e14ad30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:26.241425 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9f33-6ca7-4f74-ab3c-3ca51491bdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:26.241703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9f33-6ca7-4f74-ab3c-3ca51491bdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:26.241981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e9f33-6ca7-4f74-ab3c-3ca51491bdd0 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:26.242645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e9f33-6ca7-4f74-ab3c-3ca51491bdd0 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:26.242945 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e9f33-6ca7-4f74-ab3c-3ca51491bdd0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:26.244553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e9f33-6ca7-4f74-ab3c-3ca51491bdd0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:26.249206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 481/962] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 18:39:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:26.254750 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454495b-615d-4198-a91c-e2c6045d76fe admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:26.264743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454495b-615d-4198-a91c-e2c6045d76fe admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:26.268915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da369d-605b-436d-a35d-be7204ae41d3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjSkCWY9RvW3Gn4Knwwcxw, audit_chain_id=['QjSkCWY9RvW3Gn4Knwwcxw']) at 0x7fe09e3e4b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:26.269492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da369d-605b-436d-a35d-be7204ae41d3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:26.269780 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da369d-605b-436d-a35d-be7204ae41d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:26.270064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da369d-605b-436d-a35d-be7204ae41d3 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:26.270730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da369d-605b-436d-a35d-be7204ae41d3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:26.271028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da369d-605b-436d-a35d-be7204ae41d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:26.272653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da369d-605b-436d-a35d-be7204ae41d3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:26.276842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 482/963] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 18:39:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:28.408237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef10dc0-1f75-4a34-8b10-d5b43b7bf20e None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:28.408791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef10dc0-1f75-4a34-8b10-d5b43b7bf20e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:28.408791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef10dc0-1f75-4a34-8b10-d5b43b7bf20e None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:28.410462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 482/964] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:28.416624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7679b2-91e9-4589-8747-12a9605c4a43 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:28.417027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7679b2-91e9-4589-8747-12a9605c4a43 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:28.417193 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7679b2-91e9-4589-8747-12a9605c4a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:28.440062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-fc7679b2-91e9-4589-8747-12a9605c4a43 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:28.441216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-fc7679b2-91e9-4589-8747-12a9605c4a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:28.448853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 483/965] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:39:28.471679 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef10dc0-1f75-4a34-8b10-d5b43b7bf20e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:28.484015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef10dc0-1f75-4a34-8b10-d5b43b7bf20e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:28.488047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a453f-5241-4357-b639-9088a25bb1a0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yZznNSeiRFqiXdsmxBopaQ, audit_chain_id=['yZznNSeiRFqiXdsmxBopaQ']) at 0x7fe09e55f610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:28.488636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a453f-5241-4357-b639-9088a25bb1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:28.488927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a453f-5241-4357-b639-9088a25bb1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:28.489208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a453f-5241-4357-b639-9088a25bb1a0 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:28.489877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a453f-5241-4357-b639-9088a25bb1a0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:28.492298 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a453f-5241-4357-b639-9088a25bb1a0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:28.577259 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 483/966] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:39:28 2022] POST /identity/v3/services => generated 241 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:39:30.698396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b132-af44-477e-84ef-7c936e896130 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:30.698987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b132-af44-477e-84ef-7c936e896130 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:30.698987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b132-af44-477e-84ef-7c936e896130 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:30.700776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 484/967] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:30.707041 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04924f59-97cb-452c-93a4-10f9a57d1829 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:30.707527 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04924f59-97cb-452c-93a4-10f9a57d1829 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:30.707651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04924f59-97cb-452c-93a4-10f9a57d1829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:30.730762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-04924f59-97cb-452c-93a4-10f9a57d1829 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:30.731967 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-04924f59-97cb-452c-93a4-10f9a57d1829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:30.750099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 484/968] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:30 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:30.774270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655b132-af44-477e-84ef-7c936e896130 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:30.786307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655b132-af44-477e-84ef-7c936e896130 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:30.792330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c1470-5dce-4e19-9697-c0a827ce5bf2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Zh39SYGPTiiFRNxEh9RqTw, audit_chain_id=['Zh39SYGPTiiFRNxEh9RqTw']) at 0x7fe09e143c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:30.793070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c1470-5dce-4e19-9697-c0a827ce5bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:30.793360 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c1470-5dce-4e19-9697-c0a827ce5bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:30.793774 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c1470-5dce-4e19-9697-c0a827ce5bf2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:30.794404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c1470-5dce-4e19-9697-c0a827ce5bf2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:30.796023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c1470-5dce-4e19-9697-c0a827ce5bf2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:30.807734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-f06c1470-5dce-4e19-9697-c0a827ce5bf2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 18:39:30.808832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 485/969] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Feb 28 18:39:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:30.815428 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04924f59-97cb-452c-93a4-10f9a57d1829 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:30.824625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04924f59-97cb-452c-93a4-10f9a57d1829 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:30.829046 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893aac6-2a5a-44cf-8b5e-9631d396a6ea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Zh39SYGPTiiFRNxEh9RqTw, audit_chain_id=['Zh39SYGPTiiFRNxEh9RqTw']) at 0x7fe09e1083a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:30.829631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893aac6-2a5a-44cf-8b5e-9631d396a6ea admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:30.829920 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893aac6-2a5a-44cf-8b5e-9631d396a6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:30.830201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893aac6-2a5a-44cf-8b5e-9631d396a6ea admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:30.830866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893aac6-2a5a-44cf-8b5e-9631d396a6ea admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:30.831200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893aac6-2a5a-44cf-8b5e-9631d396a6ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:30.832767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893aac6-2a5a-44cf-8b5e-9631d396a6ea admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:30.837863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 485/970] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 18:39:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:30.843929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c1470-5dce-4e19-9697-c0a827ce5bf2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:30.853917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c1470-5dce-4e19-9697-c0a827ce5bf2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:30.858267 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eb151-93a2-4a49-8d78-6bcd6a803206 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Zh39SYGPTiiFRNxEh9RqTw, audit_chain_id=['Zh39SYGPTiiFRNxEh9RqTw']) at 0x7fe09e1883d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:30.858858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eb151-93a2-4a49-8d78-6bcd6a803206 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:30.859170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eb151-93a2-4a49-8d78-6bcd6a803206 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:30.859462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eb151-93a2-4a49-8d78-6bcd6a803206 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:30.860139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90eb151-93a2-4a49-8d78-6bcd6a803206 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:30.860440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90eb151-93a2-4a49-8d78-6bcd6a803206 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:30.862059 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90eb151-93a2-4a49-8d78-6bcd6a803206 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:30.868038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 486/971] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 18:39:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:30.874033 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893aac6-2a5a-44cf-8b5e-9631d396a6ea admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:30.884205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893aac6-2a5a-44cf-8b5e-9631d396a6ea admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:30.888616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5123dfb-4c45-48fd-a32d-7d2f6e3aba49 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Zh39SYGPTiiFRNxEh9RqTw, audit_chain_id=['Zh39SYGPTiiFRNxEh9RqTw']) at 0x7fe09e14edc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:30.889205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5123dfb-4c45-48fd-a32d-7d2f6e3aba49 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:30.889499 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5123dfb-4c45-48fd-a32d-7d2f6e3aba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:30.889786 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5123dfb-4c45-48fd-a32d-7d2f6e3aba49 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:30.890533 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5123dfb-4c45-48fd-a32d-7d2f6e3aba49 admin admin] RBAC: Adding query filter params (interface=public, service_id=bc2a6efa577c40479a49221db1511ebb, region_id=RegionOne) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:30.890842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5123dfb-4c45-48fd-a32d-7d2f6e3aba49 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:30.892508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5123dfb-4c45-48fd-a32d-7d2f6e3aba49 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:30.897852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 486/972] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Feb 28 18:39:30 2022] GET /identity/v3/endpoints?service_id=bc2a6efa577c40479a49221db1511ebb&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:30.903822 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eb151-93a2-4a49-8d78-6bcd6a803206 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:30.913330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eb151-93a2-4a49-8d78-6bcd6a803206 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:30.917592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732f4c1-413c-4ac7-a386-ebe2f02b7d6d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Zh39SYGPTiiFRNxEh9RqTw, audit_chain_id=['Zh39SYGPTiiFRNxEh9RqTw']) at 0x7fe09e380100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:30.918179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732f4c1-413c-4ac7-a386-ebe2f02b7d6d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:30.918464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732f4c1-413c-4ac7-a386-ebe2f02b7d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:30.918744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732f4c1-413c-4ac7-a386-ebe2f02b7d6d admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:30.919421 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732f4c1-413c-4ac7-a386-ebe2f02b7d6d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:30.920993 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732f4c1-413c-4ac7-a386-ebe2f02b7d6d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:30.929135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 487/973] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:39:30 2022] GET /identity/v3/services => generated 2196 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:39:33.102557 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fef766-2301-4ecb-8ab8-9b42c83bcc1e None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:33.103164 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fef766-2301-4ecb-8ab8-9b42c83bcc1e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:33.103164 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fef766-2301-4ecb-8ab8-9b42c83bcc1e None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:33.105032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 487/974] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:33.111556 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb448b1b-1dfe-4318-98ea-7cd5e1f66246 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:33.112366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb448b1b-1dfe-4318-98ea-7cd5e1f66246 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:33.112536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb448b1b-1dfe-4318-98ea-7cd5e1f66246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:33.138994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-bb448b1b-1dfe-4318-98ea-7cd5e1f66246 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:33.140224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-bb448b1b-1dfe-4318-98ea-7cd5e1f66246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:33.148526 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 488/975] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:33 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:33.175473 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fef766-2301-4ecb-8ab8-9b42c83bcc1e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:33.188961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fef766-2301-4ecb-8ab8-9b42c83bcc1e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:33.194179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f36da-0989-4594-83f5-f1e6b3b7a561 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G4vY4nRvTGOuPa9TP7HTiw, audit_chain_id=['G4vY4nRvTGOuPa9TP7HTiw']) at 0x7fe09e21eeb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:33.194944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f36da-0989-4594-83f5-f1e6b3b7a561 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:33.195293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f36da-0989-4594-83f5-f1e6b3b7a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:33.195594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f36da-0989-4594-83f5-f1e6b3b7a561 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:33.196251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f36da-0989-4594-83f5-f1e6b3b7a561 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:33.197894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f36da-0989-4594-83f5-f1e6b3b7a561 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:33.209931 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-336f36da-0989-4594-83f5-f1e6b3b7a561 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 18:39:33.211073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 488/976] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Feb 28 18:39:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:33.217908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb448b1b-1dfe-4318-98ea-7cd5e1f66246 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:33.228194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb448b1b-1dfe-4318-98ea-7cd5e1f66246 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:33.232878 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cf1a0-6bfe-41e9-907c-d6aefc35682d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G4vY4nRvTGOuPa9TP7HTiw, audit_chain_id=['G4vY4nRvTGOuPa9TP7HTiw']) at 0x7fe09e1df940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:33.233498 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cf1a0-6bfe-41e9-907c-d6aefc35682d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:33.233801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cf1a0-6bfe-41e9-907c-d6aefc35682d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:33.234091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cf1a0-6bfe-41e9-907c-d6aefc35682d admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:33.234808 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cf1a0-6bfe-41e9-907c-d6aefc35682d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:33.235140 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cf1a0-6bfe-41e9-907c-d6aefc35682d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:33.237005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cf1a0-6bfe-41e9-907c-d6aefc35682d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:33.242759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 489/977] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 18:39:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:33.248906 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f36da-0989-4594-83f5-f1e6b3b7a561 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:33.258791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f36da-0989-4594-83f5-f1e6b3b7a561 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:33.263388 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9162df-5d94-47d3-abac-15dec185dfad admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G4vY4nRvTGOuPa9TP7HTiw, audit_chain_id=['G4vY4nRvTGOuPa9TP7HTiw']) at 0x7fe09e118850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:33.264005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9162df-5d94-47d3-abac-15dec185dfad admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:33.264311 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9162df-5d94-47d3-abac-15dec185dfad admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:33.264608 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9162df-5d94-47d3-abac-15dec185dfad admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:33.265305 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9162df-5d94-47d3-abac-15dec185dfad admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:33.265621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9162df-5d94-47d3-abac-15dec185dfad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:33.267286 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9162df-5d94-47d3-abac-15dec185dfad admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:33.273135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 489/978] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 18:39:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:33.279256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cf1a0-6bfe-41e9-907c-d6aefc35682d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:33.289616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cf1a0-6bfe-41e9-907c-d6aefc35682d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:33.294288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b8d42-61f6-4e62-b2f0-429460c412e6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G4vY4nRvTGOuPa9TP7HTiw, audit_chain_id=['G4vY4nRvTGOuPa9TP7HTiw']) at 0x7fe09e3e2820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:33.294902 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b8d42-61f6-4e62-b2f0-429460c412e6 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:33.295240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b8d42-61f6-4e62-b2f0-429460c412e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:33.295533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b8d42-61f6-4e62-b2f0-429460c412e6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:33.296247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b8d42-61f6-4e62-b2f0-429460c412e6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:33.297890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b8d42-61f6-4e62-b2f0-429460c412e6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:33.393680 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 490/979] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Feb 28 18:39:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:39:35.508880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b4ecc-a514-47d4-8a7f-386d67d7b8a0 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:35.509440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b4ecc-a514-47d4-8a7f-386d67d7b8a0 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:35.509533 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b4ecc-a514-47d4-8a7f-386d67d7b8a0 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:35.511269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 490/980] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:35.516412 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8051da-f1fc-48a8-a684-814f463f55eb None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:35.516836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8051da-f1fc-48a8-a684-814f463f55eb None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:35.517094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8051da-f1fc-48a8-a684-814f463f55eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:35.540043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-7a8051da-f1fc-48a8-a684-814f463f55eb None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:35.541181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7a8051da-f1fc-48a8-a684-814f463f55eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:35.559033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 491/981] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:35.582430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b4ecc-a514-47d4-8a7f-386d67d7b8a0 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:35.596643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b4ecc-a514-47d4-8a7f-386d67d7b8a0 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:35.601920 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c2137-8e30-4219-841c-f4b46013b4bf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kd9Z13U6ReKqmrGQDeAmAA, audit_chain_id=['kd9Z13U6ReKqmrGQDeAmAA']) at 0x7fe09e25bbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:35.602649 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c2137-8e30-4219-841c-f4b46013b4bf admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:35.602942 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c2137-8e30-4219-841c-f4b46013b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:35.603283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c2137-8e30-4219-841c-f4b46013b4bf admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:35.603908 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c2137-8e30-4219-841c-f4b46013b4bf admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:35.605512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c2137-8e30-4219-841c-f4b46013b4bf admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:35.617018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-5b4c2137-8e30-4219-841c-f4b46013b4bf admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 18:39:35.618100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 491/982] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Feb 28 18:39:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:35.624307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8051da-f1fc-48a8-a684-814f463f55eb None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:35.633201 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8051da-f1fc-48a8-a684-814f463f55eb None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:35.637529 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b6c55-b9c8-4827-a507-4bfd9be2c41e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kd9Z13U6ReKqmrGQDeAmAA, audit_chain_id=['kd9Z13U6ReKqmrGQDeAmAA']) at 0x7fe09e3f62e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:35.638122 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b6c55-b9c8-4827-a507-4bfd9be2c41e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:35.638415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b6c55-b9c8-4827-a507-4bfd9be2c41e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:35.638700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b6c55-b9c8-4827-a507-4bfd9be2c41e admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:35.639410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b6c55-b9c8-4827-a507-4bfd9be2c41e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:35.639714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b6c55-b9c8-4827-a507-4bfd9be2c41e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:35.641309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b6c55-b9c8-4827-a507-4bfd9be2c41e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:35.646040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 492/983] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 18:39:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:35.652154 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c2137-8e30-4219-841c-f4b46013b4bf admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:35.662344 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c2137-8e30-4219-841c-f4b46013b4bf admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:35.666965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac54a66-516d-4a0f-8ac4-6a58f45794da admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kd9Z13U6ReKqmrGQDeAmAA, audit_chain_id=['kd9Z13U6ReKqmrGQDeAmAA']) at 0x7fe09df3bfa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:35.667602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54a66-516d-4a0f-8ac4-6a58f45794da admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:35.667896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54a66-516d-4a0f-8ac4-6a58f45794da admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:35.668182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54a66-516d-4a0f-8ac4-6a58f45794da admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:35.668843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac54a66-516d-4a0f-8ac4-6a58f45794da admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:35.669149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac54a66-516d-4a0f-8ac4-6a58f45794da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:35.670704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac54a66-516d-4a0f-8ac4-6a58f45794da admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:35.675281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 492/984] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 18:39:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:35.681649 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b6c55-b9c8-4827-a507-4bfd9be2c41e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:35.690723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b6c55-b9c8-4827-a507-4bfd9be2c41e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:35.695040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffb61a-7c80-4d89-83b4-9e3d2e425d29 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kd9Z13U6ReKqmrGQDeAmAA, audit_chain_id=['kd9Z13U6ReKqmrGQDeAmAA']) at 0x7fe09e3e44f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:35.695637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb61a-7c80-4d89-83b4-9e3d2e425d29 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:35.695922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb61a-7c80-4d89-83b4-9e3d2e425d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:35.696202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb61a-7c80-4d89-83b4-9e3d2e425d29 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:35.696933 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffb61a-7c80-4d89-83b4-9e3d2e425d29 admin admin] RBAC: Adding query filter params (interface=admin, service_id=bc2a6efa577c40479a49221db1511ebb, region_id=RegionOne) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:35.697260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffb61a-7c80-4d89-83b4-9e3d2e425d29 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:35.698802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffb61a-7c80-4d89-83b4-9e3d2e425d29 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:35.703847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 493/985] 10.222.0.21 () {56 vars in 1270 bytes} [Mon Feb 28 18:39:35 2022] GET /identity/v3/endpoints?service_id=bc2a6efa577c40479a49221db1511ebb&interface=admin®ion_id=RegionOne => generated 193 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:35.709578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac54a66-516d-4a0f-8ac4-6a58f45794da admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:35.718901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac54a66-516d-4a0f-8ac4-6a58f45794da admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:35.723140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2607b4-3658-4335-821b-453953f49d54 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kd9Z13U6ReKqmrGQDeAmAA, audit_chain_id=['kd9Z13U6ReKqmrGQDeAmAA']) at 0x7fe09e14adc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:35.723716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2607b4-3658-4335-821b-453953f49d54 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:35.724008 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2607b4-3658-4335-821b-453953f49d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:35.724293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2607b4-3658-4335-821b-453953f49d54 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:35.726035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2607b4-3658-4335-821b-453953f49d54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:35.727604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2607b4-3658-4335-821b-453953f49d54 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:35.734162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 493/986] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:39:35 2022] GET /identity/v3/services => generated 2196 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:39:37.904479 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b2a54-56bb-44c9-bfbe-35ca6e5a2b60 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:37.905010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b2a54-56bb-44c9-bfbe-35ca6e5a2b60 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:37.905116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b2a54-56bb-44c9-bfbe-35ca6e5a2b60 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:37.906727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 494/987] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:37.912389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909ac3-bbb9-4000-b530-e247659ba1cd None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:37.912820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909ac3-bbb9-4000-b530-e247659ba1cd None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:37.913304 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909ac3-bbb9-4000-b530-e247659ba1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:37.935529 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-13909ac3-bbb9-4000-b530-e247659ba1cd None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:37.936664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-13909ac3-bbb9-4000-b530-e247659ba1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:37.943925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 494/988] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:39:37.966612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b2a54-56bb-44c9-bfbe-35ca6e5a2b60 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:37.979001 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b2a54-56bb-44c9-bfbe-35ca6e5a2b60 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:37.983144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6487b5-72be-44fd-a101-ea0223f7e9f9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NuxkeE3dThWjf7TNewJuTA, audit_chain_id=['NuxkeE3dThWjf7TNewJuTA']) at 0x7fe09e3f69d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:37.983859 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6487b5-72be-44fd-a101-ea0223f7e9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:37.984146 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6487b5-72be-44fd-a101-ea0223f7e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:37.984425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6487b5-72be-44fd-a101-ea0223f7e9f9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:37.985048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6487b5-72be-44fd-a101-ea0223f7e9f9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:37.986624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6487b5-72be-44fd-a101-ea0223f7e9f9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:37.997625 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-1e6487b5-72be-44fd-a101-ea0223f7e9f9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 18:39:37.998665 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 495/989] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Feb 28 18:39:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:38.004771 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13909ac3-bbb9-4000-b530-e247659ba1cd None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:38.013670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13909ac3-bbb9-4000-b530-e247659ba1cd None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:38.017917 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62a95d-7bba-47af-8fe8-a03670f10458 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NuxkeE3dThWjf7TNewJuTA, audit_chain_id=['NuxkeE3dThWjf7TNewJuTA']) at 0x7fe09e15e100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:38.018504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a95d-7bba-47af-8fe8-a03670f10458 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:38.018794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a95d-7bba-47af-8fe8-a03670f10458 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:38.019074 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a95d-7bba-47af-8fe8-a03670f10458 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:38.019770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62a95d-7bba-47af-8fe8-a03670f10458 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:38.020068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62a95d-7bba-47af-8fe8-a03670f10458 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:38.021955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62a95d-7bba-47af-8fe8-a03670f10458 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:38.026672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 495/990] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 18:39:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:38.032175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6487b5-72be-44fd-a101-ea0223f7e9f9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:38.041870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6487b5-72be-44fd-a101-ea0223f7e9f9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:38.046085 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d14a-70d8-4ecd-8da8-2133ac6280c3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NuxkeE3dThWjf7TNewJuTA, audit_chain_id=['NuxkeE3dThWjf7TNewJuTA']) at 0x7fe09e17f730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:38.046661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d14a-70d8-4ecd-8da8-2133ac6280c3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:38.046947 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d14a-70d8-4ecd-8da8-2133ac6280c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:38.047265 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d14a-70d8-4ecd-8da8-2133ac6280c3 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:38.047925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d14a-70d8-4ecd-8da8-2133ac6280c3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:38.048224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d14a-70d8-4ecd-8da8-2133ac6280c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:38.049783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d14a-70d8-4ecd-8da8-2133ac6280c3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:38.054981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 496/991] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 18:39:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:38.060353 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62a95d-7bba-47af-8fe8-a03670f10458 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:38.069555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62a95d-7bba-47af-8fe8-a03670f10458 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:38.073697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2da2e-d678-40c9-b71b-bb2f1cac7b7d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NuxkeE3dThWjf7TNewJuTA, audit_chain_id=['NuxkeE3dThWjf7TNewJuTA']) at 0x7fe09e14a940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:38.074268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2da2e-d678-40c9-b71b-bb2f1cac7b7d admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:38.074554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2da2e-d678-40c9-b71b-bb2f1cac7b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:38.074833 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2da2e-d678-40c9-b71b-bb2f1cac7b7d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:38.075556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2da2e-d678-40c9-b71b-bb2f1cac7b7d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:38.077105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2da2e-d678-40c9-b71b-bb2f1cac7b7d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:38.152993 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 496/992] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Feb 28 18:39:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:39:40.292644 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634bafb-f3ae-420f-8363-3415fa736216 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:40.293166 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634bafb-f3ae-420f-8363-3415fa736216 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:40.293166 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634bafb-f3ae-420f-8363-3415fa736216 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:40.294801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 497/993] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:40.300144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244842bf-203e-4330-9e41-66004734c8f9 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:40.300652 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244842bf-203e-4330-9e41-66004734c8f9 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:40.300754 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244842bf-203e-4330-9e41-66004734c8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:40.322891 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-244842bf-203e-4330-9e41-66004734c8f9 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:40.324057 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-244842bf-203e-4330-9e41-66004734c8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:40.341898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 497/994] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:40 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:40.364758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634bafb-f3ae-420f-8363-3415fa736216 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:40.376559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634bafb-f3ae-420f-8363-3415fa736216 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:40.381281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aacbf5-2281-43ea-af6b-e65cad2c84ae admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RSS8nJchT6CvcH8Z6NKCYQ, audit_chain_id=['RSS8nJchT6CvcH8Z6NKCYQ']) at 0x7fe09e17f1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:40.382492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aacbf5-2281-43ea-af6b-e65cad2c84ae admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:40.382991 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aacbf5-2281-43ea-af6b-e65cad2c84ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:40.383544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aacbf5-2281-43ea-af6b-e65cad2c84ae admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:40.385075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aacbf5-2281-43ea-af6b-e65cad2c84ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:40.387186 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aacbf5-2281-43ea-af6b-e65cad2c84ae admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:40.388764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 498/995] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:40.394636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244842bf-203e-4330-9e41-66004734c8f9 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:40.403998 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244842bf-203e-4330-9e41-66004734c8f9 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:40.408302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9a84d-e032-4d07-83f3-428bf371d7ff admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RSS8nJchT6CvcH8Z6NKCYQ, audit_chain_id=['RSS8nJchT6CvcH8Z6NKCYQ']) at 0x7fe09e25b0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:40.408936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a84d-e032-4d07-83f3-428bf371d7ff admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:40.409223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a84d-e032-4d07-83f3-428bf371d7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:40.409532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a84d-e032-4d07-83f3-428bf371d7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:40.410247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9a84d-e032-4d07-83f3-428bf371d7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:40.412341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9a84d-e032-4d07-83f3-428bf371d7ff admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:40.503863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 498/996] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:39:40 2022] POST /identity/v3/projects => generated 311 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:39:42.654399 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6acc95-dd61-4cde-a20b-4bb329f07190 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:42.654937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6acc95-dd61-4cde-a20b-4bb329f07190 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:42.654937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6acc95-dd61-4cde-a20b-4bb329f07190 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:42.656681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 499/997] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:42.662378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526fb0-fe4a-4b44-8de7-fd95dd486616 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:42.662777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526fb0-fe4a-4b44-8de7-fd95dd486616 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:42.662946 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526fb0-fe4a-4b44-8de7-fd95dd486616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:42.684808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-ab526fb0-fe4a-4b44-8de7-fd95dd486616 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:42.685935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ab526fb0-fe4a-4b44-8de7-fd95dd486616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:42.753179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 499/998] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:42 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:42.777776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6acc95-dd61-4cde-a20b-4bb329f07190 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:42.790197 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6acc95-dd61-4cde-a20b-4bb329f07190 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:42.794324 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25da73-dbe5-451d-90ec-f082fd3b21c2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bd8bN6auRK2WyFcbn-UDxQ, audit_chain_id=['bd8bN6auRK2WyFcbn-UDxQ']) at 0x7fe09e3dc8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:42.795031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25da73-dbe5-451d-90ec-f082fd3b21c2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:42.795345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25da73-dbe5-451d-90ec-f082fd3b21c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:42.795624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25da73-dbe5-451d-90ec-f082fd3b21c2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:42.796712 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25da73-dbe5-451d-90ec-f082fd3b21c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:42.798368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25da73-dbe5-451d-90ec-f082fd3b21c2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:42.799842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 500/999] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:39:42.805406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab526fb0-fe4a-4b44-8de7-fd95dd486616 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:42.813831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab526fb0-fe4a-4b44-8de7-fd95dd486616 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:42.818035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2c77-97b7-4d79-8df3-e3af88442d38 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bd8bN6auRK2WyFcbn-UDxQ, audit_chain_id=['bd8bN6auRK2WyFcbn-UDxQ']) at 0x7fe09dec1430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:42.818630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2c77-97b7-4d79-8df3-e3af88442d38 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:42.818916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2c77-97b7-4d79-8df3-e3af88442d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:42.819227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2c77-97b7-4d79-8df3-e3af88442d38 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:42.819871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e2c77-97b7-4d79-8df3-e3af88442d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:42.821739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e2c77-97b7-4d79-8df3-e3af88442d38 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:42.931563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 500/1000] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:39:42 2022] POST /identity/v3/users => generated 285 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:39:45.078605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785e22b-ac2f-4cdc-97d1-902942a60f47 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:45.079174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785e22b-ac2f-4cdc-97d1-902942a60f47 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:45.079268 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785e22b-ac2f-4cdc-97d1-902942a60f47 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:45.080897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 501/1001] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:45.086896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785979d5-c5a1-4d78-8ffa-9c37ab53fce5 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:45.087342 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785979d5-c5a1-4d78-8ffa-9c37ab53fce5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:45.087504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785979d5-c5a1-4d78-8ffa-9c37ab53fce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:45.109762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-785979d5-c5a1-4d78-8ffa-9c37ab53fce5 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:45.110898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-785979d5-c5a1-4d78-8ffa-9c37ab53fce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:45.118010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 501/1002] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:45 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:45.140615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785e22b-ac2f-4cdc-97d1-902942a60f47 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:45.152729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785e22b-ac2f-4cdc-97d1-902942a60f47 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:45.156782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac87b5-6244-450e-86d9-e70eebb7ad71 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mwy5-tcySgumq_lVLw1y7A, audit_chain_id=['mwy5-tcySgumq_lVLw1y7A']) at 0x7fe09e17f730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:45.157484 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac87b5-6244-450e-86d9-e70eebb7ad71 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:45.157769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac87b5-6244-450e-86d9-e70eebb7ad71 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:45.158048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac87b5-6244-450e-86d9-e70eebb7ad71 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:45.169966 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac87b5-6244-450e-86d9-e70eebb7ad71 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:39:45.176230 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-caac87b5-6244-450e-86d9-e70eebb7ad71 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:39:45.177430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 502/1003] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:45.183636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785979d5-c5a1-4d78-8ffa-9c37ab53fce5 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:45.192115 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785979d5-c5a1-4d78-8ffa-9c37ab53fce5 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:45.196521 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2d1b6-92ff-4763-bcf4-76342e074d97 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mwy5-tcySgumq_lVLw1y7A, audit_chain_id=['mwy5-tcySgumq_lVLw1y7A']) at 0x7fe09e55f2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:45.197109 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2d1b6-92ff-4763-bcf4-76342e074d97 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:45.197395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2d1b6-92ff-4763-bcf4-76342e074d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:45.197673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2d1b6-92ff-4763-bcf4-76342e074d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:45.198382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2d1b6-92ff-4763-bcf4-76342e074d97 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:45.198681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2d1b6-92ff-4763-bcf4-76342e074d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:45.200280 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2d1b6-92ff-4763-bcf4-76342e074d97 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:45.209195 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 502/1004] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:39:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:45.214827 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac87b5-6244-450e-86d9-e70eebb7ad71 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:45.224029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac87b5-6244-450e-86d9-e70eebb7ad71 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:45.228868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96fa51-4a68-4d1d-bcc3-10a11ddb455a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mwy5-tcySgumq_lVLw1y7A, audit_chain_id=['mwy5-tcySgumq_lVLw1y7A']) at 0x7fe09e3f6b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:45.229649 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96fa51-4a68-4d1d-bcc3-10a11ddb455a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:45.229936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96fa51-4a68-4d1d-bcc3-10a11ddb455a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:45.230216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96fa51-4a68-4d1d-bcc3-10a11ddb455a admin admin] PATH_INFO: `/v3/users/7174c05300674bfc821801baf3d17078` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:45.248251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96fa51-4a68-4d1d-bcc3-10a11ddb455a admin admin] RBAC: Authorizing `identity:get_user(user_id=7174c05300674bfc821801baf3d17078)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:45.250355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96fa51-4a68-4d1d-bcc3-10a11ddb455a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:45.251852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 503/1005] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:39:45 2022] GET /identity/v3/users/7174c05300674bfc821801baf3d17078 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:45.257292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2d1b6-92ff-4763-bcf4-76342e074d97 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:45.266316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2d1b6-92ff-4763-bcf4-76342e074d97 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:45.270506 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a3a01-30ef-415a-9c85-fc55a4178c1d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mwy5-tcySgumq_lVLw1y7A, audit_chain_id=['mwy5-tcySgumq_lVLw1y7A']) at 0x7fe09e540a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:45.271600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a3a01-30ef-415a-9c85-fc55a4178c1d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:45.271882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a3a01-30ef-415a-9c85-fc55a4178c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:45.272159 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a3a01-30ef-415a-9c85-fc55a4178c1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:45.279596 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a3a01-30ef-415a-9c85-fc55a4178c1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:45.281304 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a3a01-30ef-415a-9c85-fc55a4178c1d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:45.290077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 503/1006] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:39:45 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:45.295725 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96fa51-4a68-4d1d-bcc3-10a11ddb455a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:45.304799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96fa51-4a68-4d1d-bcc3-10a11ddb455a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:45.309072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371265fa-5d6d-442c-89e8-aa1a6ba0077f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mwy5-tcySgumq_lVLw1y7A, audit_chain_id=['mwy5-tcySgumq_lVLw1y7A']) at 0x7fe09e17fee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:45.309828 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371265fa-5d6d-442c-89e8-aa1a6ba0077f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:45.310115 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371265fa-5d6d-442c-89e8-aa1a6ba0077f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:45.310393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371265fa-5d6d-442c-89e8-aa1a6ba0077f admin admin] PATH_INFO: `/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:45.311495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371265fa-5d6d-442c-89e8-aa1a6ba0077f admin admin] RBAC: Authorizing `identity:get_project(project_id=ebf0ce0f7be945acb98504a4a7b8f347)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:45.313481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371265fa-5d6d-442c-89e8-aa1a6ba0077f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:45.315090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 504/1007] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:39:45 2022] GET /identity/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:45.320898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a3a01-30ef-415a-9c85-fc55a4178c1d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:45.329259 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a3a01-30ef-415a-9c85-fc55a4178c1d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:45.334056 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74394b3-d7f2-4425-84c3-7bb2876b925d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mwy5-tcySgumq_lVLw1y7A, audit_chain_id=['mwy5-tcySgumq_lVLw1y7A']) at 0x7fe09e14e250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:45.334714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74394b3-d7f2-4425-84c3-7bb2876b925d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:45.335003 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74394b3-d7f2-4425-84c3-7bb2876b925d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:45.335588 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74394b3-d7f2-4425-84c3-7bb2876b925d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:45.336358 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74394b3-d7f2-4425-84c3-7bb2876b925d admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=ebf0ce0f7be945acb98504a4a7b8f347, user.id=7174c05300674bfc821801baf3d17078) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:45.336661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74394b3-d7f2-4425-84c3-7bb2876b925d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:45.338747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74394b3-d7f2-4425-84c3-7bb2876b925d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:45.343897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 504/1008] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:39:45 2022] GET /identity/v3/role_assignments?user.id=7174c05300674bfc821801baf3d17078&scope.project.id=ebf0ce0f7be945acb98504a4a7b8f347&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:47.461694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409ad0-6a31-4469-a9de-a9993e0259f3 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:47.462258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409ad0-6a31-4469-a9de-a9993e0259f3 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:47.462258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6409ad0-6a31-4469-a9de-a9993e0259f3 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:47.464190 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 505/1009] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:47.476351 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ebf64-6937-44e4-80ea-47149088272e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:47.476818 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ebf64-6937-44e4-80ea-47149088272e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:47.476933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ebf64-6937-44e4-80ea-47149088272e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:47.499045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-bd3ebf64-6937-44e4-80ea-47149088272e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:47.500257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-bd3ebf64-6937-44e4-80ea-47149088272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:47.507425 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 505/1010] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:47 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:47.532395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409ad0-6a31-4469-a9de-a9993e0259f3 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:47.545735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6409ad0-6a31-4469-a9de-a9993e0259f3 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:47.549892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473261ac-05d3-4987-a745-aa584ec856df admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d82mpoXPSQiRsolLkgDQWw, audit_chain_id=['d82mpoXPSQiRsolLkgDQWw']) at 0x7fe09e3e98e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:47.550610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473261ac-05d3-4987-a745-aa584ec856df admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:47.550957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473261ac-05d3-4987-a745-aa584ec856df admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:47.551208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473261ac-05d3-4987-a745-aa584ec856df admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:47.563143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473261ac-05d3-4987-a745-aa584ec856df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:39:47.569852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-473261ac-05d3-4987-a745-aa584ec856df admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:39:47.570978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 506/1011] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:47.577227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ebf64-6937-44e4-80ea-47149088272e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:47.586655 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ebf64-6937-44e4-80ea-47149088272e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:47.591334 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ed3f-c410-4541-97fc-892c778ff860 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d82mpoXPSQiRsolLkgDQWw, audit_chain_id=['d82mpoXPSQiRsolLkgDQWw']) at 0x7fe09e118e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:47.591936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ed3f-c410-4541-97fc-892c778ff860 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:47.592228 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ed3f-c410-4541-97fc-892c778ff860 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:47.592512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ed3f-c410-4541-97fc-892c778ff860 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:47.593227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ed3f-c410-4541-97fc-892c778ff860 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:47.593529 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ed3f-c410-4541-97fc-892c778ff860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:47.595130 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ed3f-c410-4541-97fc-892c778ff860 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:47.604573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 506/1012] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:39:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:47.610479 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473261ac-05d3-4987-a745-aa584ec856df admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:47.623251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473261ac-05d3-4987-a745-aa584ec856df admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:47.627553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68077916-02e0-4bc6-8969-e83dd2f085ce admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d82mpoXPSQiRsolLkgDQWw, audit_chain_id=['d82mpoXPSQiRsolLkgDQWw']) at 0x7fe09e3f0a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:47.628339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68077916-02e0-4bc6-8969-e83dd2f085ce admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:47.628624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68077916-02e0-4bc6-8969-e83dd2f085ce admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:47.628907 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68077916-02e0-4bc6-8969-e83dd2f085ce admin admin] PATH_INFO: `/v3/users/7174c05300674bfc821801baf3d17078` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:47.630011 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68077916-02e0-4bc6-8969-e83dd2f085ce admin admin] RBAC: Authorizing `identity:get_user(user_id=7174c05300674bfc821801baf3d17078)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:47.632975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68077916-02e0-4bc6-8969-e83dd2f085ce admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:47.634446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 507/1013] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:39:47 2022] GET /identity/v3/users/7174c05300674bfc821801baf3d17078 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:47.640226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ed3f-c410-4541-97fc-892c778ff860 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:47.650303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ed3f-c410-4541-97fc-892c778ff860 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:47.654641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dee4a-53cf-4f1b-8f35-238938b2daf3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d82mpoXPSQiRsolLkgDQWw, audit_chain_id=['d82mpoXPSQiRsolLkgDQWw']) at 0x7fe09e118f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:47.655466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dee4a-53cf-4f1b-8f35-238938b2daf3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:47.655758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dee4a-53cf-4f1b-8f35-238938b2daf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:47.656043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dee4a-53cf-4f1b-8f35-238938b2daf3 admin admin] PATH_INFO: `/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:47.657137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dee4a-53cf-4f1b-8f35-238938b2daf3 admin admin] RBAC: Authorizing `identity:get_project(project_id=ebf0ce0f7be945acb98504a4a7b8f347)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:47.659176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dee4a-53cf-4f1b-8f35-238938b2daf3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:47.660723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 507/1014] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:39:47 2022] GET /identity/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:47.667984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68077916-02e0-4bc6-8969-e83dd2f085ce admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:47.677756 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68077916-02e0-4bc6-8969-e83dd2f085ce admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:47.682258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667e324-4c75-4c13-a0ea-eae12592d2a6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d82mpoXPSQiRsolLkgDQWw, audit_chain_id=['d82mpoXPSQiRsolLkgDQWw']) at 0x7fe09e1c8c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:47.683071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667e324-4c75-4c13-a0ea-eae12592d2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:47.683477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667e324-4c75-4c13-a0ea-eae12592d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:47.683665 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667e324-4c75-4c13-a0ea-eae12592d2a6 admin admin] PATH_INFO: `/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347/users/7174c05300674bfc821801baf3d17078/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:47.685477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667e324-4c75-4c13-a0ea-eae12592d2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf0ce0f7be945acb98504a4a7b8f347, user_id=7174c05300674bfc821801baf3d17078, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:47.688129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667e324-4c75-4c13-a0ea-eae12592d2a6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:47.754629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 508/1015] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:39:47 2022] PUT /identity/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347/users/7174c05300674bfc821801baf3d17078/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:39:50.005746 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ac82-b7be-41cf-b114-c066514f59fc None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:50.006360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ac82-b7be-41cf-b114-c066514f59fc None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:50.006471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ac82-b7be-41cf-b114-c066514f59fc None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:50.008103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 508/1016] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:50.013317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29e427-f13f-415d-ba4f-978ba1c49257 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:50.013755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29e427-f13f-415d-ba4f-978ba1c49257 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:50.013881 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29e427-f13f-415d-ba4f-978ba1c49257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:50.036179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-ea29e427-f13f-415d-ba4f-978ba1c49257 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:50.037381 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ea29e427-f13f-415d-ba4f-978ba1c49257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:50.101143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 509/1017] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:50 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:50.124565 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864ac82-b7be-41cf-b114-c066514f59fc None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:50.137562 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864ac82-b7be-41cf-b114-c066514f59fc None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:50.141672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a1437-361b-4bf2-9a74-106a89937a53 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=J0LZ4H57TxqVuE8w8ivlYg, audit_chain_id=['J0LZ4H57TxqVuE8w8ivlYg']) at 0x7fe09e1187c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:50.142382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a1437-361b-4bf2-9a74-106a89937a53 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:50.142673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a1437-361b-4bf2-9a74-106a89937a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:50.142957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a1437-361b-4bf2-9a74-106a89937a53 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:50.156148 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a1437-361b-4bf2-9a74-106a89937a53 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:39:50.162917 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-5e7a1437-361b-4bf2-9a74-106a89937a53 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:39:50.164058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 509/1018] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:39:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:39:50.170351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29e427-f13f-415d-ba4f-978ba1c49257 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:50.179339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29e427-f13f-415d-ba4f-978ba1c49257 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:50.183623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea6c6-9f01-4ab4-b018-ec5dcb955719 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=J0LZ4H57TxqVuE8w8ivlYg, audit_chain_id=['J0LZ4H57TxqVuE8w8ivlYg']) at 0x7fe09e3f3c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:50.184213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea6c6-9f01-4ab4-b018-ec5dcb955719 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:50.184503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea6c6-9f01-4ab4-b018-ec5dcb955719 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:50.184787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea6c6-9f01-4ab4-b018-ec5dcb955719 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:50.185500 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecea6c6-9f01-4ab4-b018-ec5dcb955719 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:50.185800 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecea6c6-9f01-4ab4-b018-ec5dcb955719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:50.187595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecea6c6-9f01-4ab4-b018-ec5dcb955719 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:50.196748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 510/1019] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:39:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:50.202479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a1437-361b-4bf2-9a74-106a89937a53 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:50.213263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a1437-361b-4bf2-9a74-106a89937a53 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:50.217591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac93ca-4016-4539-a13f-7d88590345dc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=J0LZ4H57TxqVuE8w8ivlYg, audit_chain_id=['J0LZ4H57TxqVuE8w8ivlYg']) at 0x7fe09dec16d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:50.218383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac93ca-4016-4539-a13f-7d88590345dc admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:50.218673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac93ca-4016-4539-a13f-7d88590345dc admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:50.218956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac93ca-4016-4539-a13f-7d88590345dc admin admin] PATH_INFO: `/v3/users/7174c05300674bfc821801baf3d17078` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:50.220105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac93ca-4016-4539-a13f-7d88590345dc admin admin] RBAC: Authorizing `identity:get_user(user_id=7174c05300674bfc821801baf3d17078)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:50.222214 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac93ca-4016-4539-a13f-7d88590345dc admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:50.223693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 510/1020] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:39:50 2022] GET /identity/v3/users/7174c05300674bfc821801baf3d17078 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:50.229306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea6c6-9f01-4ab4-b018-ec5dcb955719 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:50.238868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea6c6-9f01-4ab4-b018-ec5dcb955719 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:50.243792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd288d-7426-4d2d-a6dd-040653ad814b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=J0LZ4H57TxqVuE8w8ivlYg, audit_chain_id=['J0LZ4H57TxqVuE8w8ivlYg']) at 0x7fe09e1b8b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:50.244362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd288d-7426-4d2d-a6dd-040653ad814b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:50.244650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd288d-7426-4d2d-a6dd-040653ad814b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:50.244934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd288d-7426-4d2d-a6dd-040653ad814b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:50.252614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd288d-7426-4d2d-a6dd-040653ad814b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:50.254340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd288d-7426-4d2d-a6dd-040653ad814b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:50.263717 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 511/1021] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:39:50 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:50.269656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac93ca-4016-4539-a13f-7d88590345dc admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:50.279598 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac93ca-4016-4539-a13f-7d88590345dc admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:50.284952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418728c-d1ec-4e26-9c12-86eb45c6a3de admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=J0LZ4H57TxqVuE8w8ivlYg, audit_chain_id=['J0LZ4H57TxqVuE8w8ivlYg']) at 0x7fe09dec1580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:50.285780 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418728c-d1ec-4e26-9c12-86eb45c6a3de admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:50.286074 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418728c-d1ec-4e26-9c12-86eb45c6a3de admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:50.286385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418728c-d1ec-4e26-9c12-86eb45c6a3de admin admin] PATH_INFO: `/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:50.288294 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418728c-d1ec-4e26-9c12-86eb45c6a3de admin admin] RBAC: Authorizing `identity:get_project(project_id=ebf0ce0f7be945acb98504a4a7b8f347)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:50.290313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418728c-d1ec-4e26-9c12-86eb45c6a3de admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:50.291929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 511/1022] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:39:50 2022] GET /identity/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:50.300789 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd288d-7426-4d2d-a6dd-040653ad814b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:50.314152 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd288d-7426-4d2d-a6dd-040653ad814b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:50.321330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b629e0e-2112-455b-82c5-d944d7148f7d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=J0LZ4H57TxqVuE8w8ivlYg, audit_chain_id=['J0LZ4H57TxqVuE8w8ivlYg']) at 0x7fe09e3eb760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:50.322113 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b629e0e-2112-455b-82c5-d944d7148f7d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:50.322507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b629e0e-2112-455b-82c5-d944d7148f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:50.322901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b629e0e-2112-455b-82c5-d944d7148f7d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:50.324050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b629e0e-2112-455b-82c5-d944d7148f7d admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=ebf0ce0f7be945acb98504a4a7b8f347, user.id=7174c05300674bfc821801baf3d17078) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:50.324464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b629e0e-2112-455b-82c5-d944d7148f7d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:50.327337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b629e0e-2112-455b-82c5-d944d7148f7d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:50.336808 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 512/1023] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:39:50 2022] GET /identity/v3/role_assignments?user.id=7174c05300674bfc821801baf3d17078&scope.project.id=ebf0ce0f7be945acb98504a4a7b8f347&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:52.465540 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a741-9b42-4441-b0b9-a340033a9ecc None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:52.466073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a741-9b42-4441-b0b9-a340033a9ecc None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:52.466187 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a741-9b42-4441-b0b9-a340033a9ecc None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:52.467803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 512/1024] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:52.472971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80786-7152-46c4-8149-56f2470091ce None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:52.473389 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80786-7152-46c4-8149-56f2470091ce None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:52.473537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80786-7152-46c4-8149-56f2470091ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:52.496873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-84a80786-7152-46c4-8149-56f2470091ce None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:52.498023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-84a80786-7152-46c4-8149-56f2470091ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:52.505158 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 513/1025] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:52 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:52.530044 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a741-9b42-4441-b0b9-a340033a9ecc None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:52.542439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a741-9b42-4441-b0b9-a340033a9ecc None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:52.546493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd575d88-6f90-476d-8cce-f6f1ea1f5cf8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1Of2DalSQr-fV3o-wBSm4g, audit_chain_id=['1Of2DalSQr-fV3o-wBSm4g']) at 0x7fe09e118400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:52.547229 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575d88-6f90-476d-8cce-f6f1ea1f5cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:52.547520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575d88-6f90-476d-8cce-f6f1ea1f5cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:52.547799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575d88-6f90-476d-8cce-f6f1ea1f5cf8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:52.548873 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd575d88-6f90-476d-8cce-f6f1ea1f5cf8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:52.550558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd575d88-6f90-476d-8cce-f6f1ea1f5cf8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:52.552650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 513/1026] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:39:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:52.558642 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a80786-7152-46c4-8149-56f2470091ce None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:52.567392 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a80786-7152-46c4-8149-56f2470091ce None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:52.572710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b93609-0e22-45e3-9314-b7ba967a4770 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1Of2DalSQr-fV3o-wBSm4g, audit_chain_id=['1Of2DalSQr-fV3o-wBSm4g']) at 0x7fe09e3dc310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:52.573295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b93609-0e22-45e3-9314-b7ba967a4770 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:52.573581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b93609-0e22-45e3-9314-b7ba967a4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:52.573859 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b93609-0e22-45e3-9314-b7ba967a4770 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:52.574511 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b93609-0e22-45e3-9314-b7ba967a4770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:52.576496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b93609-0e22-45e3-9314-b7ba967a4770 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:52.655568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 514/1027] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:39:52 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:39:54.817234 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00aa9d-d438-4f26-b1f7-4a161a96a5ba None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:54.817789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00aa9d-d438-4f26-b1f7-4a161a96a5ba None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:54.817899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00aa9d-d438-4f26-b1f7-4a161a96a5ba None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:54.819525 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 514/1028] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:54.824762 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45baf45-0169-422f-a74f-dcb79559533f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:54.825176 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45baf45-0169-422f-a74f-dcb79559533f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:54.825332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45baf45-0169-422f-a74f-dcb79559533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:54.848159 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c45baf45-0169-422f-a74f-dcb79559533f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:54.849965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c45baf45-0169-422f-a74f-dcb79559533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:54.857177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 515/1029] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:54 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:54.882230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00aa9d-d438-4f26-b1f7-4a161a96a5ba None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:54.893939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00aa9d-d438-4f26-b1f7-4a161a96a5ba None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:54.898184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5e050-df8a-4137-9697-3cb8223d38a8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r7nRlQOGTfyt8FfNwAXwxw, audit_chain_id=['r7nRlQOGTfyt8FfNwAXwxw']) at 0x7fe09e1181f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:54.898972 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5e050-df8a-4137-9697-3cb8223d38a8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:54.899275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5e050-df8a-4137-9697-3cb8223d38a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:54.899558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5e050-df8a-4137-9697-3cb8223d38a8 admin admin] PATH_INFO: `/v3/roles/5fae8096df3e470085794883a1631067` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:54.900895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5e050-df8a-4137-9697-3cb8223d38a8 admin admin] RBAC: Authorizing `identity:get_role(role_id=5fae8096df3e470085794883a1631067)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:54.901895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-1ce5e050-df8a-4137-9697-3cb8223d38a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:39:54.901895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:39:54.901895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:39:54.902755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5e050-df8a-4137-9697-3cb8223d38a8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:54.904013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 515/1030] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:39:54 2022] GET /identity/v3/roles/5fae8096df3e470085794883a1631067 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:54.909778 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45baf45-0169-422f-a74f-dcb79559533f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:54.918751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45baf45-0169-422f-a74f-dcb79559533f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:54.923010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba266c-1d39-4e24-b2f2-7c9e38d4692d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r7nRlQOGTfyt8FfNwAXwxw, audit_chain_id=['r7nRlQOGTfyt8FfNwAXwxw']) at 0x7fe09e3d1340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:54.923842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba266c-1d39-4e24-b2f2-7c9e38d4692d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:54.924127 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba266c-1d39-4e24-b2f2-7c9e38d4692d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:54.924407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba266c-1d39-4e24-b2f2-7c9e38d4692d admin admin] PATH_INFO: `/v3/users/02f12245badd41448bca8b4e8ac507ac` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:54.944580 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba266c-1d39-4e24-b2f2-7c9e38d4692d admin admin] RBAC: Authorizing `identity:get_user(user_id=02f12245badd41448bca8b4e8ac507ac)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:54.946717 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba266c-1d39-4e24-b2f2-7c9e38d4692d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:54.948309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 516/1031] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:39:54 2022] GET /identity/v3/users/02f12245badd41448bca8b4e8ac507ac => generated 286 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:54.954112 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5e050-df8a-4137-9697-3cb8223d38a8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:54.964020 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5e050-df8a-4137-9697-3cb8223d38a8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:54.968313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc493730-a286-40af-8c15-7cfef90e6f0e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r7nRlQOGTfyt8FfNwAXwxw, audit_chain_id=['r7nRlQOGTfyt8FfNwAXwxw']) at 0x7fe09e118c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:54.968897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc493730-a286-40af-8c15-7cfef90e6f0e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:54.969150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc493730-a286-40af-8c15-7cfef90e6f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:54.969437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc493730-a286-40af-8c15-7cfef90e6f0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:54.977244 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc493730-a286-40af-8c15-7cfef90e6f0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:54.979028 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc493730-a286-40af-8c15-7cfef90e6f0e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:54.987686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 516/1032] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:39:54 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:54.994147 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba266c-1d39-4e24-b2f2-7c9e38d4692d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:55.003519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba266c-1d39-4e24-b2f2-7c9e38d4692d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:55.008598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec70a0a-24e9-4e64-a718-4ef168391052 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r7nRlQOGTfyt8FfNwAXwxw, audit_chain_id=['r7nRlQOGTfyt8FfNwAXwxw']) at 0x7fe09e15b1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:55.009372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec70a0a-24e9-4e64-a718-4ef168391052 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:55.009656 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec70a0a-24e9-4e64-a718-4ef168391052 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:55.009934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec70a0a-24e9-4e64-a718-4ef168391052 admin admin] PATH_INFO: `/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:55.011008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec70a0a-24e9-4e64-a718-4ef168391052 admin admin] RBAC: Authorizing `identity:get_project(project_id=ebf0ce0f7be945acb98504a4a7b8f347)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:55.013124 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec70a0a-24e9-4e64-a718-4ef168391052 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:55.014640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 517/1033] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:39:54 2022] GET /identity/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:55.020688 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc493730-a286-40af-8c15-7cfef90e6f0e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:55.029280 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc493730-a286-40af-8c15-7cfef90e6f0e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:55.033629 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c9682-2b04-40f0-b9d9-1fc04bb99658 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r7nRlQOGTfyt8FfNwAXwxw, audit_chain_id=['r7nRlQOGTfyt8FfNwAXwxw']) at 0x7fe09e118c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:55.034207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9682-2b04-40f0-b9d9-1fc04bb99658 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:55.034498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9682-2b04-40f0-b9d9-1fc04bb99658 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:55.034782 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9682-2b04-40f0-b9d9-1fc04bb99658 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:55.035593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c9682-2b04-40f0-b9d9-1fc04bb99658 admin admin] RBAC: Adding query filter params (role.id=5fae8096df3e470085794883a1631067, scope.project.id=ebf0ce0f7be945acb98504a4a7b8f347, user.id=02f12245badd41448bca8b4e8ac507ac) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:55.035899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c9682-2b04-40f0-b9d9-1fc04bb99658 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:55.037776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c9682-2b04-40f0-b9d9-1fc04bb99658 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:55.042912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 517/1034] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:39:55 2022] GET /identity/v3/role_assignments?user.id=02f12245badd41448bca8b4e8ac507ac&scope.project.id=ebf0ce0f7be945acb98504a4a7b8f347&role.id=5fae8096df3e470085794883a1631067 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:57.142892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5a22-543a-415d-8e1e-9ea54c97c572 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:57.143492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5a22-543a-415d-8e1e-9ea54c97c572 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:57.143492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5a22-543a-415d-8e1e-9ea54c97c572 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:57.145158 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 518/1035] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:57.150812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0ef5c-3b68-4b5b-99f1-329de269468d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:57.151248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0ef5c-3b68-4b5b-99f1-329de269468d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:57.151413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0ef5c-3b68-4b5b-99f1-329de269468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:57.173305 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-96f0ef5c-3b68-4b5b-99f1-329de269468d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:57.174444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-96f0ef5c-3b68-4b5b-99f1-329de269468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:57.182005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 518/1036] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:57 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:57.204732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd5a22-543a-415d-8e1e-9ea54c97c572 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:57.217289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd5a22-543a-415d-8e1e-9ea54c97c572 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:57.221441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd61cb-c177-47d7-8e4c-ad368f67d934 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c1JDROQySoa0J0X9d2rubw, audit_chain_id=['c1JDROQySoa0J0X9d2rubw']) at 0x7fe09e1c2490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:57.222207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd61cb-c177-47d7-8e4c-ad368f67d934 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:57.222493 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd61cb-c177-47d7-8e4c-ad368f67d934 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:57.222774 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd61cb-c177-47d7-8e4c-ad368f67d934 admin admin] PATH_INFO: `/v3/roles/5fae8096df3e470085794883a1631067` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:57.224796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd61cb-c177-47d7-8e4c-ad368f67d934 admin admin] RBAC: Authorizing `identity:get_role(role_id=5fae8096df3e470085794883a1631067)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:57.225802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-64fd61cb-c177-47d7-8e4c-ad368f67d934 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:39:57.225802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:39:57.225802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:39:57.226668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd61cb-c177-47d7-8e4c-ad368f67d934 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:57.227926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 519/1037] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:39:57 2022] GET /identity/v3/roles/5fae8096df3e470085794883a1631067 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:57.233548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0ef5c-3b68-4b5b-99f1-329de269468d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:57.242287 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0ef5c-3b68-4b5b-99f1-329de269468d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:57.246460 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435fda2-e560-4dda-b880-87e506b636be admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c1JDROQySoa0J0X9d2rubw, audit_chain_id=['c1JDROQySoa0J0X9d2rubw']) at 0x7fe09e118220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:57.247291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435fda2-e560-4dda-b880-87e506b636be admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:57.247582 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435fda2-e560-4dda-b880-87e506b636be admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:57.247861 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435fda2-e560-4dda-b880-87e506b636be admin admin] PATH_INFO: `/v3/users/02f12245badd41448bca8b4e8ac507ac` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:57.248994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435fda2-e560-4dda-b880-87e506b636be admin admin] RBAC: Authorizing `identity:get_user(user_id=02f12245badd41448bca8b4e8ac507ac)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:57.251072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435fda2-e560-4dda-b880-87e506b636be admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:57.252555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 519/1038] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:39:57 2022] GET /identity/v3/users/02f12245badd41448bca8b4e8ac507ac => generated 286 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:57.258212 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd61cb-c177-47d7-8e4c-ad368f67d934 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:57.267495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd61cb-c177-47d7-8e4c-ad368f67d934 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:57.272187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef9265-7f78-4334-b2c8-0d192621d334 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c1JDROQySoa0J0X9d2rubw, audit_chain_id=['c1JDROQySoa0J0X9d2rubw']) at 0x7fe09e1ccf10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:57.272943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9265-7f78-4334-b2c8-0d192621d334 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:57.273227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9265-7f78-4334-b2c8-0d192621d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:57.273507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9265-7f78-4334-b2c8-0d192621d334 admin admin] PATH_INFO: `/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:57.274575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef9265-7f78-4334-b2c8-0d192621d334 admin admin] RBAC: Authorizing `identity:get_project(project_id=ebf0ce0f7be945acb98504a4a7b8f347)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:57.276597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef9265-7f78-4334-b2c8-0d192621d334 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:57.278069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 520/1039] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:39:57 2022] GET /identity/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:39:57.283704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435fda2-e560-4dda-b880-87e506b636be admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:57.293980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435fda2-e560-4dda-b880-87e506b636be admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:57.298196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5e346-71a2-41b8-8ad4-4407f9e84d78 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c1JDROQySoa0J0X9d2rubw, audit_chain_id=['c1JDROQySoa0J0X9d2rubw']) at 0x7fe09e705e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:57.299012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e346-71a2-41b8-8ad4-4407f9e84d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:57.299332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e346-71a2-41b8-8ad4-4407f9e84d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:57.299619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e346-71a2-41b8-8ad4-4407f9e84d78 admin admin] PATH_INFO: `/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347/users/02f12245badd41448bca8b4e8ac507ac/roles/5fae8096df3e470085794883a1631067` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:57.301819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5e346-71a2-41b8-8ad4-4407f9e84d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf0ce0f7be945acb98504a4a7b8f347, user_id=02f12245badd41448bca8b4e8ac507ac, role_id=5fae8096df3e470085794883a1631067)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:57.304439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5e346-71a2-41b8-8ad4-4407f9e84d78 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:57.382313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 520/1040] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:39:57 2022] PUT /identity/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347/users/02f12245badd41448bca8b4e8ac507ac/roles/5fae8096df3e470085794883a1631067 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:39:59.527337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8245e0b-4e31-40d7-aa34-29e4ae34e05f None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:59.527892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8245e0b-4e31-40d7-aa34-29e4ae34e05f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:59.527892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8245e0b-4e31-40d7-aa34-29e4ae34e05f None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:59.529556 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 521/1041] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:59.535010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242433e-7cdb-4f58-a390-0239b4fb872e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:59.535463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242433e-7cdb-4f58-a390-0239b4fb872e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:59.535599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242433e-7cdb-4f58-a390-0239b4fb872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:59.557628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3242433e-7cdb-4f58-a390-0239b4fb872e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:59.558749 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3242433e-7cdb-4f58-a390-0239b4fb872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:59.623400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 521/1042] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:59 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:59.648445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8245e0b-4e31-40d7-aa34-29e4ae34e05f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:59.660521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8245e0b-4e31-40d7-aa34-29e4ae34e05f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:59.665432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadada98-5c75-4517-a99a-f62fa63d5ecd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XfITMHL8RiOHVE6-wPcp1Q, audit_chain_id=['XfITMHL8RiOHVE6-wPcp1Q']) at 0x7fe09e3e0a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:59.666201 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadada98-5c75-4517-a99a-f62fa63d5ecd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:59.666488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadada98-5c75-4517-a99a-f62fa63d5ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:59.666770 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadada98-5c75-4517-a99a-f62fa63d5ecd admin admin] PATH_INFO: `/v3/roles/5fae8096df3e470085794883a1631067` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:59.668128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadada98-5c75-4517-a99a-f62fa63d5ecd admin admin] RBAC: Authorizing `identity:get_role(role_id=5fae8096df3e470085794883a1631067)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:59.669706 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadada98-5c75-4517-a99a-f62fa63d5ecd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:59.670951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 522/1043] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:39:59 2022] GET /identity/v3/roles/5fae8096df3e470085794883a1631067 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:59.677643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242433e-7cdb-4f58-a390-0239b4fb872e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:59.686207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242433e-7cdb-4f58-a390-0239b4fb872e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:59.690612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bba78-829e-4a01-9a13-f3f41e9c94b3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XfITMHL8RiOHVE6-wPcp1Q, audit_chain_id=['XfITMHL8RiOHVE6-wPcp1Q']) at 0x7fe09e1dd940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:59.691445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bba78-829e-4a01-9a13-f3f41e9c94b3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:59.691736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bba78-829e-4a01-9a13-f3f41e9c94b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:59.692017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bba78-829e-4a01-9a13-f3f41e9c94b3 admin admin] PATH_INFO: `/v3/users/02f12245badd41448bca8b4e8ac507ac` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:59.693255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bba78-829e-4a01-9a13-f3f41e9c94b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=02f12245badd41448bca8b4e8ac507ac)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:59.695463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bba78-829e-4a01-9a13-f3f41e9c94b3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:59.696940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 522/1044] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:39:59 2022] GET /identity/v3/users/02f12245badd41448bca8b4e8ac507ac => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:59.702855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadada98-5c75-4517-a99a-f62fa63d5ecd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:59.715589 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadada98-5c75-4517-a99a-f62fa63d5ecd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:59.720436 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f817f-5368-4861-9b71-bc2607bd183e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XfITMHL8RiOHVE6-wPcp1Q, audit_chain_id=['XfITMHL8RiOHVE6-wPcp1Q']) at 0x7fe09e439ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:59.721014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f817f-5368-4861-9b71-bc2607bd183e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:59.721303 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f817f-5368-4861-9b71-bc2607bd183e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:59.721587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f817f-5368-4861-9b71-bc2607bd183e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:59.730067 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f817f-5368-4861-9b71-bc2607bd183e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:59.731895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f817f-5368-4861-9b71-bc2607bd183e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:59.741177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 523/1045] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:39:59 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:59.747095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bba78-829e-4a01-9a13-f3f41e9c94b3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:59.756539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bba78-829e-4a01-9a13-f3f41e9c94b3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:59.760758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde99553-31c4-4a5a-8591-3cd8122a9bcf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XfITMHL8RiOHVE6-wPcp1Q, audit_chain_id=['XfITMHL8RiOHVE6-wPcp1Q']) at 0x7fe09dec1850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:59.761526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde99553-31c4-4a5a-8591-3cd8122a9bcf admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:59.761811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde99553-31c4-4a5a-8591-3cd8122a9bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:59.762089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde99553-31c4-4a5a-8591-3cd8122a9bcf admin admin] PATH_INFO: `/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:59.763185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde99553-31c4-4a5a-8591-3cd8122a9bcf admin admin] RBAC: Authorizing `identity:get_project(project_id=ebf0ce0f7be945acb98504a4a7b8f347)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:59.765181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde99553-31c4-4a5a-8591-3cd8122a9bcf admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:59.766672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 523/1046] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:39:59 2022] GET /identity/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:39:59.772640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f817f-5368-4861-9b71-bc2607bd183e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:59.781207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f817f-5368-4861-9b71-bc2607bd183e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:59.785515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663163e-3624-4fa0-b557-5d098b515056 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XfITMHL8RiOHVE6-wPcp1Q, audit_chain_id=['XfITMHL8RiOHVE6-wPcp1Q']) at 0x7fe09e716130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:59.786613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663163e-3624-4fa0-b557-5d098b515056 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:59.786904 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663163e-3624-4fa0-b557-5d098b515056 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:59.787221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663163e-3624-4fa0-b557-5d098b515056 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:59.787989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663163e-3624-4fa0-b557-5d098b515056 admin admin] RBAC: Adding query filter params (role.id=5fae8096df3e470085794883a1631067, scope.project.id=ebf0ce0f7be945acb98504a4a7b8f347, user.id=02f12245badd41448bca8b4e8ac507ac) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:39:59.788295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663163e-3624-4fa0-b557-5d098b515056 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:59.790101 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663163e-3624-4fa0-b557-5d098b515056 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:39:59.795695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 524/1047] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:39:59 2022] GET /identity/v3/role_assignments?user.id=02f12245badd41448bca8b4e8ac507ac&scope.project.id=ebf0ce0f7be945acb98504a4a7b8f347&role.id=5fae8096df3e470085794883a1631067 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:01.918673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d215bfc-a927-446f-8464-f446828f8423 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:01.919251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d215bfc-a927-446f-8464-f446828f8423 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:01.919251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d215bfc-a927-446f-8464-f446828f8423 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:01.920916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 524/1048] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:01.926209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66501b-e2ee-46d5-bd10-7c727e2c7532 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:01.926613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66501b-e2ee-46d5-bd10-7c727e2c7532 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:01.926824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66501b-e2ee-46d5-bd10-7c727e2c7532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:01.949426 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-cd66501b-e2ee-46d5-bd10-7c727e2c7532 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:01.950568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-cd66501b-e2ee-46d5-bd10-7c727e2c7532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:01.958332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 525/1049] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:01 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:01.982512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d215bfc-a927-446f-8464-f446828f8423 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:01.995645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d215bfc-a927-446f-8464-f446828f8423 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:01.999746 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202df0f4-e763-414c-8f47-611e392a8f61 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-r6cPoVMS0mNN0RtiaCdTA, audit_chain_id=['-r6cPoVMS0mNN0RtiaCdTA']) at 0x7fe09e1dd7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:02.000486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df0f4-e763-414c-8f47-611e392a8f61 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:02.000772 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df0f4-e763-414c-8f47-611e392a8f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:02.001051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df0f4-e763-414c-8f47-611e392a8f61 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:02.002125 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202df0f4-e763-414c-8f47-611e392a8f61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:02.003821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202df0f4-e763-414c-8f47-611e392a8f61 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:02.006008 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 525/1050] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:40:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:02.012006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66501b-e2ee-46d5-bd10-7c727e2c7532 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:02.021404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66501b-e2ee-46d5-bd10-7c727e2c7532 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:02.025881 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e33cb-8d4a-440a-bb34-6feb5f1623f3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-r6cPoVMS0mNN0RtiaCdTA, audit_chain_id=['-r6cPoVMS0mNN0RtiaCdTA']) at 0x7fe09e162a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:02.026464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e33cb-8d4a-440a-bb34-6feb5f1623f3 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:02.026755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e33cb-8d4a-440a-bb34-6feb5f1623f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:02.027038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e33cb-8d4a-440a-bb34-6feb5f1623f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:02.027777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e33cb-8d4a-440a-bb34-6feb5f1623f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:02.029694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e33cb-8d4a-440a-bb34-6feb5f1623f3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:02.120375 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 526/1051] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:40:02 2022] POST /identity/v3/projects => generated 311 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:40:04.252545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575e046-3f98-448d-88e3-30cb65e4d791 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:04.253078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575e046-3f98-448d-88e3-30cb65e4d791 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:04.253078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575e046-3f98-448d-88e3-30cb65e4d791 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:04.254682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 526/1052] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:04.260525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a97f-cad4-401d-aaba-167af79a3a15 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:04.260942 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a97f-cad4-401d-aaba-167af79a3a15 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:04.261106 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a97f-cad4-401d-aaba-167af79a3a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:04.285116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-8295a97f-cad4-401d-aaba-167af79a3a15 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:04.286406 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8295a97f-cad4-401d-aaba-167af79a3a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:04.351617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 527/1053] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:04 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:04.375948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575e046-3f98-448d-88e3-30cb65e4d791 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:04.388270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575e046-3f98-448d-88e3-30cb65e4d791 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:04.392513 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a084845-b987-40c2-8028-9d0fedabcbf3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PwJoJ4SqTlyfaMeQOCV7cA, audit_chain_id=['PwJoJ4SqTlyfaMeQOCV7cA']) at 0x7fe09e1085e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:04.393215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084845-b987-40c2-8028-9d0fedabcbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:04.393501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084845-b987-40c2-8028-9d0fedabcbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:04.393783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084845-b987-40c2-8028-9d0fedabcbf3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:04.394851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a084845-b987-40c2-8028-9d0fedabcbf3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:04.397320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a084845-b987-40c2-8028-9d0fedabcbf3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:04.398748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 527/1054] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:40:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:04.404409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295a97f-cad4-401d-aaba-167af79a3a15 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:04.413397 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295a97f-cad4-401d-aaba-167af79a3a15 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:04.417722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7368a8-0a2b-4a91-b340-0a3de4e5a84e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PwJoJ4SqTlyfaMeQOCV7cA, audit_chain_id=['PwJoJ4SqTlyfaMeQOCV7cA']) at 0x7fe09e8faa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:04.418314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7368a8-0a2b-4a91-b340-0a3de4e5a84e admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:04.418603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7368a8-0a2b-4a91-b340-0a3de4e5a84e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:04.418885 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7368a8-0a2b-4a91-b340-0a3de4e5a84e admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:04.419626 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7368a8-0a2b-4a91-b340-0a3de4e5a84e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:04.421552 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7368a8-0a2b-4a91-b340-0a3de4e5a84e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:04.496069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 528/1055] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:40:04 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:40:06.643516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e13cd-b81c-4c26-a801-afcd9cf31a2e None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:06.644093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e13cd-b81c-4c26-a801-afcd9cf31a2e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:06.644093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e13cd-b81c-4c26-a801-afcd9cf31a2e None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:06.646335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 528/1056] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:06.651644 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912d06-cabb-4b3c-907f-81ae7cf36540 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:06.652071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912d06-cabb-4b3c-907f-81ae7cf36540 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:06.652253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912d06-cabb-4b3c-907f-81ae7cf36540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:06.674152 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-dc912d06-cabb-4b3c-907f-81ae7cf36540 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:06.675332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-dc912d06-cabb-4b3c-907f-81ae7cf36540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:06.682388 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 529/1057] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:06 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:06.706055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e13cd-b81c-4c26-a801-afcd9cf31a2e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:06.718806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e13cd-b81c-4c26-a801-afcd9cf31a2e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:06.722888 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525e4b7-de27-459f-8c92-70890e601804 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6u_8eKljRx633LOE4OpCEg, audit_chain_id=['6u_8eKljRx633LOE4OpCEg']) at 0x7fe09e269ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:06.723688 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525e4b7-de27-459f-8c92-70890e601804 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:06.723937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525e4b7-de27-459f-8c92-70890e601804 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:06.724213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525e4b7-de27-459f-8c92-70890e601804 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:06.735362 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525e4b7-de27-459f-8c92-70890e601804 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:40:06.741987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-8525e4b7-de27-459f-8c92-70890e601804 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:40:06.743062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 529/1058] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:40:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:40:06.749086 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912d06-cabb-4b3c-907f-81ae7cf36540 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:06.758459 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912d06-cabb-4b3c-907f-81ae7cf36540 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:06.762733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a7987-e612-4b6b-81c2-cf05504e4100 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6u_8eKljRx633LOE4OpCEg, audit_chain_id=['6u_8eKljRx633LOE4OpCEg']) at 0x7fe09e1c8ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:06.763395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a7987-e612-4b6b-81c2-cf05504e4100 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:06.763687 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a7987-e612-4b6b-81c2-cf05504e4100 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:06.763969 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a7987-e612-4b6b-81c2-cf05504e4100 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:06.764682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a7987-e612-4b6b-81c2-cf05504e4100 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:40:06.764986 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a7987-e612-4b6b-81c2-cf05504e4100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:06.766569 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a7987-e612-4b6b-81c2-cf05504e4100 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:06.775075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 530/1059] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:06.780698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525e4b7-de27-459f-8c92-70890e601804 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:06.789980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525e4b7-de27-459f-8c92-70890e601804 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:06.794184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a7e3-d28a-4b35-a66d-10825bb9e48a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6u_8eKljRx633LOE4OpCEg, audit_chain_id=['6u_8eKljRx633LOE4OpCEg']) at 0x7fe09e118c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:06.794955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a7e3-d28a-4b35-a66d-10825bb9e48a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:06.795273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a7e3-d28a-4b35-a66d-10825bb9e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:06.795554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a7e3-d28a-4b35-a66d-10825bb9e48a admin admin] PATH_INFO: `/v3/users/fb7c84ee0bb84d4e9d85ce46a64f10d0` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:06.813919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407a7e3-d28a-4b35-a66d-10825bb9e48a admin admin] RBAC: Authorizing `identity:get_user(user_id=fb7c84ee0bb84d4e9d85ce46a64f10d0)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:06.816057 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407a7e3-d28a-4b35-a66d-10825bb9e48a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:06.818287 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 530/1060] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:06 2022] GET /identity/v3/users/fb7c84ee0bb84d4e9d85ce46a64f10d0 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:06.824134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a7987-e612-4b6b-81c2-cf05504e4100 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:06.834145 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a7987-e612-4b6b-81c2-cf05504e4100 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:06.838825 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33575708-d4d0-4b53-b823-c13c308dbe14 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6u_8eKljRx633LOE4OpCEg, audit_chain_id=['6u_8eKljRx633LOE4OpCEg']) at 0x7fe09e4721f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:06.839437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33575708-d4d0-4b53-b823-c13c308dbe14 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:06.839728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33575708-d4d0-4b53-b823-c13c308dbe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:06.840009 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33575708-d4d0-4b53-b823-c13c308dbe14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:06.847817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33575708-d4d0-4b53-b823-c13c308dbe14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:06.850133 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33575708-d4d0-4b53-b823-c13c308dbe14 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:06.858710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 531/1061] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:40:06 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:40:06.864897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a7e3-d28a-4b35-a66d-10825bb9e48a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:06.874034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a7e3-d28a-4b35-a66d-10825bb9e48a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:06.878236 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab01845-91e2-443d-8705-2e043129b26f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6u_8eKljRx633LOE4OpCEg, audit_chain_id=['6u_8eKljRx633LOE4OpCEg']) at 0x7fe09e1947c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:06.879012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab01845-91e2-443d-8705-2e043129b26f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:06.879328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab01845-91e2-443d-8705-2e043129b26f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:06.879610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab01845-91e2-443d-8705-2e043129b26f admin admin] PATH_INFO: `/v3/projects/00b56488aed744d7b2ac4fff59ebb674` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:06.881343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab01845-91e2-443d-8705-2e043129b26f admin admin] RBAC: Authorizing `identity:get_project(project_id=00b56488aed744d7b2ac4fff59ebb674)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:06.883385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab01845-91e2-443d-8705-2e043129b26f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:06.884868 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 531/1062] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:06 2022] GET /identity/v3/projects/00b56488aed744d7b2ac4fff59ebb674 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:06.890865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33575708-d4d0-4b53-b823-c13c308dbe14 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:06.899653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33575708-d4d0-4b53-b823-c13c308dbe14 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:06.903961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70fd7b-a7a7-4d6e-90fe-f9dcb3f353bf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6u_8eKljRx633LOE4OpCEg, audit_chain_id=['6u_8eKljRx633LOE4OpCEg']) at 0x7fe09eb66490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:06.904525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70fd7b-a7a7-4d6e-90fe-f9dcb3f353bf admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:06.904810 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70fd7b-a7a7-4d6e-90fe-f9dcb3f353bf admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:06.905087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70fd7b-a7a7-4d6e-90fe-f9dcb3f353bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:06.905853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70fd7b-a7a7-4d6e-90fe-f9dcb3f353bf admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=00b56488aed744d7b2ac4fff59ebb674, user.id=fb7c84ee0bb84d4e9d85ce46a64f10d0) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:40:06.906151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70fd7b-a7a7-4d6e-90fe-f9dcb3f353bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:06.908096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70fd7b-a7a7-4d6e-90fe-f9dcb3f353bf admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:06.913272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 532/1063] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:40:06 2022] GET /identity/v3/role_assignments?user.id=fb7c84ee0bb84d4e9d85ce46a64f10d0&scope.project.id=00b56488aed744d7b2ac4fff59ebb674&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:09.013434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c23f-875f-4249-b23a-2cf5aa35ffb9 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:09.013988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c23f-875f-4249-b23a-2cf5aa35ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:09.013988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c23f-875f-4249-b23a-2cf5aa35ffb9 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:09.015712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 532/1064] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:09.020806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97735-31a5-43f6-966a-147d7c01e597 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:09.021236 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97735-31a5-43f6-966a-147d7c01e597 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:09.021345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97735-31a5-43f6-966a-147d7c01e597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:09.043014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-94e97735-31a5-43f6-966a-147d7c01e597 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:09.044179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-94e97735-31a5-43f6-966a-147d7c01e597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:09.051092 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 533/1065] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:09 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:40:09.074694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c23f-875f-4249-b23a-2cf5aa35ffb9 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:09.086554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c23f-875f-4249-b23a-2cf5aa35ffb9 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:09.090927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2f97a-c29a-46c8-93b6-6b5605410619 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AlURiBtTSWyCMkXsXfxoRA, audit_chain_id=['AlURiBtTSWyCMkXsXfxoRA']) at 0x7fe09df251c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:09.091664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2f97a-c29a-46c8-93b6-6b5605410619 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:09.091955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2f97a-c29a-46c8-93b6-6b5605410619 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:09.092243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2f97a-c29a-46c8-93b6-6b5605410619 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:09.103636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2f97a-c29a-46c8-93b6-6b5605410619 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:40:09.109959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-2ca2f97a-c29a-46c8-93b6-6b5605410619 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:40:09.111079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 533/1066] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:40:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:40:09.117653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e97735-31a5-43f6-966a-147d7c01e597 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:09.126255 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e97735-31a5-43f6-966a-147d7c01e597 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:09.131080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508197d4-46ad-4dd6-86d5-f26b0ac90ea9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AlURiBtTSWyCMkXsXfxoRA, audit_chain_id=['AlURiBtTSWyCMkXsXfxoRA']) at 0x7fe09e17f2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:09.131706 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508197d4-46ad-4dd6-86d5-f26b0ac90ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:09.131993 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508197d4-46ad-4dd6-86d5-f26b0ac90ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:09.132273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508197d4-46ad-4dd6-86d5-f26b0ac90ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:09.132978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508197d4-46ad-4dd6-86d5-f26b0ac90ea9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:40:09.133274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508197d4-46ad-4dd6-86d5-f26b0ac90ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:09.134850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508197d4-46ad-4dd6-86d5-f26b0ac90ea9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:09.143202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 534/1067] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:09.148851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2f97a-c29a-46c8-93b6-6b5605410619 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:09.158680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2f97a-c29a-46c8-93b6-6b5605410619 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:09.162957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d22f9-9433-4ee5-b9fe-78a61af94615 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AlURiBtTSWyCMkXsXfxoRA, audit_chain_id=['AlURiBtTSWyCMkXsXfxoRA']) at 0x7fe09ded1dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:09.163762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d22f9-9433-4ee5-b9fe-78a61af94615 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:09.164052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d22f9-9433-4ee5-b9fe-78a61af94615 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:09.164335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d22f9-9433-4ee5-b9fe-78a61af94615 admin admin] PATH_INFO: `/v3/users/fb7c84ee0bb84d4e9d85ce46a64f10d0` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:09.165453 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d22f9-9433-4ee5-b9fe-78a61af94615 admin admin] RBAC: Authorizing `identity:get_user(user_id=fb7c84ee0bb84d4e9d85ce46a64f10d0)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:09.167603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d22f9-9433-4ee5-b9fe-78a61af94615 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:09.169139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 534/1068] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:09 2022] GET /identity/v3/users/fb7c84ee0bb84d4e9d85ce46a64f10d0 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:09.174643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508197d4-46ad-4dd6-86d5-f26b0ac90ea9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:09.184915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508197d4-46ad-4dd6-86d5-f26b0ac90ea9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:09.189260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835813ad-54ef-4990-80fb-795c91ccef1c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AlURiBtTSWyCMkXsXfxoRA, audit_chain_id=['AlURiBtTSWyCMkXsXfxoRA']) at 0x7fe09e3f0700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:09.190033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835813ad-54ef-4990-80fb-795c91ccef1c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:09.190318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835813ad-54ef-4990-80fb-795c91ccef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:09.190598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835813ad-54ef-4990-80fb-795c91ccef1c admin admin] PATH_INFO: `/v3/projects/00b56488aed744d7b2ac4fff59ebb674` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:09.191716 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835813ad-54ef-4990-80fb-795c91ccef1c admin admin] RBAC: Authorizing `identity:get_project(project_id=00b56488aed744d7b2ac4fff59ebb674)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:09.194453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835813ad-54ef-4990-80fb-795c91ccef1c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:09.195994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 535/1069] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:09 2022] GET /identity/v3/projects/00b56488aed744d7b2ac4fff59ebb674 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:09.201600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d22f9-9433-4ee5-b9fe-78a61af94615 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:09.210834 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d22f9-9433-4ee5-b9fe-78a61af94615 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:09.215351 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf650e-5f2f-4c50-8b64-453adc46f7f2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AlURiBtTSWyCMkXsXfxoRA, audit_chain_id=['AlURiBtTSWyCMkXsXfxoRA']) at 0x7fe09e108af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:09.216146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf650e-5f2f-4c50-8b64-453adc46f7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:09.216435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf650e-5f2f-4c50-8b64-453adc46f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:09.216714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf650e-5f2f-4c50-8b64-453adc46f7f2 admin admin] PATH_INFO: `/v3/projects/00b56488aed744d7b2ac4fff59ebb674/users/fb7c84ee0bb84d4e9d85ce46a64f10d0/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:09.218614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf650e-5f2f-4c50-8b64-453adc46f7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b56488aed744d7b2ac4fff59ebb674, user_id=fb7c84ee0bb84d4e9d85ce46a64f10d0, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:09.221258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf650e-5f2f-4c50-8b64-453adc46f7f2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:09.290165 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 535/1070] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:40:09 2022] PUT /identity/v3/projects/00b56488aed744d7b2ac4fff59ebb674/users/fb7c84ee0bb84d4e9d85ce46a64f10d0/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:40:11.375795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d6463-5c5b-4d71-ab00-66f7556b49ec None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:11.376301 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d6463-5c5b-4d71-ab00-66f7556b49ec None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:11.376301 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d6463-5c5b-4d71-ab00-66f7556b49ec None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:11.377974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 536/1071] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:11.383937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf53146-ea1c-4fb8-838a-9101e2ed66fd None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:11.384354 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf53146-ea1c-4fb8-838a-9101e2ed66fd None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:11.384501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf53146-ea1c-4fb8-838a-9101e2ed66fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:11.406054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-9cf53146-ea1c-4fb8-838a-9101e2ed66fd None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:11.407223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9cf53146-ea1c-4fb8-838a-9101e2ed66fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:11.471677 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 536/1072] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:11 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:11.495146 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d6463-5c5b-4d71-ab00-66f7556b49ec None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:11.507676 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d6463-5c5b-4d71-ab00-66f7556b49ec None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:11.511792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4aba5-2569-4e00-86d7-6415161573fd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE8MuU_tRjiBBreo90q7xw, audit_chain_id=['wE8MuU_tRjiBBreo90q7xw']) at 0x7fe09e1983d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:11.512502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4aba5-2569-4e00-86d7-6415161573fd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:11.512790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4aba5-2569-4e00-86d7-6415161573fd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:11.513074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4aba5-2569-4e00-86d7-6415161573fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:11.524624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4aba5-2569-4e00-86d7-6415161573fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:40:11.530874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-6bf4aba5-2569-4e00-86d7-6415161573fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:40:11.531997 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 537/1073] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:40:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:40:11.538691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf53146-ea1c-4fb8-838a-9101e2ed66fd None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:11.547407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf53146-ea1c-4fb8-838a-9101e2ed66fd None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:11.552406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9797dbe-78cf-4599-b1ec-dc3cc77de255 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE8MuU_tRjiBBreo90q7xw, audit_chain_id=['wE8MuU_tRjiBBreo90q7xw']) at 0x7fe09e1061f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:11.553018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9797dbe-78cf-4599-b1ec-dc3cc77de255 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:11.553361 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9797dbe-78cf-4599-b1ec-dc3cc77de255 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:11.553644 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9797dbe-78cf-4599-b1ec-dc3cc77de255 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:11.554348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9797dbe-78cf-4599-b1ec-dc3cc77de255 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:40:11.554644 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9797dbe-78cf-4599-b1ec-dc3cc77de255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:11.556236 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9797dbe-78cf-4599-b1ec-dc3cc77de255 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:11.564723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 537/1074] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:40:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:11.571014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4aba5-2569-4e00-86d7-6415161573fd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:11.580444 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4aba5-2569-4e00-86d7-6415161573fd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:11.586002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7abbf-eb2d-4f6f-be2d-fadfb0388bed admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE8MuU_tRjiBBreo90q7xw, audit_chain_id=['wE8MuU_tRjiBBreo90q7xw']) at 0x7fe09e159610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:11.586793 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7abbf-eb2d-4f6f-be2d-fadfb0388bed admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:11.587082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7abbf-eb2d-4f6f-be2d-fadfb0388bed admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:11.587643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7abbf-eb2d-4f6f-be2d-fadfb0388bed admin admin] PATH_INFO: `/v3/users/fb7c84ee0bb84d4e9d85ce46a64f10d0` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:11.588741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7abbf-eb2d-4f6f-be2d-fadfb0388bed admin admin] RBAC: Authorizing `identity:get_user(user_id=fb7c84ee0bb84d4e9d85ce46a64f10d0)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:11.590839 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7abbf-eb2d-4f6f-be2d-fadfb0388bed admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:11.592327 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 538/1075] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:11 2022] GET /identity/v3/users/fb7c84ee0bb84d4e9d85ce46a64f10d0 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:11.597874 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9797dbe-78cf-4599-b1ec-dc3cc77de255 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:11.607782 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9797dbe-78cf-4599-b1ec-dc3cc77de255 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:11.612015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54f43f-42cd-44de-b8df-8c33c65eab58 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE8MuU_tRjiBBreo90q7xw, audit_chain_id=['wE8MuU_tRjiBBreo90q7xw']) at 0x7fe09e1837c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:11.612584 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54f43f-42cd-44de-b8df-8c33c65eab58 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:11.612875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54f43f-42cd-44de-b8df-8c33c65eab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:11.613157 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54f43f-42cd-44de-b8df-8c33c65eab58 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:11.621446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54f43f-42cd-44de-b8df-8c33c65eab58 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:11.623269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54f43f-42cd-44de-b8df-8c33c65eab58 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:11.631883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 538/1076] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:40:11 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:40:11.637712 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7abbf-eb2d-4f6f-be2d-fadfb0388bed admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:11.647311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7abbf-eb2d-4f6f-be2d-fadfb0388bed admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:11.651592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf7144-65fc-46f8-9984-9c143ad4e1e9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE8MuU_tRjiBBreo90q7xw, audit_chain_id=['wE8MuU_tRjiBBreo90q7xw']) at 0x7fe09e1598e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:11.652355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7144-65fc-46f8-9984-9c143ad4e1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:11.652641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7144-65fc-46f8-9984-9c143ad4e1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:11.652921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7144-65fc-46f8-9984-9c143ad4e1e9 admin admin] PATH_INFO: `/v3/projects/00b56488aed744d7b2ac4fff59ebb674` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:11.653999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf7144-65fc-46f8-9984-9c143ad4e1e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=00b56488aed744d7b2ac4fff59ebb674)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:11.656047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf7144-65fc-46f8-9984-9c143ad4e1e9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:11.657549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 539/1077] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:11 2022] GET /identity/v3/projects/00b56488aed744d7b2ac4fff59ebb674 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:11.664375 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54f43f-42cd-44de-b8df-8c33c65eab58 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:11.672837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54f43f-42cd-44de-b8df-8c33c65eab58 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:11.677957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237342fb-06be-4bff-a21a-0c5eb69dfed8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE8MuU_tRjiBBreo90q7xw, audit_chain_id=['wE8MuU_tRjiBBreo90q7xw']) at 0x7fe09e108ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:11.678530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237342fb-06be-4bff-a21a-0c5eb69dfed8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:11.678821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237342fb-06be-4bff-a21a-0c5eb69dfed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:11.679101 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237342fb-06be-4bff-a21a-0c5eb69dfed8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:11.679891 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237342fb-06be-4bff-a21a-0c5eb69dfed8 admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=00b56488aed744d7b2ac4fff59ebb674, user.id=fb7c84ee0bb84d4e9d85ce46a64f10d0) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:40:11.680196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237342fb-06be-4bff-a21a-0c5eb69dfed8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:11.682045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237342fb-06be-4bff-a21a-0c5eb69dfed8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:11.687664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 539/1078] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:40:11 2022] GET /identity/v3/role_assignments?user.id=fb7c84ee0bb84d4e9d85ce46a64f10d0&scope.project.id=00b56488aed744d7b2ac4fff59ebb674&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:13.821035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55c5ad-21db-4775-8da2-550097fca005 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:13.821577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55c5ad-21db-4775-8da2-550097fca005 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:13.821577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55c5ad-21db-4775-8da2-550097fca005 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:13.823353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 540/1079] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:13.828537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc185018-709c-43c0-a020-f06fd6eafbf0 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:13.828918 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc185018-709c-43c0-a020-f06fd6eafbf0 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:13.829105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc185018-709c-43c0-a020-f06fd6eafbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:13.851580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-cc185018-709c-43c0-a020-f06fd6eafbf0 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:13.852720 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-cc185018-709c-43c0-a020-f06fd6eafbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:13.859765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 540/1080] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:13 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:13.882982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55c5ad-21db-4775-8da2-550097fca005 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:13.894796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55c5ad-21db-4775-8da2-550097fca005 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:13.899800 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072863d-c055-4ffd-a33b-bc82fda4f8d4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sBTI6Hl1RweEyElePtWxxw, audit_chain_id=['sBTI6Hl1RweEyElePtWxxw']) at 0x7fe09e3e06d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:13.900369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072863d-c055-4ffd-a33b-bc82fda4f8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:13.900656 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072863d-c055-4ffd-a33b-bc82fda4f8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:13.900935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072863d-c055-4ffd-a33b-bc82fda4f8d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:13.908552 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072863d-c055-4ffd-a33b-bc82fda4f8d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:13.910277 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072863d-c055-4ffd-a33b-bc82fda4f8d4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:13.919793 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 541/1081] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:40:13 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:40:13.925740 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc185018-709c-43c0-a020-f06fd6eafbf0 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:13.934904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc185018-709c-43c0-a020-f06fd6eafbf0 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:13.941168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815d25f-ff51-4e45-bc0b-a9d7e6efbb90 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sBTI6Hl1RweEyElePtWxxw, audit_chain_id=['sBTI6Hl1RweEyElePtWxxw']) at 0x7fe09dec3cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:13.941903 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815d25f-ff51-4e45-bc0b-a9d7e6efbb90 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:13.942305 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815d25f-ff51-4e45-bc0b-a9d7e6efbb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:13.942586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815d25f-ff51-4e45-bc0b-a9d7e6efbb90 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:13.950612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815d25f-ff51-4e45-bc0b-a9d7e6efbb90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:13.952567 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815d25f-ff51-4e45-bc0b-a9d7e6efbb90 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:13.968086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-8815d25f-ff51-4e45-bc0b-a9d7e6efbb90 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 28 18:40:13.969202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 541/1082] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Feb 28 18:40:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:40:13.976617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072863d-c055-4ffd-a33b-bc82fda4f8d4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:13.985495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072863d-c055-4ffd-a33b-bc82fda4f8d4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:13.993340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338a775-df18-45b1-966a-94e92a9148ed admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sBTI6Hl1RweEyElePtWxxw, audit_chain_id=['sBTI6Hl1RweEyElePtWxxw']) at 0x7fe09e1598e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:13.993936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338a775-df18-45b1-966a-94e92a9148ed admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:13.994257 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338a775-df18-45b1-966a-94e92a9148ed admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:13.994542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338a775-df18-45b1-966a-94e92a9148ed admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:13.995271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338a775-df18-45b1-966a-94e92a9148ed admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:40:13.995576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338a775-df18-45b1-966a-94e92a9148ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:13.997170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338a775-df18-45b1-966a-94e92a9148ed admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:14.006907 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 542/1083] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Feb 28 18:40:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:16.096981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5709d-86e1-4110-9e35-3acbfdbdcd2c None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:16.097549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5709d-86e1-4110-9e35-3acbfdbdcd2c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:16.097549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5709d-86e1-4110-9e35-3acbfdbdcd2c None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:16.099928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 542/1084] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:16.105136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74271dc5-122e-497f-8dd0-e4c36b260516 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:16.105544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74271dc5-122e-497f-8dd0-e4c36b260516 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:16.105750 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74271dc5-122e-497f-8dd0-e4c36b260516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:16.127695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-74271dc5-122e-497f-8dd0-e4c36b260516 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:16.128832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-74271dc5-122e-497f-8dd0-e4c36b260516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:16.136552 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 543/1085] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:16 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:40:16.160137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5709d-86e1-4110-9e35-3acbfdbdcd2c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:16.171880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5709d-86e1-4110-9e35-3acbfdbdcd2c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:16.175999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf474d5-ca86-4d67-98c8-80f55bf24c9f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EtKBIq2MQ9i6X23ihSlmKA, audit_chain_id=['EtKBIq2MQ9i6X23ihSlmKA']) at 0x7fe09e14a370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:16.176639 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf474d5-ca86-4d67-98c8-80f55bf24c9f admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:16.176925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf474d5-ca86-4d67-98c8-80f55bf24c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:16.177207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf474d5-ca86-4d67-98c8-80f55bf24c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:16.177906 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf474d5-ca86-4d67-98c8-80f55bf24c9f admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:16.178905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-daf474d5-ca86-4d67-98c8-80f55bf24c9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:40:16.178905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:40:16.178905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:40:16.179871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf474d5-ca86-4d67-98c8-80f55bf24c9f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:16.285597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 543/1086] 10.222.0.21 () {60 vars in 1159 bytes} [Mon Feb 28 18:40:16 2022] POST /identity/v3/domains => generated 267 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:40:18.438613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c531f-e6d0-4e1c-bd2a-9063f333874e None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:18.439206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c531f-e6d0-4e1c-bd2a-9063f333874e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:18.439300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c531f-e6d0-4e1c-bd2a-9063f333874e None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:18.440939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 544/1087] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:18.446429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9257778-d8a4-468b-a880-474b4582b811 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:18.446856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9257778-d8a4-468b-a880-474b4582b811 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:18.446992 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9257778-d8a4-468b-a880-474b4582b811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:18.469155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-c9257778-d8a4-468b-a880-474b4582b811 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:18.470285 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c9257778-d8a4-468b-a880-474b4582b811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:18.542399 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 544/1088] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:18 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:18.566138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c531f-e6d0-4e1c-bd2a-9063f333874e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:18.578219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c531f-e6d0-4e1c-bd2a-9063f333874e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:18.582281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dd069-d1a1-461b-85bf-0b45ec7ccf75 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Y99xB96lSzeuFlnvRvE32Q, audit_chain_id=['Y99xB96lSzeuFlnvRvE32Q']) at 0x7fe09e1b0580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:18.583196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd069-d1a1-461b-85bf-0b45ec7ccf75 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:18.583402 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd069-d1a1-461b-85bf-0b45ec7ccf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:18.583684 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd069-d1a1-461b-85bf-0b45ec7ccf75 admin admin] PATH_INFO: `/v3/domains/a41f54a0abd04405af686afcedbc3d65` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:18.595934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dd069-d1a1-461b-85bf-0b45ec7ccf75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a41f54a0abd04405af686afcedbc3d65)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:18.597960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dd069-d1a1-461b-85bf-0b45ec7ccf75 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:18.600077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 545/1089] 10.222.0.21 () {56 vars in 1204 bytes} [Mon Feb 28 18:40:18 2022] GET /identity/v3/domains/a41f54a0abd04405af686afcedbc3d65 => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:18.606190 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9257778-d8a4-468b-a880-474b4582b811 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:18.615672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9257778-d8a4-468b-a880-474b4582b811 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:18.619872 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8058a25-7859-4ebf-874f-75ac7e3c6bd7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Y99xB96lSzeuFlnvRvE32Q, audit_chain_id=['Y99xB96lSzeuFlnvRvE32Q']) at 0x7fe09eacf9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:18.620455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8058a25-7859-4ebf-874f-75ac7e3c6bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:18.620744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8058a25-7859-4ebf-874f-75ac7e3c6bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:18.621025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8058a25-7859-4ebf-874f-75ac7e3c6bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:18.621669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8058a25-7859-4ebf-874f-75ac7e3c6bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:18.623571 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8058a25-7859-4ebf-874f-75ac7e3c6bd7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:18.759513 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 545/1090] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:40:18 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:40:20.925560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b254b9-004c-4c4e-9d4b-2681894ffd1c None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:20.926086 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b254b9-004c-4c4e-9d4b-2681894ffd1c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:20.926173 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b254b9-004c-4c4e-9d4b-2681894ffd1c None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:20.928670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 546/1091] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:20.935650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57bb2a-641d-4c47-b82b-f4040ce7cf00 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:20.936096 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57bb2a-641d-4c47-b82b-f4040ce7cf00 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:20.936354 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57bb2a-641d-4c47-b82b-f4040ce7cf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:20.959997 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-9b57bb2a-641d-4c47-b82b-f4040ce7cf00 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:20.961167 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9b57bb2a-641d-4c47-b82b-f4040ce7cf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:21.027867 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 546/1092] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:20 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:21.053339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b254b9-004c-4c4e-9d4b-2681894ffd1c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:21.065213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b254b9-004c-4c4e-9d4b-2681894ffd1c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:21.069539 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107da139-3ebf-4e97-81c0-1ebd203bb19b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jdMUblyrTw6MvvXgIpLHOg, audit_chain_id=['jdMUblyrTw6MvvXgIpLHOg']) at 0x7fe09e1625b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:21.070355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da139-3ebf-4e97-81c0-1ebd203bb19b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:21.070594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da139-3ebf-4e97-81c0-1ebd203bb19b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:21.070869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da139-3ebf-4e97-81c0-1ebd203bb19b admin admin] PATH_INFO: `/v3/domains/a41f54a0abd04405af686afcedbc3d65` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:21.071976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107da139-3ebf-4e97-81c0-1ebd203bb19b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a41f54a0abd04405af686afcedbc3d65)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:21.073891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107da139-3ebf-4e97-81c0-1ebd203bb19b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:21.075357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 547/1093] 10.222.0.21 () {56 vars in 1204 bytes} [Mon Feb 28 18:40:21 2022] GET /identity/v3/domains/a41f54a0abd04405af686afcedbc3d65 => generated 267 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:21.081072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57bb2a-641d-4c47-b82b-f4040ce7cf00 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:21.090429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57bb2a-641d-4c47-b82b-f4040ce7cf00 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:21.094739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37261647-25d2-456f-83dc-3cedc5f81658 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jdMUblyrTw6MvvXgIpLHOg, audit_chain_id=['jdMUblyrTw6MvvXgIpLHOg']) at 0x7fe09e1a1520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:21.095363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37261647-25d2-456f-83dc-3cedc5f81658 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:21.095652 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37261647-25d2-456f-83dc-3cedc5f81658 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:21.095930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37261647-25d2-456f-83dc-3cedc5f81658 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:21.096578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37261647-25d2-456f-83dc-3cedc5f81658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:21.099195 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37261647-25d2-456f-83dc-3cedc5f81658 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:21.186959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 547/1094] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:40:21 2022] POST /identity/v3/users => generated 311 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:40:23.338639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f0a4-f6a0-46bb-96d0-04244a345105 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:23.339168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f0a4-f6a0-46bb-96d0-04244a345105 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:23.339168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f0a4-f6a0-46bb-96d0-04244a345105 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:23.340850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 548/1095] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:23.346099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aab8e0-63ca-499f-b743-29a6b11cc0be None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:23.346531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aab8e0-63ca-499f-b743-29a6b11cc0be None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:23.346667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aab8e0-63ca-499f-b743-29a6b11cc0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:23.368976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-c7aab8e0-63ca-499f-b743-29a6b11cc0be None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:23.370147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c7aab8e0-63ca-499f-b743-29a6b11cc0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:23.377147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 548/1096] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:23 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:23.401618 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2f0a4-f6a0-46bb-96d0-04244a345105 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:23.414289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2f0a4-f6a0-46bb-96d0-04244a345105 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:23.418489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41001d-78d4-4b6e-b203-5507a8192fd2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v9EyAUJRRXaAB5-uLP-L-A, audit_chain_id=['v9EyAUJRRXaAB5-uLP-L-A']) at 0x7fe09e3c4940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:23.419233 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41001d-78d4-4b6e-b203-5507a8192fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:23.419526 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41001d-78d4-4b6e-b203-5507a8192fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:23.419811 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41001d-78d4-4b6e-b203-5507a8192fd2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:23.433099 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41001d-78d4-4b6e-b203-5507a8192fd2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:40:23.439503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-7f41001d-78d4-4b6e-b203-5507a8192fd2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:40:23.440588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 549/1097] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:40:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:40:23.447416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aab8e0-63ca-499f-b743-29a6b11cc0be None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:23.455969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aab8e0-63ca-499f-b743-29a6b11cc0be None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:23.460301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f7356-1df9-41b2-b7b6-536f1e6ae7ae admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v9EyAUJRRXaAB5-uLP-L-A, audit_chain_id=['v9EyAUJRRXaAB5-uLP-L-A']) at 0x7fe09e155070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:23.460890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f7356-1df9-41b2-b7b6-536f1e6ae7ae admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:23.461182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f7356-1df9-41b2-b7b6-536f1e6ae7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:23.461467 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f7356-1df9-41b2-b7b6-536f1e6ae7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:23.462430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f7356-1df9-41b2-b7b6-536f1e6ae7ae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:40:23.462730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f7356-1df9-41b2-b7b6-536f1e6ae7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:23.464349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f7356-1df9-41b2-b7b6-536f1e6ae7ae admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:23.472668 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 549/1098] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:40:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:23.478315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41001d-78d4-4b6e-b203-5507a8192fd2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:23.488117 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41001d-78d4-4b6e-b203-5507a8192fd2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:23.493142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b823c-536d-4382-a749-ae629de82f02 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v9EyAUJRRXaAB5-uLP-L-A, audit_chain_id=['v9EyAUJRRXaAB5-uLP-L-A']) at 0x7fe09e1ccf10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:23.493921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b823c-536d-4382-a749-ae629de82f02 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:23.494211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b823c-536d-4382-a749-ae629de82f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:23.494494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b823c-536d-4382-a749-ae629de82f02 admin admin] PATH_INFO: `/v3/users/c212e52c7aa24814918691132aeb64af` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:23.513174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b823c-536d-4382-a749-ae629de82f02 admin admin] RBAC: Authorizing `identity:get_user(user_id=c212e52c7aa24814918691132aeb64af)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:23.515308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b823c-536d-4382-a749-ae629de82f02 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:23.516774 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 550/1099] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:23 2022] GET /identity/v3/users/c212e52c7aa24814918691132aeb64af => generated 311 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:23.522482 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f7356-1df9-41b2-b7b6-536f1e6ae7ae admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:23.531702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f7356-1df9-41b2-b7b6-536f1e6ae7ae admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:23.536025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c170f6-c3a1-46cc-89b6-03b6166e6d06 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v9EyAUJRRXaAB5-uLP-L-A, audit_chain_id=['v9EyAUJRRXaAB5-uLP-L-A']) at 0x7fe09df3b7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:23.536596 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c170f6-c3a1-46cc-89b6-03b6166e6d06 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:23.536889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c170f6-c3a1-46cc-89b6-03b6166e6d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:23.537174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c170f6-c3a1-46cc-89b6-03b6166e6d06 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:23.544764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c170f6-c3a1-46cc-89b6-03b6166e6d06 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:23.546487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c170f6-c3a1-46cc-89b6-03b6166e6d06 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:23.555517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 550/1100] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:40:23 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:40:23.561074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b823c-536d-4382-a749-ae629de82f02 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:23.570403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b823c-536d-4382-a749-ae629de82f02 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:23.574601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20f9db-be98-4eda-9411-5b90ef3b0660 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v9EyAUJRRXaAB5-uLP-L-A, audit_chain_id=['v9EyAUJRRXaAB5-uLP-L-A']) at 0x7fe09e1b0490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:23.582967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f9db-be98-4eda-9411-5b90ef3b0660 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:23.582967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f9db-be98-4eda-9411-5b90ef3b0660 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:23.582967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f9db-be98-4eda-9411-5b90ef3b0660 admin admin] PATH_INFO: `/v3/projects/a3015b5ef9e64185ad329e29c6fb9132` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:23.582967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20f9db-be98-4eda-9411-5b90ef3b0660 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3015b5ef9e64185ad329e29c6fb9132)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:23.582967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20f9db-be98-4eda-9411-5b90ef3b0660 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:23.582967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 551/1101] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:23 2022] GET /identity/v3/projects/a3015b5ef9e64185ad329e29c6fb9132 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:23.586776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c170f6-c3a1-46cc-89b6-03b6166e6d06 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:23.595515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c170f6-c3a1-46cc-89b6-03b6166e6d06 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:23.601046 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539c6d-2c8e-4887-b074-40087464b08c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v9EyAUJRRXaAB5-uLP-L-A, audit_chain_id=['v9EyAUJRRXaAB5-uLP-L-A']) at 0x7fe09e4f3b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:23.601624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539c6d-2c8e-4887-b074-40087464b08c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:23.601919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539c6d-2c8e-4887-b074-40087464b08c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:23.602207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539c6d-2c8e-4887-b074-40087464b08c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:23.603008 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539c6d-2c8e-4887-b074-40087464b08c admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=a3015b5ef9e64185ad329e29c6fb9132, user.id=c212e52c7aa24814918691132aeb64af) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:40:23.603348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539c6d-2c8e-4887-b074-40087464b08c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:23.605156 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539c6d-2c8e-4887-b074-40087464b08c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:23.610655 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 551/1102] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:40:23 2022] GET /identity/v3/role_assignments?user.id=c212e52c7aa24814918691132aeb64af&scope.project.id=a3015b5ef9e64185ad329e29c6fb9132&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:40:25.702768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71995-3242-4396-a88e-e0dece2b30bf None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:25.703325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71995-3242-4396-a88e-e0dece2b30bf None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:25.703441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71995-3242-4396-a88e-e0dece2b30bf None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:25.705047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 552/1103] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:25.710773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569c12f-6197-4ec1-ae2f-9c239bda1b17 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:25.711240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569c12f-6197-4ec1-ae2f-9c239bda1b17 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:25.711379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569c12f-6197-4ec1-ae2f-9c239bda1b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:25.735165 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-b569c12f-6197-4ec1-ae2f-9c239bda1b17 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:25.736311 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b569c12f-6197-4ec1-ae2f-9c239bda1b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:25.743382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 552/1104] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:25 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:25.765920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e71995-3242-4396-a88e-e0dece2b30bf None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:25.778941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e71995-3242-4396-a88e-e0dece2b30bf None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:25.783279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2e4b2-b5ec-48c3-b320-ebfdcac0125b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2OGz-gxXRPW1oAr9ej91Lg, audit_chain_id=['2OGz-gxXRPW1oAr9ej91Lg']) at 0x7fe09e1b0d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:25.784002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2e4b2-b5ec-48c3-b320-ebfdcac0125b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:25.784293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2e4b2-b5ec-48c3-b320-ebfdcac0125b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:25.784577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2e4b2-b5ec-48c3-b320-ebfdcac0125b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:25.796895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2e4b2-b5ec-48c3-b320-ebfdcac0125b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:40:25.803710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-d0f2e4b2-b5ec-48c3-b320-ebfdcac0125b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:40:25.804818 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 553/1105] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:40:25.811000 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569c12f-6197-4ec1-ae2f-9c239bda1b17 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:25.820286 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569c12f-6197-4ec1-ae2f-9c239bda1b17 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:25.824589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802c552-1e0f-4606-b117-65da33bbd4c2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2OGz-gxXRPW1oAr9ej91Lg, audit_chain_id=['2OGz-gxXRPW1oAr9ej91Lg']) at 0x7fe09e15eeb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:25.825178 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802c552-1e0f-4606-b117-65da33bbd4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:25.825466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802c552-1e0f-4606-b117-65da33bbd4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:25.825747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802c552-1e0f-4606-b117-65da33bbd4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:25.826455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802c552-1e0f-4606-b117-65da33bbd4c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:40:25.826752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802c552-1e0f-4606-b117-65da33bbd4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:25.828506 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802c552-1e0f-4606-b117-65da33bbd4c2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:25.838058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 553/1106] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:25.843858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2e4b2-b5ec-48c3-b320-ebfdcac0125b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:25.854518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2e4b2-b5ec-48c3-b320-ebfdcac0125b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:25.858926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205f90f-7d12-4ef4-a458-a2003a5743e0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2OGz-gxXRPW1oAr9ej91Lg, audit_chain_id=['2OGz-gxXRPW1oAr9ej91Lg']) at 0x7fe09df0bb50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:25.859715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f90f-7d12-4ef4-a458-a2003a5743e0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:25.860003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f90f-7d12-4ef4-a458-a2003a5743e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:25.860291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f90f-7d12-4ef4-a458-a2003a5743e0 admin admin] PATH_INFO: `/v3/users/c212e52c7aa24814918691132aeb64af` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:25.861379 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205f90f-7d12-4ef4-a458-a2003a5743e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=c212e52c7aa24814918691132aeb64af)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:25.863557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205f90f-7d12-4ef4-a458-a2003a5743e0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:25.865094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 554/1107] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:25 2022] GET /identity/v3/users/c212e52c7aa24814918691132aeb64af => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:25.870589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802c552-1e0f-4606-b117-65da33bbd4c2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:25.880278 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802c552-1e0f-4606-b117-65da33bbd4c2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:25.884498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6563dd-b49a-40f2-8230-592657730e01 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2OGz-gxXRPW1oAr9ej91Lg, audit_chain_id=['2OGz-gxXRPW1oAr9ej91Lg']) at 0x7fe09e4f3ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:25.885268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6563dd-b49a-40f2-8230-592657730e01 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:25.885555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6563dd-b49a-40f2-8230-592657730e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:25.885836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6563dd-b49a-40f2-8230-592657730e01 admin admin] PATH_INFO: `/v3/projects/a3015b5ef9e64185ad329e29c6fb9132` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:25.886901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6563dd-b49a-40f2-8230-592657730e01 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3015b5ef9e64185ad329e29c6fb9132)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:25.889037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6563dd-b49a-40f2-8230-592657730e01 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:25.890521 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 554/1108] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:25 2022] GET /identity/v3/projects/a3015b5ef9e64185ad329e29c6fb9132 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:25.896756 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205f90f-7d12-4ef4-a458-a2003a5743e0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:25.906012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205f90f-7d12-4ef4-a458-a2003a5743e0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:25.910273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb49743-2cc7-41ee-8d45-012ff09ea43c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2OGz-gxXRPW1oAr9ej91Lg, audit_chain_id=['2OGz-gxXRPW1oAr9ej91Lg']) at 0x7fe09df0bc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:25.911333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb49743-2cc7-41ee-8d45-012ff09ea43c admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:25.911612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb49743-2cc7-41ee-8d45-012ff09ea43c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:25.911893 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb49743-2cc7-41ee-8d45-012ff09ea43c admin admin] PATH_INFO: `/v3/projects/a3015b5ef9e64185ad329e29c6fb9132/users/c212e52c7aa24814918691132aeb64af/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:25.913664 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb49743-2cc7-41ee-8d45-012ff09ea43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3015b5ef9e64185ad329e29c6fb9132, user_id=c212e52c7aa24814918691132aeb64af, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:25.916284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb49743-2cc7-41ee-8d45-012ff09ea43c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:26.027804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 555/1109] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:40:25 2022] PUT /identity/v3/projects/a3015b5ef9e64185ad329e29c6fb9132/users/c212e52c7aa24814918691132aeb64af/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:40:28.117173 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318465-60cb-4c15-8950-0d3869f80543 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:28.117731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318465-60cb-4c15-8950-0d3869f80543 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:28.117731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318465-60cb-4c15-8950-0d3869f80543 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:28.119572 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 555/1110] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:28.124696 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6762718-4e59-4bfe-a649-da7df3b90b2c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:28.125122 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6762718-4e59-4bfe-a649-da7df3b90b2c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:28.125266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6762718-4e59-4bfe-a649-da7df3b90b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:28.147957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b6762718-4e59-4bfe-a649-da7df3b90b2c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:28.149084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b6762718-4e59-4bfe-a649-da7df3b90b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:28.214572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 556/1111] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:28 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:28.237741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3318465-60cb-4c15-8950-0d3869f80543 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:28.249606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3318465-60cb-4c15-8950-0d3869f80543 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:28.253672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c4615-3876-4ddc-819f-3fa59b7a2844 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iKs29viTTXCpiHjGKXYovw, audit_chain_id=['iKs29viTTXCpiHjGKXYovw']) at 0x7fe09e15e4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:28.255078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c4615-3876-4ddc-819f-3fa59b7a2844 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:28.255401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c4615-3876-4ddc-819f-3fa59b7a2844 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:28.255680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c4615-3876-4ddc-819f-3fa59b7a2844 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:28.266746 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c4615-3876-4ddc-819f-3fa59b7a2844 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:40:28.273713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-d72c4615-3876-4ddc-819f-3fa59b7a2844 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:40:28.274774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 556/1112] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:40:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:40:28.281045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6762718-4e59-4bfe-a649-da7df3b90b2c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:28.291708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6762718-4e59-4bfe-a649-da7df3b90b2c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:28.295927 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f97b6a-7120-4e4e-8c59-44ac7fe13745 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iKs29viTTXCpiHjGKXYovw, audit_chain_id=['iKs29viTTXCpiHjGKXYovw']) at 0x7fe09e795130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:28.296512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f97b6a-7120-4e4e-8c59-44ac7fe13745 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:28.296796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f97b6a-7120-4e4e-8c59-44ac7fe13745 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:28.297074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f97b6a-7120-4e4e-8c59-44ac7fe13745 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:28.297780 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f97b6a-7120-4e4e-8c59-44ac7fe13745 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:40:28.298075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f97b6a-7120-4e4e-8c59-44ac7fe13745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:28.299691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f97b6a-7120-4e4e-8c59-44ac7fe13745 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:28.308071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 557/1113] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:40:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:28.313689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c4615-3876-4ddc-819f-3fa59b7a2844 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:28.323429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c4615-3876-4ddc-819f-3fa59b7a2844 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:28.327629 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3acfc-4656-4902-997c-3a2667cf24be admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iKs29viTTXCpiHjGKXYovw, audit_chain_id=['iKs29viTTXCpiHjGKXYovw']) at 0x7fe09e15eeb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:28.328406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3acfc-4656-4902-997c-3a2667cf24be admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:28.328695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3acfc-4656-4902-997c-3a2667cf24be admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:28.328978 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3acfc-4656-4902-997c-3a2667cf24be admin admin] PATH_INFO: `/v3/users/c212e52c7aa24814918691132aeb64af` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:28.330097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3acfc-4656-4902-997c-3a2667cf24be admin admin] RBAC: Authorizing `identity:get_user(user_id=c212e52c7aa24814918691132aeb64af)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:28.332900 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3acfc-4656-4902-997c-3a2667cf24be admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:28.334352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 557/1114] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:28 2022] GET /identity/v3/users/c212e52c7aa24814918691132aeb64af => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:28.339837 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f97b6a-7120-4e4e-8c59-44ac7fe13745 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:28.348981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f97b6a-7120-4e4e-8c59-44ac7fe13745 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:28.353133 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b327cf-fa51-4bd6-97ac-7e576eb567c9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iKs29viTTXCpiHjGKXYovw, audit_chain_id=['iKs29viTTXCpiHjGKXYovw']) at 0x7fe09e16e700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:28.353687 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b327cf-fa51-4bd6-97ac-7e576eb567c9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:28.353970 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b327cf-fa51-4bd6-97ac-7e576eb567c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:28.354245 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b327cf-fa51-4bd6-97ac-7e576eb567c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:28.361753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b327cf-fa51-4bd6-97ac-7e576eb567c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:28.363674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b327cf-fa51-4bd6-97ac-7e576eb567c9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:28.371981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 558/1115] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:40:28 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:40:28.377357 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3acfc-4656-4902-997c-3a2667cf24be admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:28.386865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3acfc-4656-4902-997c-3a2667cf24be admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:28.391045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42bbff-63a6-4d2b-a1de-ffbd309d0517 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iKs29viTTXCpiHjGKXYovw, audit_chain_id=['iKs29viTTXCpiHjGKXYovw']) at 0x7fe09df39220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:28.391821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42bbff-63a6-4d2b-a1de-ffbd309d0517 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:28.392111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42bbff-63a6-4d2b-a1de-ffbd309d0517 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:28.392395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42bbff-63a6-4d2b-a1de-ffbd309d0517 admin admin] PATH_INFO: `/v3/projects/a3015b5ef9e64185ad329e29c6fb9132` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:28.393461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42bbff-63a6-4d2b-a1de-ffbd309d0517 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3015b5ef9e64185ad329e29c6fb9132)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:28.396085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42bbff-63a6-4d2b-a1de-ffbd309d0517 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:28.397605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 558/1116] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:28 2022] GET /identity/v3/projects/a3015b5ef9e64185ad329e29c6fb9132 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:28.403369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b327cf-fa51-4bd6-97ac-7e576eb567c9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:28.411952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b327cf-fa51-4bd6-97ac-7e576eb567c9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:28.416233 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299f646-e24a-45a5-a203-6f1e5e50a446 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iKs29viTTXCpiHjGKXYovw, audit_chain_id=['iKs29viTTXCpiHjGKXYovw']) at 0x7fe09e1b8ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:28.416802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f646-e24a-45a5-a203-6f1e5e50a446 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:28.417088 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f646-e24a-45a5-a203-6f1e5e50a446 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:28.417370 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f646-e24a-45a5-a203-6f1e5e50a446 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:28.418141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299f646-e24a-45a5-a203-6f1e5e50a446 admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=a3015b5ef9e64185ad329e29c6fb9132, user.id=c212e52c7aa24814918691132aeb64af) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:40:28.418445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299f646-e24a-45a5-a203-6f1e5e50a446 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:28.420299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299f646-e24a-45a5-a203-6f1e5e50a446 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:40:28.426061 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 559/1117] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:40:28 2022] GET /identity/v3/role_assignments?user.id=c212e52c7aa24814918691132aeb64af&scope.project.id=a3015b5ef9e64185ad329e29c6fb9132&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:04.769288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff9150-c1f0-4abf-b734-ce18a9a390bb None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:04.769884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff9150-c1f0-4abf-b734-ce18a9a390bb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:04.769884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff9150-c1f0-4abf-b734-ce18a9a390bb None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:04.771551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 559/1118] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:04.776705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c31155-d4c1-472b-b59e-97af29ace3c5 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:04.777123 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c31155-d4c1-472b-b59e-97af29ace3c5 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:04.777271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c31155-d4c1-472b-b59e-97af29ace3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:04.863311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c1c31155-d4c1-472b-b59e-97af29ace3c5 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:04.864466 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c1c31155-d4c1-472b-b59e-97af29ace3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:04.907658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 560/1119] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:47:04 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:04.933518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff9150-c1f0-4abf-b734-ce18a9a390bb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:04.945154 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff9150-c1f0-4abf-b734-ce18a9a390bb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:04.949208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0675049-713c-467e-aa4a-d22031acaf84 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CZXDtdO6R0Stu3vnLR88sA, audit_chain_id=['CZXDtdO6R0Stu3vnLR88sA']) at 0x7fe09df39c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:04.950163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675049-713c-467e-aa4a-d22031acaf84 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:04.950451 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675049-713c-467e-aa4a-d22031acaf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:04.950728 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0675049-713c-467e-aa4a-d22031acaf84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:04.962744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0675049-713c-467e-aa4a-d22031acaf84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:04.964572 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0675049-713c-467e-aa4a-d22031acaf84 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:04.981343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-f0675049-713c-467e-aa4a-d22031acaf84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:04.982432 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 560/1120] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:04.989275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c31155-d4c1-472b-b59e-97af29ace3c5 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:04.998623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c31155-d4c1-472b-b59e-97af29ace3c5 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:05.002892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7159a70-641b-45ca-95cc-8710e10adcba admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CZXDtdO6R0Stu3vnLR88sA, audit_chain_id=['CZXDtdO6R0Stu3vnLR88sA']) at 0x7fe09e3c4dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:05.003505 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7159a70-641b-45ca-95cc-8710e10adcba admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:05.003796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7159a70-641b-45ca-95cc-8710e10adcba admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:05.004080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7159a70-641b-45ca-95cc-8710e10adcba admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:05.004764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7159a70-641b-45ca-95cc-8710e10adcba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:05.005064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7159a70-641b-45ca-95cc-8710e10adcba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:05.006647 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7159a70-641b-45ca-95cc-8710e10adcba admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:05.019034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 561/1121] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:05.024875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0675049-713c-467e-aa4a-d22031acaf84 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:05.033926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0675049-713c-467e-aa4a-d22031acaf84 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:05.042689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b1f4a-21df-4be0-aeb3-916be931c154 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CZXDtdO6R0Stu3vnLR88sA, audit_chain_id=['CZXDtdO6R0Stu3vnLR88sA']) at 0x7fe09df39520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:05.042689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b1f4a-21df-4be0-aeb3-916be931c154 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:05.042689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b1f4a-21df-4be0-aeb3-916be931c154 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:05.042689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b1f4a-21df-4be0-aeb3-916be931c154 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:05.043071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b1f4a-21df-4be0-aeb3-916be931c154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:05.043071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b1f4a-21df-4be0-aeb3-916be931c154 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:05.143029 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 561/1122] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Feb 28 18:47:05 2022] POST /identity/v3/users => generated 251 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:07.297581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5fe00-9526-49b9-8d71-f90f2c3177d5 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.298115 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5fe00-9526-49b9-8d71-f90f2c3177d5 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.298115 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5fe00-9526-49b9-8d71-f90f2c3177d5 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.299744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 562/1123] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:07.304894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adbbad-27c5-4b26-b680-3dd3a5bcaa39 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.305409 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adbbad-27c5-4b26-b680-3dd3a5bcaa39 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.305508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adbbad-27c5-4b26-b680-3dd3a5bcaa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.328315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-58adbbad-27c5-4b26-b680-3dd3a5bcaa39 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:07.329461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-58adbbad-27c5-4b26-b680-3dd3a5bcaa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:07.336674 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 562/1124] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:47:07 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:07.361117 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5fe00-9526-49b9-8d71-f90f2c3177d5 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.374047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5fe00-9526-49b9-8d71-f90f2c3177d5 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.378144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b8826-506e-44da-a00a-71c7b4b61c14 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09eabbe50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.378859 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b8826-506e-44da-a00a-71c7b4b61c14 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.379173 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b8826-506e-44da-a00a-71c7b4b61c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.379456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b8826-506e-44da-a00a-71c7b4b61c14 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.391131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b8826-506e-44da-a00a-71c7b4b61c14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:47:07.397730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-434b8826-506e-44da-a00a-71c7b4b61c14 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:47:07.398957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 563/1125] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:07.405163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adbbad-27c5-4b26-b680-3dd3a5bcaa39 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.413940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adbbad-27c5-4b26-b680-3dd3a5bcaa39 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.418880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40245e84-34b9-4ae2-a86d-df340d33ec96 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09e4f3a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.419600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40245e84-34b9-4ae2-a86d-df340d33ec96 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.423206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40245e84-34b9-4ae2-a86d-df340d33ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.423206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40245e84-34b9-4ae2-a86d-df340d33ec96 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.423206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40245e84-34b9-4ae2-a86d-df340d33ec96 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:07.423206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40245e84-34b9-4ae2-a86d-df340d33ec96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.423206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40245e84-34b9-4ae2-a86d-df340d33ec96 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:07.431515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 563/1126] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:07.437069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b8826-506e-44da-a00a-71c7b4b61c14 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.447067 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b8826-506e-44da-a00a-71c7b4b61c14 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.468175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a8384-c0af-4a84-a062-9178df31aaea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09e198160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.468175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a8384-c0af-4a84-a062-9178df31aaea admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.468175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a8384-c0af-4a84-a062-9178df31aaea admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.468175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a8384-c0af-4a84-a062-9178df31aaea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.468555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a8384-c0af-4a84-a062-9178df31aaea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.468555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a8384-c0af-4a84-a062-9178df31aaea admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:07.483698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-5a3a8384-c0af-4a84-a062-9178df31aaea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:07.484777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 564/1127] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:07.490770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40245e84-34b9-4ae2-a86d-df340d33ec96 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.500870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40245e84-34b9-4ae2-a86d-df340d33ec96 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.505275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1977f60-2b90-4fb9-8feb-be455e51fcfc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09e705760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.505857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1977f60-2b90-4fb9-8feb-be455e51fcfc admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.506143 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1977f60-2b90-4fb9-8feb-be455e51fcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.506422 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1977f60-2b90-4fb9-8feb-be455e51fcfc admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.507104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1977f60-2b90-4fb9-8feb-be455e51fcfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:07.507432 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1977f60-2b90-4fb9-8feb-be455e51fcfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.509071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1977f60-2b90-4fb9-8feb-be455e51fcfc admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:07.521370 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 564/1128] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:07.527375 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a8384-c0af-4a84-a062-9178df31aaea admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.536777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a8384-c0af-4a84-a062-9178df31aaea admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.542120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dc535-3815-4bc3-8d34-e493f0474a7a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09e1fbc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.542845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dc535-3815-4bc3-8d34-e493f0474a7a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.543165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dc535-3815-4bc3-8d34-e493f0474a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.543454 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dc535-3815-4bc3-8d34-e493f0474a7a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.556499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dc535-3815-4bc3-8d34-e493f0474a7a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.558428 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dc535-3815-4bc3-8d34-e493f0474a7a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:07.576520 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-014dc535-3815-4bc3-8d34-e493f0474a7a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:47:07.577617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 565/1129] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:07.583346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1977f60-2b90-4fb9-8feb-be455e51fcfc admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.593255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1977f60-2b90-4fb9-8feb-be455e51fcfc admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.597466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ff7a9-b535-4a7c-bf97-5f5651e259e7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09e108610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.598054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ff7a9-b535-4a7c-bf97-5f5651e259e7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.598340 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ff7a9-b535-4a7c-bf97-5f5651e259e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.598619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ff7a9-b535-4a7c-bf97-5f5651e259e7 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.599438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ff7a9-b535-4a7c-bf97-5f5651e259e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:07.599743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ff7a9-b535-4a7c-bf97-5f5651e259e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.601547 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ff7a9-b535-4a7c-bf97-5f5651e259e7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:07.629572 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 565/1130] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:07.635359 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dc535-3815-4bc3-8d34-e493f0474a7a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.644660 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dc535-3815-4bc3-8d34-e493f0474a7a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.649554 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c27ac-d582-467f-bcea-a49878afc929 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09e1cc040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.650133 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c27ac-d582-467f-bcea-a49878afc929 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.650423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c27ac-d582-467f-bcea-a49878afc929 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.650707 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c27ac-d582-467f-bcea-a49878afc929 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.658886 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c27ac-d582-467f-bcea-a49878afc929 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.660676 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c27ac-d582-467f-bcea-a49878afc929 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:07.671828 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 566/1131] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:07.678118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ff7a9-b535-4a7c-bf97-5f5651e259e7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.687569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ff7a9-b535-4a7c-bf97-5f5651e259e7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.691843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcc8c2-967d-4fdc-a9e6-bd0198af945d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09e108c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.692560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcc8c2-967d-4fdc-a9e6-bd0198af945d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.692853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcc8c2-967d-4fdc-a9e6-bd0198af945d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.693138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcc8c2-967d-4fdc-a9e6-bd0198af945d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.704865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcc8c2-967d-4fdc-a9e6-bd0198af945d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.706674 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcc8c2-967d-4fdc-a9e6-bd0198af945d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:07.723570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-3cfcc8c2-967d-4fdc-a9e6-bd0198af945d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:07.724640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 566/1132] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:47:07.732549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c27ac-d582-467f-bcea-a49878afc929 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.741122 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c27ac-d582-467f-bcea-a49878afc929 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.745861 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e3af4-cb69-413d-a523-dadadcc88481 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09e1ccc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.746443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e3af4-cb69-413d-a523-dadadcc88481 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.746731 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e3af4-cb69-413d-a523-dadadcc88481 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.747014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e3af4-cb69-413d-a523-dadadcc88481 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.747726 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e3af4-cb69-413d-a523-dadadcc88481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:07.748027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e3af4-cb69-413d-a523-dadadcc88481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.749596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e3af4-cb69-413d-a523-dadadcc88481 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:07.762207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 567/1133] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:07.768004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcc8c2-967d-4fdc-a9e6-bd0198af945d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.778315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcc8c2-967d-4fdc-a9e6-bd0198af945d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.782674 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bac9a-2a63-44c8-b4de-d73e676e8ae4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09e14a7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.783415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bac9a-2a63-44c8-b4de-d73e676e8ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.783708 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bac9a-2a63-44c8-b4de-d73e676e8ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.784000 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bac9a-2a63-44c8-b4de-d73e676e8ae4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.793499 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bac9a-2a63-44c8-b4de-d73e676e8ae4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.795476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bac9a-2a63-44c8-b4de-d73e676e8ae4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:07.809178 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-785bac9a-2a63-44c8-b4de-d73e676e8ae4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:47:07.810243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 567/1134] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:07.816116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e3af4-cb69-413d-a523-dadadcc88481 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.825624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e3af4-cb69-413d-a523-dadadcc88481 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.829848 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56579be8-cec4-4fe2-b9b1-93ba9b5fd153 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09e3de610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.830420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56579be8-cec4-4fe2-b9b1-93ba9b5fd153 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.830705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56579be8-cec4-4fe2-b9b1-93ba9b5fd153 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.830983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56579be8-cec4-4fe2-b9b1-93ba9b5fd153 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.831751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56579be8-cec4-4fe2-b9b1-93ba9b5fd153 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:07.832047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56579be8-cec4-4fe2-b9b1-93ba9b5fd153 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.833852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56579be8-cec4-4fe2-b9b1-93ba9b5fd153 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:07.846879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 568/1135] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:07.853976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bac9a-2a63-44c8-b4de-d73e676e8ae4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.863294 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bac9a-2a63-44c8-b4de-d73e676e8ae4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.867512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c73839-36b3-4017-8163-0004885f1f6c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-dAMVeSrSWWkHNMpfGWpGA, audit_chain_id=['-dAMVeSrSWWkHNMpfGWpGA']) at 0x7fe09e4f3a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.868469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73839-36b3-4017-8163-0004885f1f6c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.868765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73839-36b3-4017-8163-0004885f1f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.869051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73839-36b3-4017-8163-0004885f1f6c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.869824 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73839-36b3-4017-8163-0004885f1f6c admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=2f330acd453f445ea31acf9fc43b53ad) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:07.870129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73839-36b3-4017-8163-0004885f1f6c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.871980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73839-36b3-4017-8163-0004885f1f6c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:07.877222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 568/1136] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/role_assignments?user.id=2f330acd453f445ea31acf9fc43b53ad&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:09.974857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd3faf-0df6-448f-aa97-7d5df57e1fdc None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:09.975440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd3faf-0df6-448f-aa97-7d5df57e1fdc None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:09.975440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd3faf-0df6-448f-aa97-7d5df57e1fdc None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:09.977118 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 569/1137] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:09.982198 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead17581-1e21-4ffb-a424-43b27b4ddba4 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:09.982620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead17581-1e21-4ffb-a424-43b27b4ddba4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:09.982776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead17581-1e21-4ffb-a424-43b27b4ddba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.005589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-ead17581-1e21-4ffb-a424-43b27b4ddba4 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:10.006720 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ead17581-1e21-4ffb-a424-43b27b4ddba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:10.014470 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 569/1138] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:47:09 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:10.036939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd3faf-0df6-448f-aa97-7d5df57e1fdc None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.048658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd3faf-0df6-448f-aa97-7d5df57e1fdc None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.052790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a93c7-7707-4819-8eac-4e672716aae0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZGMPNsUjSBK-Na170kKANg, audit_chain_id=['ZGMPNsUjSBK-Na170kKANg']) at 0x7fe09e198be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.053492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a93c7-7707-4819-8eac-4e672716aae0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.053775 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a93c7-7707-4819-8eac-4e672716aae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.054051 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a93c7-7707-4819-8eac-4e672716aae0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.065512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a93c7-7707-4819-8eac-4e672716aae0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:47:10.072384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-250a93c7-7707-4819-8eac-4e672716aae0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:47:10.073449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 570/1139] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:10.079548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead17581-1e21-4ffb-a424-43b27b4ddba4 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.088176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead17581-1e21-4ffb-a424-43b27b4ddba4 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.092589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785adb-4c94-4332-bdc5-e5e27e7daa6d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZGMPNsUjSBK-Na170kKANg, audit_chain_id=['ZGMPNsUjSBK-Na170kKANg']) at 0x7fe09e14aa00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.093181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785adb-4c94-4332-bdc5-e5e27e7daa6d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.093469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785adb-4c94-4332-bdc5-e5e27e7daa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.093753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785adb-4c94-4332-bdc5-e5e27e7daa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.094458 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6785adb-4c94-4332-bdc5-e5e27e7daa6d admin admin] RBAC: Adding query filter params (name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:10.094755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6785adb-4c94-4332-bdc5-e5e27e7daa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.096352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6785adb-4c94-4332-bdc5-e5e27e7daa6d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:10.104605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 570/1140] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:10.110023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a93c7-7707-4819-8eac-4e672716aae0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.120334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a93c7-7707-4819-8eac-4e672716aae0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.124525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1cfca-d6c9-4f35-96bb-40b7caec0d6f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZGMPNsUjSBK-Na170kKANg, audit_chain_id=['ZGMPNsUjSBK-Na170kKANg']) at 0x7fe09e1fb400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.125217 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1cfca-d6c9-4f35-96bb-40b7caec0d6f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.125581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1cfca-d6c9-4f35-96bb-40b7caec0d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.125860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1cfca-d6c9-4f35-96bb-40b7caec0d6f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.137399 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1cfca-d6c9-4f35-96bb-40b7caec0d6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.139220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1cfca-d6c9-4f35-96bb-40b7caec0d6f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:10.156259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-29a1cfca-d6c9-4f35-96bb-40b7caec0d6f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:10.157293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 571/1141] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:10.162977 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785adb-4c94-4332-bdc5-e5e27e7daa6d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.172920 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785adb-4c94-4332-bdc5-e5e27e7daa6d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.177504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d809d-b826-4ec5-b01f-be84bb44db58 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZGMPNsUjSBK-Na170kKANg, audit_chain_id=['ZGMPNsUjSBK-Na170kKANg']) at 0x7fe09e14a940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.178084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d809d-b826-4ec5-b01f-be84bb44db58 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.178372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d809d-b826-4ec5-b01f-be84bb44db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.178652 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d809d-b826-4ec5-b01f-be84bb44db58 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.179370 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d809d-b826-4ec5-b01f-be84bb44db58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:10.179670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d809d-b826-4ec5-b01f-be84bb44db58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.182005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d809d-b826-4ec5-b01f-be84bb44db58 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:10.194334 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 571/1142] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:10.200236 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1cfca-d6c9-4f35-96bb-40b7caec0d6f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.210251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1cfca-d6c9-4f35-96bb-40b7caec0d6f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.214642 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca50d-a5b7-49d1-b54b-df1a0a0a2e41 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZGMPNsUjSBK-Na170kKANg, audit_chain_id=['ZGMPNsUjSBK-Na170kKANg']) at 0x7fe09df0b550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.215386 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca50d-a5b7-49d1-b54b-df1a0a0a2e41 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.215671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca50d-a5b7-49d1-b54b-df1a0a0a2e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.215949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca50d-a5b7-49d1-b54b-df1a0a0a2e41 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.229202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ca50d-a5b7-49d1-b54b-df1a0a0a2e41 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.231210 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ca50d-a5b7-49d1-b54b-df1a0a0a2e41 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:10.249057 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-883ca50d-a5b7-49d1-b54b-df1a0a0a2e41 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:47:10.250112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 572/1143] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:10.255921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d809d-b826-4ec5-b01f-be84bb44db58 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.265613 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d809d-b826-4ec5-b01f-be84bb44db58 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.269898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644ebf3-0feb-4c15-ba3d-89db9c02ca95 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZGMPNsUjSBK-Na170kKANg, audit_chain_id=['ZGMPNsUjSBK-Na170kKANg']) at 0x7fe09e1a14c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.270492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ebf3-0feb-4c15-ba3d-89db9c02ca95 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.270783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ebf3-0feb-4c15-ba3d-89db9c02ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.271067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644ebf3-0feb-4c15-ba3d-89db9c02ca95 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.271880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644ebf3-0feb-4c15-ba3d-89db9c02ca95 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:10.272186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644ebf3-0feb-4c15-ba3d-89db9c02ca95 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.274090 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644ebf3-0feb-4c15-ba3d-89db9c02ca95 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:10.303587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 572/1144] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:10.309936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca50d-a5b7-49d1-b54b-df1a0a0a2e41 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.319458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca50d-a5b7-49d1-b54b-df1a0a0a2e41 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.329940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e74f71-eaf6-474e-9302-f663b66d9a70 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZGMPNsUjSBK-Na170kKANg, audit_chain_id=['ZGMPNsUjSBK-Na170kKANg']) at 0x7fe09e1fb400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.330649 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e74f71-eaf6-474e-9302-f663b66d9a70 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.330935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e74f71-eaf6-474e-9302-f663b66d9a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.331250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e74f71-eaf6-474e-9302-f663b66d9a70 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.343229 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e74f71-eaf6-474e-9302-f663b66d9a70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.345027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e74f71-eaf6-474e-9302-f663b66d9a70 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:10.362230 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-46e74f71-eaf6-474e-9302-f663b66d9a70 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:10.363313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 573/1145] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:10.369882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644ebf3-0feb-4c15-ba3d-89db9c02ca95 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.379155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644ebf3-0feb-4c15-ba3d-89db9c02ca95 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.383468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414e3be-e2ef-4a44-ba84-0c3107d51b5c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZGMPNsUjSBK-Na170kKANg, audit_chain_id=['ZGMPNsUjSBK-Na170kKANg']) at 0x7fe09e123970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.384111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414e3be-e2ef-4a44-ba84-0c3107d51b5c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.384401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414e3be-e2ef-4a44-ba84-0c3107d51b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.384682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414e3be-e2ef-4a44-ba84-0c3107d51b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.385361 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414e3be-e2ef-4a44-ba84-0c3107d51b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:10.385658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414e3be-e2ef-4a44-ba84-0c3107d51b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.387247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414e3be-e2ef-4a44-ba84-0c3107d51b5c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:10.399586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 573/1146] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:10.405236 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e74f71-eaf6-474e-9302-f663b66d9a70 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.415655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e74f71-eaf6-474e-9302-f663b66d9a70 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.420240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7807fd-6387-46b1-9cf2-58d18129f641 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZGMPNsUjSBK-Na170kKANg, audit_chain_id=['ZGMPNsUjSBK-Na170kKANg']) at 0x7fe09df1a3d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.420568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7807fd-6387-46b1-9cf2-58d18129f641 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.420852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7807fd-6387-46b1-9cf2-58d18129f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.421126 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7807fd-6387-46b1-9cf2-58d18129f641 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.429441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7807fd-6387-46b1-9cf2-58d18129f641 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.432118 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7807fd-6387-46b1-9cf2-58d18129f641 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:10.445615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-cc7807fd-6387-46b1-9cf2-58d18129f641 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:47:10.446801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 574/1147] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:10.453146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414e3be-e2ef-4a44-ba84-0c3107d51b5c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.462534 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414e3be-e2ef-4a44-ba84-0c3107d51b5c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.467103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db222f77-48db-49a7-aae6-2f0ac170c135 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZGMPNsUjSBK-Na170kKANg, audit_chain_id=['ZGMPNsUjSBK-Na170kKANg']) at 0x7fe09e108a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.467974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db222f77-48db-49a7-aae6-2f0ac170c135 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.468264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db222f77-48db-49a7-aae6-2f0ac170c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.468551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db222f77-48db-49a7-aae6-2f0ac170c135 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.469295 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db222f77-48db-49a7-aae6-2f0ac170c135 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:10.469600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db222f77-48db-49a7-aae6-2f0ac170c135 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.471449 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db222f77-48db-49a7-aae6-2f0ac170c135 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:10.484389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 574/1148] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:10.490208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7807fd-6387-46b1-9cf2-58d18129f641 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.500082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7807fd-6387-46b1-9cf2-58d18129f641 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.504258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff968a-943a-446b-b63f-200cf0eabe80 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZGMPNsUjSBK-Na170kKANg, audit_chain_id=['ZGMPNsUjSBK-Na170kKANg']) at 0x7fe09e198550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.505055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff968a-943a-446b-b63f-200cf0eabe80 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.505337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff968a-943a-446b-b63f-200cf0eabe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.505614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff968a-943a-446b-b63f-200cf0eabe80 admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/2f330acd453f445ea31acf9fc43b53ad/roles/9a37fbff179849e58437f2fad75ce546` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.543043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff968a-943a-446b-b63f-200cf0eabe80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=2f330acd453f445ea31acf9fc43b53ad, role_id=9a37fbff179849e58437f2fad75ce546)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.545792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff968a-943a-446b-b63f-200cf0eabe80 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:10.640580 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 575/1149] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:47:10 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/2f330acd453f445ea31acf9fc43b53ad/roles/9a37fbff179849e58437f2fad75ce546 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:12.740024 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72839c-da88-4e3d-86f0-8c7870379e6a None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:12.740589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72839c-da88-4e3d-86f0-8c7870379e6a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:12.740589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72839c-da88-4e3d-86f0-8c7870379e6a None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:12.742224 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 575/1150] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:12.748069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2c2e2-8b1a-403d-98d6-a46292d700bf None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:12.748608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2c2e2-8b1a-403d-98d6-a46292d700bf None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:12.748755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2c2e2-8b1a-403d-98d6-a46292d700bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:12.772374 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-55a2c2e2-8b1a-403d-98d6-a46292d700bf None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:12.773621 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-55a2c2e2-8b1a-403d-98d6-a46292d700bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:12.838714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 576/1151] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:47:12 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:12.862815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72839c-da88-4e3d-86f0-8c7870379e6a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:12.875593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72839c-da88-4e3d-86f0-8c7870379e6a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:12.879641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945d77b-3270-4ea7-a58a-5044d8e46132 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09e14eaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:12.881408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945d77b-3270-4ea7-a58a-5044d8e46132 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:12.881408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945d77b-3270-4ea7-a58a-5044d8e46132 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:12.881408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945d77b-3270-4ea7-a58a-5044d8e46132 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:12.892493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945d77b-3270-4ea7-a58a-5044d8e46132 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:47:12.899196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-3945d77b-3270-4ea7-a58a-5044d8e46132 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:47:12.900296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 576/1152] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Feb 28 18:47:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:12.906308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2c2e2-8b1a-403d-98d6-a46292d700bf None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:12.915102 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2c2e2-8b1a-403d-98d6-a46292d700bf None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:12.919423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c067003-96b3-4459-bb03-511a75963675 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09e1b0b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:12.920018 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c067003-96b3-4459-bb03-511a75963675 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:12.920307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c067003-96b3-4459-bb03-511a75963675 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:12.920588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c067003-96b3-4459-bb03-511a75963675 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:12.921301 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c067003-96b3-4459-bb03-511a75963675 admin admin] RBAC: Adding query filter params (name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:12.921603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c067003-96b3-4459-bb03-511a75963675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:12.923195 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c067003-96b3-4459-bb03-511a75963675 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:12.932488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 577/1153] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 18:47:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:12.938423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945d77b-3270-4ea7-a58a-5044d8e46132 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:12.949480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945d77b-3270-4ea7-a58a-5044d8e46132 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:12.953763 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ebbe6-826e-4f74-99f8-1c290eb5a136 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09e705430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:12.954498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ebbe6-826e-4f74-99f8-1c290eb5a136 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:12.954900 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ebbe6-826e-4f74-99f8-1c290eb5a136 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:12.955318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ebbe6-826e-4f74-99f8-1c290eb5a136 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:12.966877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ebbe6-826e-4f74-99f8-1c290eb5a136 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:12.968740 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ebbe6-826e-4f74-99f8-1c290eb5a136 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:12.985776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-3f9ebbe6-826e-4f74-99f8-1c290eb5a136 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:12.995660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 577/1154] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:12.995841 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c067003-96b3-4459-bb03-511a75963675 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:13.003280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c067003-96b3-4459-bb03-511a75963675 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.007535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad61e21-65ac-40ad-92a3-fd5282a72543 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09e1df880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.008714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad61e21-65ac-40ad-92a3-fd5282a72543 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.008997 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad61e21-65ac-40ad-92a3-fd5282a72543 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.009276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad61e21-65ac-40ad-92a3-fd5282a72543 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.009956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad61e21-65ac-40ad-92a3-fd5282a72543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:13.010252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad61e21-65ac-40ad-92a3-fd5282a72543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.011873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad61e21-65ac-40ad-92a3-fd5282a72543 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:13.024384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 578/1155] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:13.030040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ebbe6-826e-4f74-99f8-1c290eb5a136 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:13.040679 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ebbe6-826e-4f74-99f8-1c290eb5a136 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.045000 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b06e4f-6c83-401c-8294-2f3c7513e3ac admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09e183940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.045723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b06e4f-6c83-401c-8294-2f3c7513e3ac admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.046013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b06e4f-6c83-401c-8294-2f3c7513e3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.046295 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b06e4f-6c83-401c-8294-2f3c7513e3ac admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.059249 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b06e4f-6c83-401c-8294-2f3c7513e3ac admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.061279 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b06e4f-6c83-401c-8294-2f3c7513e3ac admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:13.079730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-56b06e4f-6c83-401c-8294-2f3c7513e3ac admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:47:13.080811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 578/1156] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:13.086646 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad61e21-65ac-40ad-92a3-fd5282a72543 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:13.096054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad61e21-65ac-40ad-92a3-fd5282a72543 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.100399 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bb2df-8863-4bb9-8527-752465399125 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09e204190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.100988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bb2df-8863-4bb9-8527-752465399125 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.101275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bb2df-8863-4bb9-8527-752465399125 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.101557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bb2df-8863-4bb9-8527-752465399125 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.102377 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bb2df-8863-4bb9-8527-752465399125 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:13.102698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bb2df-8863-4bb9-8527-752465399125 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.104541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bb2df-8863-4bb9-8527-752465399125 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:13.132884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 579/1157] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Feb 28 18:47:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:13.139358 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b06e4f-6c83-401c-8294-2f3c7513e3ac admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:13.148634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b06e4f-6c83-401c-8294-2f3c7513e3ac admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.152989 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7958b8-fa9a-4009-a68f-b72ecd09ca5f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09e480dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.153576 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7958b8-fa9a-4009-a68f-b72ecd09ca5f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.153868 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7958b8-fa9a-4009-a68f-b72ecd09ca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.154157 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7958b8-fa9a-4009-a68f-b72ecd09ca5f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.161866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7958b8-fa9a-4009-a68f-b72ecd09ca5f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.163639 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7958b8-fa9a-4009-a68f-b72ecd09ca5f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:13.173071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 579/1158] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:47:13 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:13.179030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bb2df-8863-4bb9-8527-752465399125 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:13.188954 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bb2df-8863-4bb9-8527-752465399125 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.193177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2afbac-b35b-4500-8374-34374c6e1855 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09e204ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.193881 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2afbac-b35b-4500-8374-34374c6e1855 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.194167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2afbac-b35b-4500-8374-34374c6e1855 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.194447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2afbac-b35b-4500-8374-34374c6e1855 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.206325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2afbac-b35b-4500-8374-34374c6e1855 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.208158 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2afbac-b35b-4500-8374-34374c6e1855 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:13.224879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-6e2afbac-b35b-4500-8374-34374c6e1855 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:13.225924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 580/1159] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:13.232455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7958b8-fa9a-4009-a68f-b72ecd09ca5f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:13.240943 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7958b8-fa9a-4009-a68f-b72ecd09ca5f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.246233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9ddf0-2461-4e9c-a39e-4d7a2755bf49 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09e15e550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.246765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9ddf0-2461-4e9c-a39e-4d7a2755bf49 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.247057 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9ddf0-2461-4e9c-a39e-4d7a2755bf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.247375 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9ddf0-2461-4e9c-a39e-4d7a2755bf49 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.248058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9ddf0-2461-4e9c-a39e-4d7a2755bf49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:13.248364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9ddf0-2461-4e9c-a39e-4d7a2755bf49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.249926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9ddf0-2461-4e9c-a39e-4d7a2755bf49 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:13.262277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 580/1160] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:13.269139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2afbac-b35b-4500-8374-34374c6e1855 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:13.278528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2afbac-b35b-4500-8374-34374c6e1855 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.283265 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15607666-d0dc-42b4-99ce-ff152e466f7a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09e1fbcd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.283976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15607666-d0dc-42b4-99ce-ff152e466f7a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.284258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15607666-d0dc-42b4-99ce-ff152e466f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.284534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15607666-d0dc-42b4-99ce-ff152e466f7a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.293558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15607666-d0dc-42b4-99ce-ff152e466f7a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.295507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15607666-d0dc-42b4-99ce-ff152e466f7a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:13.309341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-15607666-d0dc-42b4-99ce-ff152e466f7a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:47:13.310410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 581/1161] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:47:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:13.316766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9ddf0-2461-4e9c-a39e-4d7a2755bf49 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:13.330483 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9ddf0-2461-4e9c-a39e-4d7a2755bf49 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.334796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96891d38-41e9-483a-8e58-404f1380821d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09df3bd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.335421 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96891d38-41e9-483a-8e58-404f1380821d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.335717 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96891d38-41e9-483a-8e58-404f1380821d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.336002 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96891d38-41e9-483a-8e58-404f1380821d admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.336947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96891d38-41e9-483a-8e58-404f1380821d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:13.337253 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96891d38-41e9-483a-8e58-404f1380821d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.339136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96891d38-41e9-483a-8e58-404f1380821d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:13.351573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 581/1162] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:47:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:13.358896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15607666-d0dc-42b4-99ce-ff152e466f7a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:13.368970 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15607666-d0dc-42b4-99ce-ff152e466f7a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.373245 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184ceff-eb40-449d-9d5b-fe4f7bc1513a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CDDxLLtFTb-xJJEpFIzqqQ, audit_chain_id=['CDDxLLtFTb-xJJEpFIzqqQ']) at 0x7fe09e3de220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.373815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184ceff-eb40-449d-9d5b-fe4f7bc1513a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.374099 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184ceff-eb40-449d-9d5b-fe4f7bc1513a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.374377 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184ceff-eb40-449d-9d5b-fe4f7bc1513a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.375172 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184ceff-eb40-449d-9d5b-fe4f7bc1513a admin admin] RBAC: Adding query filter params (role.id=9a37fbff179849e58437f2fad75ce546, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=2f330acd453f445ea31acf9fc43b53ad) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:13.375476 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184ceff-eb40-449d-9d5b-fe4f7bc1513a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.377280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184ceff-eb40-449d-9d5b-fe4f7bc1513a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:13.382799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 582/1163] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:47:13 2022] GET /identity/v3/role_assignments?user.id=2f330acd453f445ea31acf9fc43b53ad&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=9a37fbff179849e58437f2fad75ce546 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:15.558927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e5cf-ca48-47fd-bc72-3542b388a518 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.559630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e5cf-ca48-47fd-bc72-3542b388a518 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.559630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e5cf-ca48-47fd-bc72-3542b388a518 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.561239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 582/1164] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:15.566826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab437f-0127-4a52-94a3-3d4a6d3031f2 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.567456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab437f-0127-4a52-94a3-3d4a6d3031f2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.567456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab437f-0127-4a52-94a3-3d4a6d3031f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.590986 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-79ab437f-0127-4a52-94a3-3d4a6d3031f2 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:15.592148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-79ab437f-0127-4a52-94a3-3d4a6d3031f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:15.599133 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 583/1165] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:47:15 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:15.623373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406e5cf-ca48-47fd-bc72-3542b388a518 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:15.636518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406e5cf-ca48-47fd-bc72-3542b388a518 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:15.640829 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32fa47-097a-4de2-9f89-fcc42a3bd062 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09e106a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:15.641561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fa47-097a-4de2-9f89-fcc42a3bd062 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.641852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fa47-097a-4de2-9f89-fcc42a3bd062 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.642137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fa47-097a-4de2-9f89-fcc42a3bd062 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.654567 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32fa47-097a-4de2-9f89-fcc42a3bd062 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:47:15.660987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-3f32fa47-097a-4de2-9f89-fcc42a3bd062 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:47:15.662180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 583/1166] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:15.668697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab437f-0127-4a52-94a3-3d4a6d3031f2 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:15.677537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab437f-0127-4a52-94a3-3d4a6d3031f2 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:15.682283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966b828-a7b7-47ad-a723-06701e0decec admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09e1fbdc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:15.682875 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966b828-a7b7-47ad-a723-06701e0decec admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.683200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966b828-a7b7-47ad-a723-06701e0decec admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.683487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966b828-a7b7-47ad-a723-06701e0decec admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.684200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966b828-a7b7-47ad-a723-06701e0decec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:15.684502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966b828-a7b7-47ad-a723-06701e0decec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:15.686323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966b828-a7b7-47ad-a723-06701e0decec admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:15.696319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 584/1167] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:15.703402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32fa47-097a-4de2-9f89-fcc42a3bd062 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:15.714773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32fa47-097a-4de2-9f89-fcc42a3bd062 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:15.719292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83734b-ad2d-4cad-aba3-de3825252f7e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09e14a730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:15.721568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83734b-ad2d-4cad-aba3-de3825252f7e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.721568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83734b-ad2d-4cad-aba3-de3825252f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.721568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83734b-ad2d-4cad-aba3-de3825252f7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.733626 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83734b-ad2d-4cad-aba3-de3825252f7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:15.735494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83734b-ad2d-4cad-aba3-de3825252f7e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:15.754335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-9e83734b-ad2d-4cad-aba3-de3825252f7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:15.755575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 584/1168] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:15.762489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966b828-a7b7-47ad-a723-06701e0decec admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:15.771995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966b828-a7b7-47ad-a723-06701e0decec admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:15.776629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b046da-4369-4216-bbdc-6c1ac25e70ad admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09e1d7190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:15.777238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b046da-4369-4216-bbdc-6c1ac25e70ad admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.777527 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b046da-4369-4216-bbdc-6c1ac25e70ad admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.777813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b046da-4369-4216-bbdc-6c1ac25e70ad admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.778509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b046da-4369-4216-bbdc-6c1ac25e70ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:15.778811 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b046da-4369-4216-bbdc-6c1ac25e70ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:15.780463 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b046da-4369-4216-bbdc-6c1ac25e70ad admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:15.793454 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 585/1169] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:15.799653 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83734b-ad2d-4cad-aba3-de3825252f7e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:15.809712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83734b-ad2d-4cad-aba3-de3825252f7e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:15.814192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc45b52-c2c4-4f05-8b95-db155c632a5b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09e2120d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:15.814926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45b52-c2c4-4f05-8b95-db155c632a5b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.815252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45b52-c2c4-4f05-8b95-db155c632a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.815539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45b52-c2c4-4f05-8b95-db155c632a5b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.830431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc45b52-c2c4-4f05-8b95-db155c632a5b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:15.832457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc45b52-c2c4-4f05-8b95-db155c632a5b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:15.850054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-cbc45b52-c2c4-4f05-8b95-db155c632a5b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:47:15.851217 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 585/1170] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:15.857153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b046da-4369-4216-bbdc-6c1ac25e70ad admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:15.866692 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b046da-4369-4216-bbdc-6c1ac25e70ad admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:15.871734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6344bd8-2bb5-4317-871f-1c1c9f501972 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09e3eb0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:15.872393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344bd8-2bb5-4317-871f-1c1c9f501972 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.872688 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344bd8-2bb5-4317-871f-1c1c9f501972 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.872985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344bd8-2bb5-4317-871f-1c1c9f501972 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.873793 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6344bd8-2bb5-4317-871f-1c1c9f501972 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:15.874091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6344bd8-2bb5-4317-871f-1c1c9f501972 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:15.875985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6344bd8-2bb5-4317-871f-1c1c9f501972 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:15.905349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 586/1171] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Feb 28 18:47:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:15.911180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc45b52-c2c4-4f05-8b95-db155c632a5b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:15.920546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc45b52-c2c4-4f05-8b95-db155c632a5b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:15.924788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa149be-ab68-4828-9212-06903f943bd1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09e105760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:15.925426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa149be-ab68-4828-9212-06903f943bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.925782 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa149be-ab68-4828-9212-06903f943bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.926128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa149be-ab68-4828-9212-06903f943bd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.934709 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa149be-ab68-4828-9212-06903f943bd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:15.936607 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa149be-ab68-4828-9212-06903f943bd1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:15.945440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 586/1172] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:47:15 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:15.952214 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6344bd8-2bb5-4317-871f-1c1c9f501972 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:15.961744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6344bd8-2bb5-4317-871f-1c1c9f501972 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:15.966480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03282da5-c264-4785-bcc0-dca023a66d31 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09e439ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:15.967228 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03282da5-c264-4785-bcc0-dca023a66d31 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.967523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03282da5-c264-4785-bcc0-dca023a66d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.967803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03282da5-c264-4785-bcc0-dca023a66d31 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.979595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03282da5-c264-4785-bcc0-dca023a66d31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:15.981411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03282da5-c264-4785-bcc0-dca023a66d31 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:15.998693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-03282da5-c264-4785-bcc0-dca023a66d31 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:15.999796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 587/1173] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:47:16.005580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa149be-ab68-4828-9212-06903f943bd1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:16.014668 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa149be-ab68-4828-9212-06903f943bd1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:16.018897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf955f2-3a1d-4705-82bb-57f41a6f3871 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09ded0ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:16.019520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf955f2-3a1d-4705-82bb-57f41a6f3871 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:16.019808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf955f2-3a1d-4705-82bb-57f41a6f3871 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:16.020087 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf955f2-3a1d-4705-82bb-57f41a6f3871 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:16.020755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf955f2-3a1d-4705-82bb-57f41a6f3871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:16.021053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf955f2-3a1d-4705-82bb-57f41a6f3871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:16.022595 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf955f2-3a1d-4705-82bb-57f41a6f3871 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:16.034792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 587/1174] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:16.040622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03282da5-c264-4785-bcc0-dca023a66d31 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:16.049863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03282da5-c264-4785-bcc0-dca023a66d31 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:16.054165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d631cc-c275-4181-9f68-1af157878edd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09df0b670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:16.055518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d631cc-c275-4181-9f68-1af157878edd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:16.055871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d631cc-c275-4181-9f68-1af157878edd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:16.056095 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d631cc-c275-4181-9f68-1af157878edd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:16.064545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d631cc-c275-4181-9f68-1af157878edd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:16.066443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d631cc-c275-4181-9f68-1af157878edd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:16.080913 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-c6d631cc-c275-4181-9f68-1af157878edd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:47:16.081987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 588/1175] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:47:16.088281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf955f2-3a1d-4705-82bb-57f41a6f3871 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:16.097480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf955f2-3a1d-4705-82bb-57f41a6f3871 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:16.101783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33f6e3-60ec-4c36-bee2-0b059b1370f0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09e183880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:16.102460 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33f6e3-60ec-4c36-bee2-0b059b1370f0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:16.102744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33f6e3-60ec-4c36-bee2-0b059b1370f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:16.103025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33f6e3-60ec-4c36-bee2-0b059b1370f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:16.103795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33f6e3-60ec-4c36-bee2-0b059b1370f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:16.104099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33f6e3-60ec-4c36-bee2-0b059b1370f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:16.105903 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33f6e3-60ec-4c36-bee2-0b059b1370f0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:16.118814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 588/1176] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:47:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:16.125019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d631cc-c275-4181-9f68-1af157878edd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:16.135620 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d631cc-c275-4181-9f68-1af157878edd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:16.139923 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4870d-a6e8-4fcf-ad6a-ec92e23e8d5b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7w3cn1AvSZurddDItK1Rjg, audit_chain_id=['7w3cn1AvSZurddDItK1Rjg']) at 0x7fe09e1d7760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:16.140496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4870d-a6e8-4fcf-ad6a-ec92e23e8d5b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:16.140785 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4870d-a6e8-4fcf-ad6a-ec92e23e8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:16.141070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4870d-a6e8-4fcf-ad6a-ec92e23e8d5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:16.141872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4870d-a6e8-4fcf-ad6a-ec92e23e8d5b admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=2f330acd453f445ea31acf9fc43b53ad) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:16.142175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4870d-a6e8-4fcf-ad6a-ec92e23e8d5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:16.144047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4870d-a6e8-4fcf-ad6a-ec92e23e8d5b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:16.149818 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 589/1177] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:47:16 2022] GET /identity/v3/role_assignments?user.id=2f330acd453f445ea31acf9fc43b53ad&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:18.247508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4ffd-c4c3-459a-ac94-89e746b69add None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.248014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4ffd-c4c3-459a-ac94-89e746b69add None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.248014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d4ffd-c4c3-459a-ac94-89e746b69add None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.249647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 589/1178] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:18.254675 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8da19-6994-426d-b520-19a2854f6be8 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.255142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8da19-6994-426d-b520-19a2854f6be8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.255281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8da19-6994-426d-b520-19a2854f6be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.279472 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-32f8da19-6994-426d-b520-19a2854f6be8 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:18.280600 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-32f8da19-6994-426d-b520-19a2854f6be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:18.287486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 590/1179] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:47:18 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:18.310990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d4ffd-c4c3-459a-ac94-89e746b69add None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:18.323276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d4ffd-c4c3-459a-ac94-89e746b69add None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:18.327544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a224d70-e22e-486d-ab64-59f2d522692c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ie9N2u0SRIqy0e8mjc6VUw, audit_chain_id=['Ie9N2u0SRIqy0e8mjc6VUw']) at 0x7fe09e108c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:18.328246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a224d70-e22e-486d-ab64-59f2d522692c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.328534 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a224d70-e22e-486d-ab64-59f2d522692c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.328810 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a224d70-e22e-486d-ab64-59f2d522692c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.339726 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a224d70-e22e-486d-ab64-59f2d522692c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:47:18.345841 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-4a224d70-e22e-486d-ab64-59f2d522692c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:47:18.346913 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 590/1180] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:47:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:18.352875 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8da19-6994-426d-b520-19a2854f6be8 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:18.361383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8da19-6994-426d-b520-19a2854f6be8 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:18.365550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7705b-0db6-4016-8d52-4822655ba954 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ie9N2u0SRIqy0e8mjc6VUw, audit_chain_id=['Ie9N2u0SRIqy0e8mjc6VUw']) at 0x7fe09e16e640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:18.366134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7705b-0db6-4016-8d52-4822655ba954 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.366419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7705b-0db6-4016-8d52-4822655ba954 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.366697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7705b-0db6-4016-8d52-4822655ba954 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.368073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7705b-0db6-4016-8d52-4822655ba954 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:18.368374 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7705b-0db6-4016-8d52-4822655ba954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:18.369943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7705b-0db6-4016-8d52-4822655ba954 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:18.378228 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 591/1181] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:47:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:47:18.384437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a224d70-e22e-486d-ab64-59f2d522692c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:18.393857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a224d70-e22e-486d-ab64-59f2d522692c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:18.397986 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6577-3947-45b2-affe-3bad815c464e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ie9N2u0SRIqy0e8mjc6VUw, audit_chain_id=['Ie9N2u0SRIqy0e8mjc6VUw']) at 0x7fe09df3b5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:18.398756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6577-3947-45b2-affe-3bad815c464e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.399042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6577-3947-45b2-affe-3bad815c464e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.399357 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6577-3947-45b2-affe-3bad815c464e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.411322 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e6577-3947-45b2-affe-3bad815c464e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:18.413112 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e6577-3947-45b2-affe-3bad815c464e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:18.430862 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-680e6577-3947-45b2-affe-3bad815c464e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:18.431965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 591/1182] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:47:18.437697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7705b-0db6-4016-8d52-4822655ba954 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:18.447031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7705b-0db6-4016-8d52-4822655ba954 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:18.451591 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024e591-e3c8-44c6-a710-6b4c7553fc1c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ie9N2u0SRIqy0e8mjc6VUw, audit_chain_id=['Ie9N2u0SRIqy0e8mjc6VUw']) at 0x7fe09e3e75e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:18.452171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e591-e3c8-44c6-a710-6b4c7553fc1c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.452460 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e591-e3c8-44c6-a710-6b4c7553fc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.452748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e591-e3c8-44c6-a710-6b4c7553fc1c admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.453430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024e591-e3c8-44c6-a710-6b4c7553fc1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:18.453764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024e591-e3c8-44c6-a710-6b4c7553fc1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:18.455373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024e591-e3c8-44c6-a710-6b4c7553fc1c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:18.467564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 592/1183] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:18.472856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6577-3947-45b2-affe-3bad815c464e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:18.482498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6577-3947-45b2-affe-3bad815c464e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:18.486677 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4031a30-241b-464f-944a-3cdf31b585f4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ie9N2u0SRIqy0e8mjc6VUw, audit_chain_id=['Ie9N2u0SRIqy0e8mjc6VUw']) at 0x7fe09df3b8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:18.487405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031a30-241b-464f-944a-3cdf31b585f4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.487691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031a30-241b-464f-944a-3cdf31b585f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.487969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031a30-241b-464f-944a-3cdf31b585f4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.500895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4031a30-241b-464f-944a-3cdf31b585f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:18.502797 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4031a30-241b-464f-944a-3cdf31b585f4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:18.519851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-b4031a30-241b-464f-944a-3cdf31b585f4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:47:18.520890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 592/1184] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:18.526493 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024e591-e3c8-44c6-a710-6b4c7553fc1c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:18.535653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024e591-e3c8-44c6-a710-6b4c7553fc1c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:18.540939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58756e-f2bd-4214-90e2-f3e5fcdae077 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ie9N2u0SRIqy0e8mjc6VUw, audit_chain_id=['Ie9N2u0SRIqy0e8mjc6VUw']) at 0x7fe09e3f69d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:18.541519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58756e-f2bd-4214-90e2-f3e5fcdae077 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.541807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58756e-f2bd-4214-90e2-f3e5fcdae077 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.542089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58756e-f2bd-4214-90e2-f3e5fcdae077 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.542870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58756e-f2bd-4214-90e2-f3e5fcdae077 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:18.543197 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58756e-f2bd-4214-90e2-f3e5fcdae077 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:18.545002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58756e-f2bd-4214-90e2-f3e5fcdae077 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:18.580709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 593/1185] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Feb 28 18:47:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:18.586580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4031a30-241b-464f-944a-3cdf31b585f4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:18.595756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4031a30-241b-464f-944a-3cdf31b585f4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:18.599916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1a7c1-9d4c-4470-a6eb-f0bf1c150b93 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ie9N2u0SRIqy0e8mjc6VUw, audit_chain_id=['Ie9N2u0SRIqy0e8mjc6VUw']) at 0x7fe09e55f520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:18.600622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1a7c1-9d4c-4470-a6eb-f0bf1c150b93 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.600910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1a7c1-9d4c-4470-a6eb-f0bf1c150b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.601189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1a7c1-9d4c-4470-a6eb-f0bf1c150b93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.613689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1a7c1-9d4c-4470-a6eb-f0bf1c150b93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:18.615513 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1a7c1-9d4c-4470-a6eb-f0bf1c150b93 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:18.631818 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-85f1a7c1-9d4c-4470-a6eb-f0bf1c150b93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:18.633369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 593/1186] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:18.638999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58756e-f2bd-4214-90e2-f3e5fcdae077 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:18.648207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58756e-f2bd-4214-90e2-f3e5fcdae077 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:18.652829 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340ad44-e59d-4635-a520-05b41bd353d9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ie9N2u0SRIqy0e8mjc6VUw, audit_chain_id=['Ie9N2u0SRIqy0e8mjc6VUw']) at 0x7fe09e3f8fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:18.653409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340ad44-e59d-4635-a520-05b41bd353d9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.653699 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340ad44-e59d-4635-a520-05b41bd353d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.653981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340ad44-e59d-4635-a520-05b41bd353d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.654662 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340ad44-e59d-4635-a520-05b41bd353d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:18.654963 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340ad44-e59d-4635-a520-05b41bd353d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:18.656565 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340ad44-e59d-4635-a520-05b41bd353d9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:18.669103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 594/1187] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:18.674508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1a7c1-9d4c-4470-a6eb-f0bf1c150b93 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:18.684218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1a7c1-9d4c-4470-a6eb-f0bf1c150b93 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:18.688576 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cd25f-4fbf-42e7-a6fd-8bfe272b11f4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ie9N2u0SRIqy0e8mjc6VUw, audit_chain_id=['Ie9N2u0SRIqy0e8mjc6VUw']) at 0x7fe09df3b6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:18.689281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cd25f-4fbf-42e7-a6fd-8bfe272b11f4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.689569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cd25f-4fbf-42e7-a6fd-8bfe272b11f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.689848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cd25f-4fbf-42e7-a6fd-8bfe272b11f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.698221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cd25f-4fbf-42e7-a6fd-8bfe272b11f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:18.700396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cd25f-4fbf-42e7-a6fd-8bfe272b11f4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:18.713440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-e30cd25f-4fbf-42e7-a6fd-8bfe272b11f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:47:18.714472 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 594/1188] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:47:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:18.720024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340ad44-e59d-4635-a520-05b41bd353d9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:18.729652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340ad44-e59d-4635-a520-05b41bd353d9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:18.733957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25f239-e9de-4f81-ab36-2918caaa276d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ie9N2u0SRIqy0e8mjc6VUw, audit_chain_id=['Ie9N2u0SRIqy0e8mjc6VUw']) at 0x7fe09e3eb760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:18.734528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25f239-e9de-4f81-ab36-2918caaa276d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.734816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25f239-e9de-4f81-ab36-2918caaa276d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.735099 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25f239-e9de-4f81-ab36-2918caaa276d admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.735860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25f239-e9de-4f81-ab36-2918caaa276d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:18.736164 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25f239-e9de-4f81-ab36-2918caaa276d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:18.737960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25f239-e9de-4f81-ab36-2918caaa276d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:18.750814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 595/1189] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:47:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:18.756368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cd25f-4fbf-42e7-a6fd-8bfe272b11f4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:18.765227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cd25f-4fbf-42e7-a6fd-8bfe272b11f4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:18.769343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e28ddb-578a-48c4-8325-91e916a253a9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ie9N2u0SRIqy0e8mjc6VUw, audit_chain_id=['Ie9N2u0SRIqy0e8mjc6VUw']) at 0x7fe09dec1df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:18.770127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e28ddb-578a-48c4-8325-91e916a253a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.770413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e28ddb-578a-48c4-8325-91e916a253a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.770692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e28ddb-578a-48c4-8325-91e916a253a9 admin admin] PATH_INFO: `/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/2f330acd453f445ea31acf9fc43b53ad/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.772469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e28ddb-578a-48c4-8325-91e916a253a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65bccb1addf41ecb44dfe73b3d94bea, user_id=2f330acd453f445ea31acf9fc43b53ad, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:18.775592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e28ddb-578a-48c4-8325-91e916a253a9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:18.852618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 595/1190] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Feb 28 18:47:18 2022] PUT /identity/v3/projects/a65bccb1addf41ecb44dfe73b3d94bea/users/2f330acd453f445ea31acf9fc43b53ad/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:20.988841 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aea6b-2df2-4bda-a03b-0dd29713ece6 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:20.989370 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aea6b-2df2-4bda-a03b-0dd29713ece6 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:20.989370 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980aea6b-2df2-4bda-a03b-0dd29713ece6 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:20.991062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 596/1191] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:20.997094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee2f3-5646-452b-b497-692e169dad6e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:20.997505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee2f3-5646-452b-b497-692e169dad6e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:20.997661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee2f3-5646-452b-b497-692e169dad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.019807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f63ee2f3-5646-452b-b497-692e169dad6e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:21.020937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f63ee2f3-5646-452b-b497-692e169dad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:21.083904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 596/1192] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:47:20 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:21.108120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aea6b-2df2-4bda-a03b-0dd29713ece6 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.120224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980aea6b-2df2-4bda-a03b-0dd29713ece6 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.124372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd1e0f-6074-4333-a506-ba3952a3c826 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09e17faf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.125077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd1e0f-6074-4333-a506-ba3952a3c826 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.125362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd1e0f-6074-4333-a506-ba3952a3c826 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.125680 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd1e0f-6074-4333-a506-ba3952a3c826 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.138144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd1e0f-6074-4333-a506-ba3952a3c826 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 18:47:21.144386 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-90dd1e0f-6074-4333-a506-ba3952a3c826 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:47:21.145450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 597/1193] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:21.152005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ee2f3-5646-452b-b497-692e169dad6e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.160531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ee2f3-5646-452b-b497-692e169dad6e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.165675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2022891-6533-4ff0-ade6-70269288a897 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09e1e6520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.166247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2022891-6533-4ff0-ade6-70269288a897 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.166539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2022891-6533-4ff0-ade6-70269288a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.166814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2022891-6533-4ff0-ade6-70269288a897 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.167555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2022891-6533-4ff0-ade6-70269288a897 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:21.167855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2022891-6533-4ff0-ade6-70269288a897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.169414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2022891-6533-4ff0-ade6-70269288a897 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:21.177676 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 597/1194] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:21.183189 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd1e0f-6074-4333-a506-ba3952a3c826 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.192788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd1e0f-6074-4333-a506-ba3952a3c826 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.197365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e757-166d-475e-b8c9-c68eb86700fc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09e1f3f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.198057 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e757-166d-475e-b8c9-c68eb86700fc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.198341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e757-166d-475e-b8c9-c68eb86700fc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.198620 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e757-166d-475e-b8c9-c68eb86700fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.209908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e757-166d-475e-b8c9-c68eb86700fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.212251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e757-166d-475e-b8c9-c68eb86700fc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:21.229186 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-c440e757-166d-475e-b8c9-c68eb86700fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:21.230229 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 598/1195] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:21.235870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2022891-6533-4ff0-ade6-70269288a897 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.245560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2022891-6533-4ff0-ade6-70269288a897 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.250053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfdc82-d7c8-441c-a9b2-2c0d48ee5a1a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09e705fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.250632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfdc82-d7c8-441c-a9b2-2c0d48ee5a1a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.250921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfdc82-d7c8-441c-a9b2-2c0d48ee5a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.251239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfdc82-d7c8-441c-a9b2-2c0d48ee5a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.251919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfdc82-d7c8-441c-a9b2-2c0d48ee5a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:21.252218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfdc82-d7c8-441c-a9b2-2c0d48ee5a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.253812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfdc82-d7c8-441c-a9b2-2c0d48ee5a1a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:21.267756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 598/1196] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:21.273293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e757-166d-475e-b8c9-c68eb86700fc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.282692 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e757-166d-475e-b8c9-c68eb86700fc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.287014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356b64-a5ba-4196-b223-0be383e144a1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09e1d7f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.287787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356b64-a5ba-4196-b223-0be383e144a1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.288046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356b64-a5ba-4196-b223-0be383e144a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.288326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356b64-a5ba-4196-b223-0be383e144a1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.300906 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb356b64-a5ba-4196-b223-0be383e144a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.302924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb356b64-a5ba-4196-b223-0be383e144a1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:21.321661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-fb356b64-a5ba-4196-b223-0be383e144a1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:47:21.322737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 599/1197] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:21.328865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfdc82-d7c8-441c-a9b2-2c0d48ee5a1a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.338273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfdc82-d7c8-441c-a9b2-2c0d48ee5a1a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.342564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71b72b-65bb-4998-a900-700028eef0bc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09e118c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.343178 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71b72b-65bb-4998-a900-700028eef0bc admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.343467 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71b72b-65bb-4998-a900-700028eef0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.343745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71b72b-65bb-4998-a900-700028eef0bc admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.344518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71b72b-65bb-4998-a900-700028eef0bc admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:21.344815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71b72b-65bb-4998-a900-700028eef0bc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.346608 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71b72b-65bb-4998-a900-700028eef0bc admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:21.374819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 599/1198] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:21.380420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356b64-a5ba-4196-b223-0be383e144a1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.390768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356b64-a5ba-4196-b223-0be383e144a1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.394954 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7790d-05ac-48b2-94f8-21dc7b058114 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09df25ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.395598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7790d-05ac-48b2-94f8-21dc7b058114 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.395882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7790d-05ac-48b2-94f8-21dc7b058114 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.396162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7790d-05ac-48b2-94f8-21dc7b058114 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.403886 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7790d-05ac-48b2-94f8-21dc7b058114 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.405595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7790d-05ac-48b2-94f8-21dc7b058114 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:21.415248 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 600/1199] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:21.421046 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71b72b-65bb-4998-a900-700028eef0bc admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.430937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71b72b-65bb-4998-a900-700028eef0bc admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.435079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201eb2e-bbdf-4b80-8efe-9fed3a3826f8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09e1a1d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.435813 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201eb2e-bbdf-4b80-8efe-9fed3a3826f8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.436097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201eb2e-bbdf-4b80-8efe-9fed3a3826f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.436372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201eb2e-bbdf-4b80-8efe-9fed3a3826f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.447706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201eb2e-bbdf-4b80-8efe-9fed3a3826f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.449753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201eb2e-bbdf-4b80-8efe-9fed3a3826f8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:21.466109 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-a201eb2e-bbdf-4b80-8efe-9fed3a3826f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:47:21.467131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 600/1200] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:47:21.474111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7790d-05ac-48b2-94f8-21dc7b058114 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.483535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7790d-05ac-48b2-94f8-21dc7b058114 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.487890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d13cf7-129e-40c0-b7df-2bbfc49782a9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09df25fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.488465 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d13cf7-129e-40c0-b7df-2bbfc49782a9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.488757 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d13cf7-129e-40c0-b7df-2bbfc49782a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.489037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d13cf7-129e-40c0-b7df-2bbfc49782a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.489710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d13cf7-129e-40c0-b7df-2bbfc49782a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:21.490004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d13cf7-129e-40c0-b7df-2bbfc49782a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.491709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d13cf7-129e-40c0-b7df-2bbfc49782a9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:21.504790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 601/1201] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:21.510239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201eb2e-bbdf-4b80-8efe-9fed3a3826f8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.519389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201eb2e-bbdf-4b80-8efe-9fed3a3826f8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.523636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261b17e-c858-4a4d-bda1-ed8cbe24f254 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09ded17f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.524414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261b17e-c858-4a4d-bda1-ed8cbe24f254 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.524710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261b17e-c858-4a4d-bda1-ed8cbe24f254 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.524988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261b17e-c858-4a4d-bda1-ed8cbe24f254 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.533275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261b17e-c858-4a4d-bda1-ed8cbe24f254 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.535287 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261b17e-c858-4a4d-bda1-ed8cbe24f254 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:21.549155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING keystone.server.flask.application [None req-7261b17e-c858-4a4d-bda1-ed8cbe24f254 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:47:21.550223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 601/1202] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:21.556563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d13cf7-129e-40c0-b7df-2bbfc49782a9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.565862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d13cf7-129e-40c0-b7df-2bbfc49782a9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.570125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e8f78-53d4-42a3-870f-075139c9e5c6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09e57ef40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.570692 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e8f78-53d4-42a3-870f-075139c9e5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.571079 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e8f78-53d4-42a3-870f-075139c9e5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.571339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e8f78-53d4-42a3-870f-075139c9e5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.572076 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e8f78-53d4-42a3-870f-075139c9e5c6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:21.572377 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e8f78-53d4-42a3-870f-075139c9e5c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.574439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e8f78-53d4-42a3-870f-075139c9e5c6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:21.587183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 602/1203] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:21.593059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261b17e-c858-4a4d-bda1-ed8cbe24f254 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.603060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261b17e-c858-4a4d-bda1-ed8cbe24f254 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.607306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfac623-1be9-42ca-84a9-da75e054e537 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjeUMRhAQJueYf9gtjU_KQ, audit_chain_id=['QjeUMRhAQJueYf9gtjU_KQ']) at 0x7fe09ded1dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.607883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfac623-1be9-42ca-84a9-da75e054e537 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.608170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfac623-1be9-42ca-84a9-da75e054e537 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.608452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfac623-1be9-42ca-84a9-da75e054e537 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.609222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfac623-1be9-42ca-84a9-da75e054e537 admin admin] RBAC: Adding query filter params (role.id=bf363c82fad34c8c9be7cee42a8f474c, scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea, user.id=2f330acd453f445ea31acf9fc43b53ad) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:21.609525 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfac623-1be9-42ca-84a9-da75e054e537 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.611340 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfac623-1be9-42ca-84a9-da75e054e537 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:21.617787 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 602/1204] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/role_assignments?user.id=2f330acd453f445ea31acf9fc43b53ad&scope.project.id=a65bccb1addf41ecb44dfe73b3d94bea&role.id=bf363c82fad34c8c9be7cee42a8f474c => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:23.781366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93da10f-6aed-463f-af37-489b33031ce2 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:23.781940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93da10f-6aed-463f-af37-489b33031ce2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:23.781940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93da10f-6aed-463f-af37-489b33031ce2 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:23.783639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 603/1205] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:23.788720 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eba087-3f6b-48c2-87ef-16c66d222e96 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:23.789618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eba087-3f6b-48c2-87ef-16c66d222e96 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:23.789772 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eba087-3f6b-48c2-87ef-16c66d222e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:23.812053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-b0eba087-3f6b-48c2-87ef-16c66d222e96 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:23.813192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b0eba087-3f6b-48c2-87ef-16c66d222e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:23.820266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 603/1206] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:47:23 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:23.842648 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93da10f-6aed-463f-af37-489b33031ce2 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:23.855143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93da10f-6aed-463f-af37-489b33031ce2 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:23.859237 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2699d7b-9a3d-4ae8-b511-a7350416ddf1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wMCI8dUjQqaVSOXVeCfbbA, audit_chain_id=['wMCI8dUjQqaVSOXVeCfbbA']) at 0x7fe09e1df220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:23.859950 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699d7b-9a3d-4ae8-b511-a7350416ddf1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:23.860243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699d7b-9a3d-4ae8-b511-a7350416ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:23.860527 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699d7b-9a3d-4ae8-b511-a7350416ddf1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:23.861150 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2699d7b-9a3d-4ae8-b511-a7350416ddf1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:23.862728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2699d7b-9a3d-4ae8-b511-a7350416ddf1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:23.873693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-b2699d7b-9a3d-4ae8-b511-a7350416ddf1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 18:47:23.874723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 604/1207] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Feb 28 18:47:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:23.880455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eba087-3f6b-48c2-87ef-16c66d222e96 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:23.889504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eba087-3f6b-48c2-87ef-16c66d222e96 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:23.893764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c438d3b-c316-41ed-a197-244914c2af99 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wMCI8dUjQqaVSOXVeCfbbA, audit_chain_id=['wMCI8dUjQqaVSOXVeCfbbA']) at 0x7fe09e14e5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:23.894353 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438d3b-c316-41ed-a197-244914c2af99 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:23.894650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438d3b-c316-41ed-a197-244914c2af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:23.894939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c438d3b-c316-41ed-a197-244914c2af99 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:23.895649 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c438d3b-c316-41ed-a197-244914c2af99 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:23.895957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c438d3b-c316-41ed-a197-244914c2af99 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:23.897533 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c438d3b-c316-41ed-a197-244914c2af99 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:23.902761 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 604/1208] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Feb 28 18:47:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:23.908074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2699d7b-9a3d-4ae8-b511-a7350416ddf1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:23.918234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2699d7b-9a3d-4ae8-b511-a7350416ddf1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:23.922476 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86298b4b-7d08-4fe1-bec2-f1f462d81d04 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wMCI8dUjQqaVSOXVeCfbbA, audit_chain_id=['wMCI8dUjQqaVSOXVeCfbbA']) at 0x7fe09e3e9730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:23.923054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86298b4b-7d08-4fe1-bec2-f1f462d81d04 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:23.923373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86298b4b-7d08-4fe1-bec2-f1f462d81d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:23.923658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86298b4b-7d08-4fe1-bec2-f1f462d81d04 admin admin] PATH_INFO: `/v3/services` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:23.924323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86298b4b-7d08-4fe1-bec2-f1f462d81d04 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:23.924624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86298b4b-7d08-4fe1-bec2-f1f462d81d04 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:23.926180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86298b4b-7d08-4fe1-bec2-f1f462d81d04 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:23.931002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 605/1209] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Feb 28 18:47:23 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:26.031300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0864a6-eb20-4e7d-9b5c-12f9a0148db2 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:26.031824 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0864a6-eb20-4e7d-9b5c-12f9a0148db2 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:26.031914 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0864a6-eb20-4e7d-9b5c-12f9a0148db2 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:26.033539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 605/1210] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:26.039226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f6c54-53eb-4fd4-9d54-3b550aa518a2 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:26.039663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f6c54-53eb-4fd4-9d54-3b550aa518a2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:26.039952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f6c54-53eb-4fd4-9d54-3b550aa518a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:26.063638 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d66f6c54-53eb-4fd4-9d54-3b550aa518a2 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:26.064774 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d66f6c54-53eb-4fd4-9d54-3b550aa518a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:26.072001 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 606/1211] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:47:26 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:26.094940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0864a6-eb20-4e7d-9b5c-12f9a0148db2 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:26.107199 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0864a6-eb20-4e7d-9b5c-12f9a0148db2 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:26.111307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa872f-6c60-4cf3-b6d0-ccc2c5fd829b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jsz8OLbqShequ-kP8_LTeQ, audit_chain_id=['Jsz8OLbqShequ-kP8_LTeQ']) at 0x7fe09e15eaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:26.111885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa872f-6c60-4cf3-b6d0-ccc2c5fd829b admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:26.112178 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa872f-6c60-4cf3-b6d0-ccc2c5fd829b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:26.112465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa872f-6c60-4cf3-b6d0-ccc2c5fd829b admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:26.113138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa872f-6c60-4cf3-b6d0-ccc2c5fd829b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:26.114713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa872f-6c60-4cf3-b6d0-ccc2c5fd829b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:26.200802 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 606/1212] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Feb 28 18:47:26 2022] POST /identity/v3/services => generated 246 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:47:28.421827 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c1852-4780-4909-99dd-1890e616cd56 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:28.422369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c1852-4780-4909-99dd-1890e616cd56 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:28.422481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c1852-4780-4909-99dd-1890e616cd56 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:28.424114 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 607/1213] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:28.429706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acecf5-3dc2-486f-8c92-d8796c89e393 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:28.431145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acecf5-3dc2-486f-8c92-d8796c89e393 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:28.431145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acecf5-3dc2-486f-8c92-d8796c89e393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:28.452774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a9acecf5-3dc2-486f-8c92-d8796c89e393 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:28.453910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a9acecf5-3dc2-486f-8c92-d8796c89e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:28.471997 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 607/1214] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:47:28 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:28.495541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c1852-4780-4909-99dd-1890e616cd56 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:28.507375 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c1852-4780-4909-99dd-1890e616cd56 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:28.511440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63ad80-cf82-442d-be0a-78b943c4b0cc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Y3hempRhQ3iQ1WA4CiJrIg, audit_chain_id=['Y3hempRhQ3iQ1WA4CiJrIg']) at 0x7fe09e1b0a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:28.512151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63ad80-cf82-442d-be0a-78b943c4b0cc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:28.512438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63ad80-cf82-442d-be0a-78b943c4b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:28.512715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63ad80-cf82-442d-be0a-78b943c4b0cc admin admin] PATH_INFO: `/v3/services/placement` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:28.513334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63ad80-cf82-442d-be0a-78b943c4b0cc admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:28.514940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63ad80-cf82-442d-be0a-78b943c4b0cc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:28.525790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-7e63ad80-cf82-442d-be0a-78b943c4b0cc admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 18:47:28.526879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 608/1215] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Feb 28 18:47:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:28.532662 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acecf5-3dc2-486f-8c92-d8796c89e393 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:28.541912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acecf5-3dc2-486f-8c92-d8796c89e393 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:28.546182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57643b1-c8aa-4113-ae4f-a4a1e5030f7a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Y3hempRhQ3iQ1WA4CiJrIg, audit_chain_id=['Y3hempRhQ3iQ1WA4CiJrIg']) at 0x7fe09eacf9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:28.546765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57643b1-c8aa-4113-ae4f-a4a1e5030f7a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:28.547054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57643b1-c8aa-4113-ae4f-a4a1e5030f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:28.547366 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57643b1-c8aa-4113-ae4f-a4a1e5030f7a admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:28.548029 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57643b1-c8aa-4113-ae4f-a4a1e5030f7a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:28.548329 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57643b1-c8aa-4113-ae4f-a4a1e5030f7a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:28.549893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57643b1-c8aa-4113-ae4f-a4a1e5030f7a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:28.555081 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 608/1216] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Feb 28 18:47:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:28.560732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63ad80-cf82-442d-be0a-78b943c4b0cc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:28.569771 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63ad80-cf82-442d-be0a-78b943c4b0cc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:28.574496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec5f6d-5242-4826-8ea3-13c98b888e23 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Y3hempRhQ3iQ1WA4CiJrIg, audit_chain_id=['Y3hempRhQ3iQ1WA4CiJrIg']) at 0x7fe09e1df310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:28.575064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec5f6d-5242-4826-8ea3-13c98b888e23 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:28.575382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec5f6d-5242-4826-8ea3-13c98b888e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:28.575664 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec5f6d-5242-4826-8ea3-13c98b888e23 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:28.576401 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec5f6d-5242-4826-8ea3-13c98b888e23 admin admin] RBAC: Adding query filter params (interface=public, service_id=f12d8b0205ed4293bc97fb26ebad68e4, region_id=RegionOne) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:28.576705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec5f6d-5242-4826-8ea3-13c98b888e23 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:28.578242 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec5f6d-5242-4826-8ea3-13c98b888e23 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:28.583274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 609/1217] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Feb 28 18:47:28 2022] GET /identity/v3/endpoints?service_id=f12d8b0205ed4293bc97fb26ebad68e4&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:47:28.589033 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57643b1-c8aa-4113-ae4f-a4a1e5030f7a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:28.597890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57643b1-c8aa-4113-ae4f-a4a1e5030f7a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:28.602682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80ec8d-2902-4d8b-99c7-6eed0625e7d7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Y3hempRhQ3iQ1WA4CiJrIg, audit_chain_id=['Y3hempRhQ3iQ1WA4CiJrIg']) at 0x7fe09e212160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:28.603278 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ec8d-2902-4d8b-99c7-6eed0625e7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:28.603572 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ec8d-2902-4d8b-99c7-6eed0625e7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:28.603858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ec8d-2902-4d8b-99c7-6eed0625e7d7 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:28.604491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80ec8d-2902-4d8b-99c7-6eed0625e7d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:28.606022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80ec8d-2902-4d8b-99c7-6eed0625e7d7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:28.613141 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 609/1218] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:47:28 2022] GET /identity/v3/services => generated 2430 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:47:30.720531 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542d6c-cf50-45fb-aff5-685c40d30b93 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:30.721164 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542d6c-cf50-45fb-aff5-685c40d30b93 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:30.721164 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542d6c-cf50-45fb-aff5-685c40d30b93 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:30.722798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 610/1219] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:30.729423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237db31-20e7-4828-9d29-d2719ad28964 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:30.729889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237db31-20e7-4828-9d29-d2719ad28964 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:30.730001 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237db31-20e7-4828-9d29-d2719ad28964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:30.759270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f237db31-20e7-4828-9d29-d2719ad28964 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:30.760435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f237db31-20e7-4828-9d29-d2719ad28964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:30.767577 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 610/1220] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:47:30 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:30.794222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82542d6c-cf50-45fb-aff5-685c40d30b93 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:30.807014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82542d6c-cf50-45fb-aff5-685c40d30b93 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:30.811148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475acf-4b2f-46a5-af3d-390ac5cbbb86 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=z-fKZZSwR7i7fq_0l5C3fA, audit_chain_id=['z-fKZZSwR7i7fq_0l5C3fA']) at 0x7fe09e198040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:30.811861 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475acf-4b2f-46a5-af3d-390ac5cbbb86 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:30.812149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475acf-4b2f-46a5-af3d-390ac5cbbb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:30.812427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24475acf-4b2f-46a5-af3d-390ac5cbbb86 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:30.813044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24475acf-4b2f-46a5-af3d-390ac5cbbb86 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:30.814612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24475acf-4b2f-46a5-af3d-390ac5cbbb86 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:30.825628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING keystone.server.flask.application [None req-24475acf-4b2f-46a5-af3d-390ac5cbbb86 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 18:47:30.826695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 611/1221] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Feb 28 18:47:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:47:30.833068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237db31-20e7-4828-9d29-d2719ad28964 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:30.842844 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237db31-20e7-4828-9d29-d2719ad28964 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:30.847449 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0278cd-78cc-42fb-93ea-6bcc8decc022 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=z-fKZZSwR7i7fq_0l5C3fA, audit_chain_id=['z-fKZZSwR7i7fq_0l5C3fA']) at 0x7fe09e155550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:30.848047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0278cd-78cc-42fb-93ea-6bcc8decc022 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:30.848341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0278cd-78cc-42fb-93ea-6bcc8decc022 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:30.848619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0278cd-78cc-42fb-93ea-6bcc8decc022 admin admin] PATH_INFO: `/v3/services` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:30.849297 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0278cd-78cc-42fb-93ea-6bcc8decc022 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:47:30.849601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0278cd-78cc-42fb-93ea-6bcc8decc022 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:30.851901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0278cd-78cc-42fb-93ea-6bcc8decc022 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:30.857241 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 611/1222] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Feb 28 18:47:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:47:30.863160 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475acf-4b2f-46a5-af3d-390ac5cbbb86 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:30.873937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24475acf-4b2f-46a5-af3d-390ac5cbbb86 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:30.878687 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80091e4-1f90-4391-828d-5c80855b4048 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=z-fKZZSwR7i7fq_0l5C3fA, audit_chain_id=['z-fKZZSwR7i7fq_0l5C3fA']) at 0x7fe09df25be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:30.879300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80091e4-1f90-4391-828d-5c80855b4048 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:30.879589 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80091e4-1f90-4391-828d-5c80855b4048 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:30.879870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80091e4-1f90-4391-828d-5c80855b4048 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:30.880557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80091e4-1f90-4391-828d-5c80855b4048 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:30.882129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80091e4-1f90-4391-828d-5c80855b4048 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:47:30.962025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 612/1223] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Feb 28 18:47:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:39.059322 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fba7b9-5abf-45a6-9b38-0841b86a23bd None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:39.059938 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fba7b9-5abf-45a6-9b38-0841b86a23bd None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:39.059938 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fba7b9-5abf-45a6-9b38-0841b86a23bd None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:39.061545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 612/1224] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:52:39.067460 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7742882-f638-496b-b3e1-2b6cc99dff57 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:39.067938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7742882-f638-496b-b3e1-2b6cc99dff57 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:39.068045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7742882-f638-496b-b3e1-2b6cc99dff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:39.164137 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d7742882-f638-496b-b3e1-2b6cc99dff57 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:39.165505 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d7742882-f638-496b-b3e1-2b6cc99dff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:39.287278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 613/1225] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:52:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:39.314774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fba7b9-5abf-45a6-9b38-0841b86a23bd None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:39.316704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-39fba7b9-5abf-45a6-9b38-0841b86a23bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:39.470884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fba7b9-5abf-45a6-9b38-0841b86a23bd None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:39.580715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51930d20-7c78-480a-a0bf-49dab3b818b4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nsOC0M5mQ-e6jyaA8OinzA, audit_chain_id=['nsOC0M5mQ-e6jyaA8OinzA']) at 0x7fe09df3b6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:39.581582 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51930d20-7c78-480a-a0bf-49dab3b818b4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:39.582020 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51930d20-7c78-480a-a0bf-49dab3b818b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:39.582456 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51930d20-7c78-480a-a0bf-49dab3b818b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:39.583340 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51930d20-7c78-480a-a0bf-49dab3b818b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:39.585336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51930d20-7c78-480a-a0bf-49dab3b818b4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:52:39.607670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 613/1226] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:52:39 2022] GET /identity/v3/projects => generated 2553 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:41.866289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42036a0-3f90-4f04-981c-44f1161afcff None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:41.866831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42036a0-3f90-4f04-981c-44f1161afcff None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:41.866831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42036a0-3f90-4f04-981c-44f1161afcff None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:41.868573 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 614/1227] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:52:41.874812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae393b08-b4d3-4295-a194-c0d5e5d5ad15 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:41.875336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae393b08-b4d3-4295-a194-c0d5e5d5ad15 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:41.875432 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae393b08-b4d3-4295-a194-c0d5e5d5ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:41.977175 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-ae393b08-b4d3-4295-a194-c0d5e5d5ad15 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:41.978367 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ae393b08-b4d3-4295-a194-c0d5e5d5ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:42.093337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 614/1228] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:52:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:42.145563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6680-0a02-4b83-b20c-445e3d99ab87 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.145864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6680-0a02-4b83-b20c-445e3d99ab87 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.147256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6680-0a02-4b83-b20c-445e3d99ab87 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.148591 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 615/1229] 10.222.0.21 () {54 vars in 963 bytes} [Mon Feb 28 18:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:52:42.155234 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc4e0-0415-40b1-afbb-5a31061c6436 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.155698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc4e0-0415-40b1-afbb-5a31061c6436 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.155981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc4e0-0415-40b1-afbb-5a31061c6436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.278411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3cbbc4e0-0415-40b1-afbb-5a31061c6436 None None] MFA Rules not processed for user `65a9c92fb5144e3dacc922eede1131fd`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:42.279876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3cbbc4e0-0415-40b1-afbb-5a31061c6436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:42.383714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 615/1230] 10.222.0.21 () {58 vars in 1060 bytes} [Mon Feb 28 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:42.393395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6680-0a02-4b83-b20c-445e3d99ab87 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:42.394847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-012b6680-0a02-4b83-b20c-445e3d99ab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:42.522766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6680-0a02-4b83-b20c-445e3d99ab87 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:42.615433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79d9b1-b755-4277-acf5-76add41c2b1c service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09df1aa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:42.616022 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d9b1-b755-4277-acf5-76add41c2b1c service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.616367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d9b1-b755-4277-acf5-76add41c2b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.616581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d9b1-b755-4277-acf5-76add41c2b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.618184 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-db79d9b1-b755-4277-acf5-76add41c2b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:42.752836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79d9b1-b755-4277-acf5-76add41c2b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:42.754284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79d9b1-b755-4277-acf5-76add41c2b1c service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:52:42.775482 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 616/1231] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:45.213946 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b6cc-05e7-450c-853a-875cc994619c None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:45.214479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b6cc-05e7-450c-853a-875cc994619c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:45.214603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b6cc-05e7-450c-853a-875cc994619c None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:45.217049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 616/1232] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:52:45.222333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470891-9253-4ce7-bc61-25e0ea2ae69b None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:45.222776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470891-9253-4ce7-bc61-25e0ea2ae69b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:45.222903 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470891-9253-4ce7-bc61-25e0ea2ae69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:45.316767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d0470891-9253-4ce7-bc61-25e0ea2ae69b None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:45.317951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d0470891-9253-4ce7-bc61-25e0ea2ae69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:45.425801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 617/1233] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:52:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:45.465903 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b6cc-05e7-450c-853a-875cc994619c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:45.467462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7ac7b6cc-05e7-450c-853a-875cc994619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:45.590266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b6cc-05e7-450c-853a-875cc994619c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:45.677808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048aca3-3d9b-420b-bedd-75352c4b7eb5 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e1dda90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:45.678397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048aca3-3d9b-420b-bedd-75352c4b7eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:45.678684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048aca3-3d9b-420b-bedd-75352c4b7eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:45.678962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048aca3-3d9b-420b-bedd-75352c4b7eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:45.680545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6048aca3-3d9b-420b-bedd-75352c4b7eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:45.806452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048aca3-3d9b-420b-bedd-75352c4b7eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:45.807898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048aca3-3d9b-420b-bedd-75352c4b7eb5 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:52:45.829641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 617/1234] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:48.513961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7962-200d-4f9d-bb46-ec1697c0f293 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:48.514554 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7962-200d-4f9d-bb46-ec1697c0f293 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:48.514554 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7962-200d-4f9d-bb46-ec1697c0f293 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:48.516236 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 618/1235] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:52:48.521506 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3586ec1-1a63-407b-b6c4-bb8fb358bd26 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:48.521905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3586ec1-1a63-407b-b6c4-bb8fb358bd26 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:48.522080 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3586ec1-1a63-407b-b6c4-bb8fb358bd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:48.610580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a3586ec1-1a63-407b-b6c4-bb8fb358bd26 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:48.611932 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a3586ec1-1a63-407b-b6c4-bb8fb358bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:48.731743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 618/1236] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:52:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:48.766945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce7962-200d-4f9d-bb46-ec1697c0f293 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:48.768448 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f7ce7962-200d-4f9d-bb46-ec1697c0f293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:48.912389 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce7962-200d-4f9d-bb46-ec1697c0f293 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.020872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e4500-24d9-4bf4-aba7-6d59e768b58f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Y_qJR7xlRu-J2cvJPkyepw, audit_chain_id=['Y_qJR7xlRu-J2cvJPkyepw']) at 0x7fe09e162a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.021580 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e4500-24d9-4bf4-aba7-6d59e768b58f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.021862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e4500-24d9-4bf4-aba7-6d59e768b58f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.022141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e4500-24d9-4bf4-aba7-6d59e768b58f admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.033541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e4500-24d9-4bf4-aba7-6d59e768b58f admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.035638 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e4500-24d9-4bf4-aba7-6d59e768b58f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:52:49.037287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 619/1237] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:52:48 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:52:49.049981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3586ec1-1a63-407b-b6c4-bb8fb358bd26 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.051147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a3586ec1-1a63-407b-b6c4-bb8fb358bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:49.157014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3586ec1-1a63-407b-b6c4-bb8fb358bd26 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.241165 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8883c-143c-49e9-b11f-739eb4405705 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e1ae7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.241770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8883c-143c-49e9-b11f-739eb4405705 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.242056 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8883c-143c-49e9-b11f-739eb4405705 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.242333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8883c-143c-49e9-b11f-739eb4405705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.243926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c6b8883c-143c-49e9-b11f-739eb4405705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:49.381666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8883c-143c-49e9-b11f-739eb4405705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.383023 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8883c-143c-49e9-b11f-739eb4405705 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:52:49.405554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 619/1238] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:49 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:52.439705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa049-2bd9-4e9c-ac06-6a7310babfed None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.440274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa049-2bd9-4e9c-ac06-6a7310babfed None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.440274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa049-2bd9-4e9c-ac06-6a7310babfed None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.441964 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 620/1239] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:52:52.447695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9180-fd1e-49c9-b582-edc50e55c9fb None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.448159 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9180-fd1e-49c9-b582-edc50e55c9fb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.448309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9180-fd1e-49c9-b582-edc50e55c9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.541981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-367a9180-fd1e-49c9-b582-edc50e55c9fb None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:52.543985 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-367a9180-fd1e-49c9-b582-edc50e55c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:52.653807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 620/1240] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:52:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:52.688151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa049-2bd9-4e9c-ac06-6a7310babfed None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:52.689981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-2b3aa049-2bd9-4e9c-ac06-6a7310babfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:52.834355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa049-2bd9-4e9c-ac06-6a7310babfed None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:52.945978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8405187-b9a7-4a67-a024-636965bd1a12 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YFWHEGIySN-sCYut5O0fIA, audit_chain_id=['YFWHEGIySN-sCYut5O0fIA']) at 0x7fe09e887070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:52.946698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405187-b9a7-4a67-a024-636965bd1a12 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.946985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405187-b9a7-4a67-a024-636965bd1a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.947290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405187-b9a7-4a67-a024-636965bd1a12 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.959860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8405187-b9a7-4a67-a024-636965bd1a12 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:52.961913 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8405187-b9a7-4a67-a024-636965bd1a12 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:52:52.963592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 621/1241] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:52:52 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:52:52.989974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506b930-4416-416d-a3a7-c212de4f2b93 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.990268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506b930-4416-416d-a3a7-c212de4f2b93 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.990554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506b930-4416-416d-a3a7-c212de4f2b93 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.992292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 621/1242] 10.222.0.21 () {54 vars in 963 bytes} [Mon Feb 28 18:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:52:52.999096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df461-68bd-4c3d-8d5d-629f472eac85 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.999424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df461-68bd-4c3d-8d5d-629f472eac85 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.999715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df461-68bd-4c3d-8d5d-629f472eac85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:53.104264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-489df461-68bd-4c3d-8d5d-629f472eac85 None None] MFA Rules not processed for user `65a9c92fb5144e3dacc922eede1131fd`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:53.105505 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-489df461-68bd-4c3d-8d5d-629f472eac85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:53.193901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 622/1243] 10.222.0.21 () {58 vars in 1060 bytes} [Mon Feb 28 18:52:52 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:53.204913 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506b930-4416-416d-a3a7-c212de4f2b93 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:53.206329 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d506b930-4416-416d-a3a7-c212de4f2b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:53.338956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506b930-4416-416d-a3a7-c212de4f2b93 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:53.426556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85376f9b-ba5e-43f1-87de-ccb4e77da236 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e540d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:53.427163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85376f9b-ba5e-43f1-87de-ccb4e77da236 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:53.427460 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85376f9b-ba5e-43f1-87de-ccb4e77da236 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:53.427745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85376f9b-ba5e-43f1-87de-ccb4e77da236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:53.429323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-85376f9b-ba5e-43f1-87de-ccb4e77da236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:53.558929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85376f9b-ba5e-43f1-87de-ccb4e77da236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:53.560649 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85376f9b-ba5e-43f1-87de-ccb4e77da236 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:52:53.580646 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 622/1244] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:53 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:57.192805 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f479b-05b5-4a80-8b7c-1939dec1ad7f None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:57.193380 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f479b-05b5-4a80-8b7c-1939dec1ad7f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:57.193380 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f479b-05b5-4a80-8b7c-1939dec1ad7f None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:57.195055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 623/1245] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:52:57.201074 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce029f-0b4a-4710-8750-8659e49e2adf None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:57.201528 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce029f-0b4a-4710-8750-8659e49e2adf None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:57.201657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce029f-0b4a-4710-8750-8659e49e2adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:57.296374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-09ce029f-0b4a-4710-8750-8659e49e2adf None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:57.297524 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-09ce029f-0b4a-4710-8750-8659e49e2adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:57.408654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 623/1246] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:52:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:57.446864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f479b-05b5-4a80-8b7c-1939dec1ad7f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:57.448392 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-394f479b-05b5-4a80-8b7c-1939dec1ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:57.578820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f479b-05b5-4a80-8b7c-1939dec1ad7f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:57.666295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e93082-4cf2-46fc-b71c-6477237f4058 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e3f05b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:57.666882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93082-4cf2-46fc-b71c-6477237f4058 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:57.667198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93082-4cf2-46fc-b71c-6477237f4058 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:57.667477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93082-4cf2-46fc-b71c-6477237f4058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:57.669462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-78e93082-4cf2-46fc-b71c-6477237f4058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:57.795839 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e93082-4cf2-46fc-b71c-6477237f4058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:57.797202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e93082-4cf2-46fc-b71c-6477237f4058 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:52:57.817660 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 624/1247] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:57 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:00.039979 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b306470-cd8a-4a04-a335-5241788a938d None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:00.040503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b306470-cd8a-4a04-a335-5241788a938d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:00.040503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b306470-cd8a-4a04-a335-5241788a938d None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:00.042154 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 624/1248] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:00.048047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b767b-0231-4def-a652-9f61b8903e56 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:00.048508 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b767b-0231-4def-a652-9f61b8903e56 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:00.048735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b767b-0231-4def-a652-9f61b8903e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:00.140550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-ff1b767b-0231-4def-a652-9f61b8903e56 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:00.141766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ff1b767b-0231-4def-a652-9f61b8903e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:00.255303 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 625/1249] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:00.292336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b306470-cd8a-4a04-a335-5241788a938d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:00.294429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6b306470-cd8a-4a04-a335-5241788a938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:00.421290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b306470-cd8a-4a04-a335-5241788a938d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:00.516513 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd1eea-8c9b-4b9d-9063-3299d068777a service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e150d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:00.517112 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd1eea-8c9b-4b9d-9063-3299d068777a service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:00.517403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd1eea-8c9b-4b9d-9063-3299d068777a service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:00.517685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd1eea-8c9b-4b9d-9063-3299d068777a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:00.519331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b1dd1eea-8c9b-4b9d-9063-3299d068777a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:00.649487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd1eea-8c9b-4b9d-9063-3299d068777a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:00.650970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd1eea-8c9b-4b9d-9063-3299d068777a service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:00.673030 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 625/1250] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:00 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:02.896495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a79aff-3c40-4f0b-9d79-8a63b7ca4682 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:02.897037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a79aff-3c40-4f0b-9d79-8a63b7ca4682 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:02.897037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a79aff-3c40-4f0b-9d79-8a63b7ca4682 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:02.898744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 626/1251] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:02.905661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b285ed-6996-40ff-bc40-1ff604211317 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:02.906194 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b285ed-6996-40ff-bc40-1ff604211317 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:02.906459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b285ed-6996-40ff-bc40-1ff604211317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:03.015459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-e5b285ed-6996-40ff-bc40-1ff604211317 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:03.016561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e5b285ed-6996-40ff-bc40-1ff604211317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:03.142099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 626/1252] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:03.174849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a79aff-3c40-4f0b-9d79-8a63b7ca4682 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:03.176383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a1a79aff-3c40-4f0b-9d79-8a63b7ca4682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:03.331288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a79aff-3c40-4f0b-9d79-8a63b7ca4682 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:03.441756 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea158dcd-d7d8-4f23-8ecf-405dfe4c3533 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tizPsvt9SvyM2KBTS_547w, audit_chain_id=['tizPsvt9SvyM2KBTS_547w']) at 0x7fe09e922fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:03.442553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea158dcd-d7d8-4f23-8ecf-405dfe4c3533 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:03.442836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea158dcd-d7d8-4f23-8ecf-405dfe4c3533 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:03.443142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea158dcd-d7d8-4f23-8ecf-405dfe4c3533 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:03.456073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea158dcd-d7d8-4f23-8ecf-405dfe4c3533 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:03.464044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea158dcd-d7d8-4f23-8ecf-405dfe4c3533 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:03.465826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 627/1253] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:53:03 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:53:03.482692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b285ed-6996-40ff-bc40-1ff604211317 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:03.484735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e5b285ed-6996-40ff-bc40-1ff604211317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:03.615682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b285ed-6996-40ff-bc40-1ff604211317 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:03.701244 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8ba22-4f95-4b62-8609-cb349ae3cc80 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e150550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:03.701843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ba22-4f95-4b62-8609-cb349ae3cc80 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:03.702136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ba22-4f95-4b62-8609-cb349ae3cc80 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:03.702422 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ba22-4f95-4b62-8609-cb349ae3cc80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:03.704050 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6ae8ba22-4f95-4b62-8609-cb349ae3cc80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:03.837778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8ba22-4f95-4b62-8609-cb349ae3cc80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:03.839807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8ba22-4f95-4b62-8609-cb349ae3cc80 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:03.860837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 627/1254] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:06.456372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef871c27-a438-4dde-9ff1-0eb13ee052da None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:06.456974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef871c27-a438-4dde-9ff1-0eb13ee052da None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:06.456974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef871c27-a438-4dde-9ff1-0eb13ee052da None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:06.458636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 628/1255] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:06.464072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8fe7-7dc2-4806-8241-f2857db86cf4 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:06.465197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8fe7-7dc2-4806-8241-f2857db86cf4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:06.465197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8fe7-7dc2-4806-8241-f2857db86cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:06.550714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-9f0a8fe7-7dc2-4806-8241-f2857db86cf4 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:06.551923 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9f0a8fe7-7dc2-4806-8241-f2857db86cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:06.659127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 628/1256] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:06.695365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef871c27-a438-4dde-9ff1-0eb13ee052da None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:06.696812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ef871c27-a438-4dde-9ff1-0eb13ee052da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:06.824448 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef871c27-a438-4dde-9ff1-0eb13ee052da None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:06.910200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9f28c-0015-49d6-904b-ceafe031e302 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e57ef40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:06.910789 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f28c-0015-49d6-904b-ceafe031e302 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:06.911077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f28c-0015-49d6-904b-ceafe031e302 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:06.911460 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f28c-0015-49d6-904b-ceafe031e302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:06.913014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c1d9f28c-0015-49d6-904b-ceafe031e302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:07.036925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9f28c-0015-49d6-904b-ceafe031e302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:07.038364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9f28c-0015-49d6-904b-ceafe031e302 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:07.057640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 629/1257] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:09.252942 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc750101-f3cb-4033-a8f3-52a44872e9fe None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:09.253474 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc750101-f3cb-4033-a8f3-52a44872e9fe None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:09.253593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc750101-f3cb-4033-a8f3-52a44872e9fe None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:09.255230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 629/1258] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:09.260354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57b72d-ad3b-4c16-95d0-2a2d66ea5cc0 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:09.260772 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57b72d-ad3b-4c16-95d0-2a2d66ea5cc0 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:09.260944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57b72d-ad3b-4c16-95d0-2a2d66ea5cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:09.357320 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-7e57b72d-ad3b-4c16-95d0-2a2d66ea5cc0 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:09.358416 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7e57b72d-ad3b-4c16-95d0-2a2d66ea5cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:09.474352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 630/1259] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:09.516212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc750101-f3cb-4033-a8f3-52a44872e9fe None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:09.518310 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-cc750101-f3cb-4033-a8f3-52a44872e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:09.628700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc750101-f3cb-4033-a8f3-52a44872e9fe None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:09.632024 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3412bb-e1c2-48fa-91f0-1b2157275fec service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e347310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:09.632607 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3412bb-e1c2-48fa-91f0-1b2157275fec service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:09.632898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3412bb-e1c2-48fa-91f0-1b2157275fec service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:09.633182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3412bb-e1c2-48fa-91f0-1b2157275fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:09.642701 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3412bb-e1c2-48fa-91f0-1b2157275fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:09.644154 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3412bb-e1c2-48fa-91f0-1b2157275fec service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:09.653517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 630/1260] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:12.522788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ed09-fe57-4421-bc4c-11b26c554246 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:12.523384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ed09-fe57-4421-bc4c-11b26c554246 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:12.523384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ed09-fe57-4421-bc4c-11b26c554246 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:12.525136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 631/1261] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:12.531491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a0e1-1f95-445e-acbf-e8f78c226298 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:12.531957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a0e1-1f95-445e-acbf-e8f78c226298 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:12.532104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a0e1-1f95-445e-acbf-e8f78c226298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:12.555867 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-e133a0e1-1f95-445e-acbf-e8f78c226298 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:12.557031 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e133a0e1-1f95-445e-acbf-e8f78c226298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:12.564899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 631/1262] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:12.602695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03ed09-fe57-4421-bc4c-11b26c554246 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:12.614397 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03ed09-fe57-4421-bc4c-11b26c554246 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:12.617810 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9bc31-d00e-43c7-b757-bf7bed8ebbff service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e1df0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:12.618381 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9bc31-d00e-43c7-b757-bf7bed8ebbff service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:12.618668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9bc31-d00e-43c7-b757-bf7bed8ebbff service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:12.618995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9bc31-d00e-43c7-b757-bf7bed8ebbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:12.628536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9bc31-d00e-43c7-b757-bf7bed8ebbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:12.629953 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9bc31-d00e-43c7-b757-bf7bed8ebbff service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:12.638967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 632/1263] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:12 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:17.477137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557d030-bec8-41a4-8d25-ee7569a8b780 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:17.477658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557d030-bec8-41a4-8d25-ee7569a8b780 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:17.477658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557d030-bec8-41a4-8d25-ee7569a8b780 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:17.479384 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 632/1264] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:17.484990 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5811973-ba4f-4108-aa72-aaa4de2d6d08 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:17.485535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5811973-ba4f-4108-aa72-aaa4de2d6d08 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:17.485624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5811973-ba4f-4108-aa72-aaa4de2d6d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:17.508373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c5811973-ba4f-4108-aa72-aaa4de2d6d08 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:17.509523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c5811973-ba4f-4108-aa72-aaa4de2d6d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:17.517787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 633/1265] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:17.558507 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557d030-bec8-41a4-8d25-ee7569a8b780 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:17.569308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557d030-bec8-41a4-8d25-ee7569a8b780 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:17.572697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d5640-d904-4123-b5f6-bb8577a2ca0d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e4f3940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:17.574587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d5640-d904-4123-b5f6-bb8577a2ca0d service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:17.574587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d5640-d904-4123-b5f6-bb8577a2ca0d service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:17.574783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d5640-d904-4123-b5f6-bb8577a2ca0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:17.583562 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d5640-d904-4123-b5f6-bb8577a2ca0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:17.584981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d5640-d904-4123-b5f6-bb8577a2ca0d service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:17.594185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 633/1266] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:21.111786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cc9ab-b1de-4856-a5f5-b7841b6674b4 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:21.112659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cc9ab-b1de-4856-a5f5-b7841b6674b4 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:21.112833 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cc9ab-b1de-4856-a5f5-b7841b6674b4 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:21.114934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 634/1267] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:21.120225 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba9667-ad44-4b70-95db-e9aaa82c0f01 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:21.120728 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba9667-ad44-4b70-95db-e9aaa82c0f01 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:21.120828 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba9667-ad44-4b70-95db-e9aaa82c0f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:21.143235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-1eba9667-ad44-4b70-95db-e9aaa82c0f01 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:21.144376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-1eba9667-ad44-4b70-95db-e9aaa82c0f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:21.152341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 634/1268] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:21.191021 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cc9ab-b1de-4856-a5f5-b7841b6674b4 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:21.202039 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cc9ab-b1de-4856-a5f5-b7841b6674b4 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:21.205545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aeb0a0-0431-4554-b5f6-ff328448f57f service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e16e400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:21.206114 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeb0a0-0431-4554-b5f6-ff328448f57f service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:21.206403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeb0a0-0431-4554-b5f6-ff328448f57f service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:21.206684 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeb0a0-0431-4554-b5f6-ff328448f57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:21.216148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aeb0a0-0431-4554-b5f6-ff328448f57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:21.217592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aeb0a0-0431-4554-b5f6-ff328448f57f service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:21.227001 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 635/1269] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:21 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:26.671867 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a616445-76c6-46ad-b1b5-ad9afb28b7f5 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:26.672440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a616445-76c6-46ad-b1b5-ad9afb28b7f5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:26.672440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a616445-76c6-46ad-b1b5-ad9afb28b7f5 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:26.674196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 635/1270] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:26.680062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc14e-7f90-40ea-9d99-1e2f7fbb0c43 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:26.684252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc14e-7f90-40ea-9d99-1e2f7fbb0c43 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:26.684252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc14e-7f90-40ea-9d99-1e2f7fbb0c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:26.706234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f10bc14e-7f90-40ea-9d99-1e2f7fbb0c43 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:26.707439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f10bc14e-7f90-40ea-9d99-1e2f7fbb0c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:26.715141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 636/1271] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:53:26.754572 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a616445-76c6-46ad-b1b5-ad9afb28b7f5 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:26.767204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a616445-76c6-46ad-b1b5-ad9afb28b7f5 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:26.771232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd3aa8-49d3-4143-a5a7-3b16b21d607c service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e7051f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:26.772017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd3aa8-49d3-4143-a5a7-3b16b21d607c service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:26.772478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd3aa8-49d3-4143-a5a7-3b16b21d607c service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:26.772926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd3aa8-49d3-4143-a5a7-3b16b21d607c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:26.783634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd3aa8-49d3-4143-a5a7-3b16b21d607c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:26.785380 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd3aa8-49d3-4143-a5a7-3b16b21d607c service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:26.795783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 636/1272] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:26 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:31.528033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a43601-47d5-4df0-b9ed-0bc40134dc24 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:31.528539 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a43601-47d5-4df0-b9ed-0bc40134dc24 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:31.528634 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a43601-47d5-4df0-b9ed-0bc40134dc24 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:31.530342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 637/1273] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 18:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:31.536078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf20d2-c0b0-459e-96b3-8229f5713854 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:31.539227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf20d2-c0b0-459e-96b3-8229f5713854 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:31.539227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf20d2-c0b0-459e-96b3-8229f5713854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:31.640889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-6abf20d2-c0b0-459e-96b3-8229f5713854 None None] MFA Rules not processed for user `2f330acd453f445ea31acf9fc43b53ad`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:31.642068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6abf20d2-c0b0-459e-96b3-8229f5713854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:31.777823 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 637/1274] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 18:53:31 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:32.210093 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57e3f0-9ab2-4f1f-9189-dc3ea6d06a5b None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:32.210636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57e3f0-9ab2-4f1f-9189-dc3ea6d06a5b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:32.211095 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57e3f0-9ab2-4f1f-9189-dc3ea6d06a5b None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:32.213247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 638/1275] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 18:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:32.218809 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44b7fa-a630-45d0-b0fd-993c1b864511 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:32.219381 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44b7fa-a630-45d0-b0fd-993c1b864511 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:32.219847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44b7fa-a630-45d0-b0fd-993c1b864511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:32.243846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-8d44b7fa-a630-45d0-b0fd-993c1b864511 None None] MFA Rules not processed for user `2f330acd453f445ea31acf9fc43b53ad`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:32.246086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8d44b7fa-a630-45d0-b0fd-993c1b864511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:32.254918 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 638/1276] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 18:53:32 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:53:36.470415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a64fb8-50f7-486d-b38f-0c3a160359e2 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:36.470978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a64fb8-50f7-486d-b38f-0c3a160359e2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:36.470978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a64fb8-50f7-486d-b38f-0c3a160359e2 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:36.472882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 639/1277] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 18:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:36.477811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b352d4-d26c-41b3-8905-3edb21e84fae None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:36.478241 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b352d4-d26c-41b3-8905-3edb21e84fae None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:36.478389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b352d4-d26c-41b3-8905-3edb21e84fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:36.507144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-36b352d4-d26c-41b3-8905-3edb21e84fae None None] MFA Rules not processed for user `2f330acd453f445ea31acf9fc43b53ad`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:36.508380 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-36b352d4-d26c-41b3-8905-3edb21e84fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:36.518418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 639/1278] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 18:53:36 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:53:37.921207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233ce6-181f-444e-bb97-78d20428657a None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:37.922389 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233ce6-181f-444e-bb97-78d20428657a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:37.923048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233ce6-181f-444e-bb97-78d20428657a None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:37.925590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 640/1279] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 18:53:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:37.932178 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f813a2-e44c-48d2-ba47-48cd9edc4f04 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:37.932890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f813a2-e44c-48d2-ba47-48cd9edc4f04 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:37.933293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f813a2-e44c-48d2-ba47-48cd9edc4f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:37.959954 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f5f813a2-e44c-48d2-ba47-48cd9edc4f04 None None] MFA Rules not processed for user `2f330acd453f445ea31acf9fc43b53ad`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:37.961208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f5f813a2-e44c-48d2-ba47-48cd9edc4f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:37.969369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 640/1280] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 18:53:37 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:41.883091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd57d14-b404-43a6-b7d7-1ff88aeb9992 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:41.883727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd57d14-b404-43a6-b7d7-1ff88aeb9992 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:41.883823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd57d14-b404-43a6-b7d7-1ff88aeb9992 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:41.886110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 641/1281] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:41.894246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29258193-3329-4d6d-b9b9-8f8213aa6279 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:41.894781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29258193-3329-4d6d-b9b9-8f8213aa6279 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:41.894889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29258193-3329-4d6d-b9b9-8f8213aa6279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:41.918340 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-29258193-3329-4d6d-b9b9-8f8213aa6279 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:41.919536 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-29258193-3329-4d6d-b9b9-8f8213aa6279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:41.926762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 641/1282] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:41.976343 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f0437-7f3d-4d6c-841e-c8c5eb1a9db6 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:41.976708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f0437-7f3d-4d6c-841e-c8c5eb1a9db6 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:41.976995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f0437-7f3d-4d6c-841e-c8c5eb1a9db6 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:41.979307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 642/1283] 10.222.0.21 () {54 vars in 960 bytes} [Mon Feb 28 18:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:41.985128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3435-d634-4de6-be4b-a1511db8ffe7 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:41.985419 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3435-d634-4de6-be4b-a1511db8ffe7 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:41.985697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3435-d634-4de6-be4b-a1511db8ffe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:42.061662 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-76bd3435-d634-4de6-be4b-a1511db8ffe7 None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:42.063191 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-76bd3435-d634-4de6-be4b-a1511db8ffe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:42.154595 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 642/1284] 10.222.0.21 () {58 vars in 1057 bytes} [Mon Feb 28 18:53:41 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:42.162698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f0437-7f3d-4d6c-841e-c8c5eb1a9db6 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:42.181096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f0437-7f3d-4d6c-841e-c8c5eb1a9db6 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:42.187571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f0e4d-4493-49be-a12d-c1adb31c36df service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09e9a0cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:42.188408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f0e4d-4493-49be-a12d-c1adb31c36df service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:42.188698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f0e4d-4493-49be-a12d-c1adb31c36df service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:42.188979 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f0e4d-4493-49be-a12d-c1adb31c36df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:42.197952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f0e4d-4493-49be-a12d-c1adb31c36df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:42.199596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f0e4d-4493-49be-a12d-c1adb31c36df service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:42.209172 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 643/1285] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:44.708336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a46fbc-20e3-498c-b5cc-205ef1bc5264 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:44.708890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a46fbc-20e3-498c-b5cc-205ef1bc5264 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:44.708890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a46fbc-20e3-498c-b5cc-205ef1bc5264 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:44.710612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 643/1286] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:44.716555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587b9e-96bb-43af-a7a6-9c352b9a0b02 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:44.717026 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587b9e-96bb-43af-a7a6-9c352b9a0b02 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:44.717143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587b9e-96bb-43af-a7a6-9c352b9a0b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:44.740192 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b5587b9e-96bb-43af-a7a6-9c352b9a0b02 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:44.741363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b5587b9e-96bb-43af-a7a6-9c352b9a0b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:44.748880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 644/1287] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:44.793849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a46fbc-20e3-498c-b5cc-205ef1bc5264 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:44.807734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a46fbc-20e3-498c-b5cc-205ef1bc5264 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:44.813067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e501fa-4532-4379-afbe-fef45714ea5e service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09e194640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:44.813657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e501fa-4532-4379-afbe-fef45714ea5e service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:44.813936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e501fa-4532-4379-afbe-fef45714ea5e service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:44.814219 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e501fa-4532-4379-afbe-fef45714ea5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:44.822380 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e501fa-4532-4379-afbe-fef45714ea5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:44.824212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e501fa-4532-4379-afbe-fef45714ea5e service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:44.833290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 644/1288] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:47.488701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f843-9f5d-4faf-980f-ca139f3dd957 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:47.489274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f843-9f5d-4faf-980f-ca139f3dd957 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:47.489274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f843-9f5d-4faf-980f-ca139f3dd957 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:47.490950 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 645/1289] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:47.496339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d83e6-84d7-4271-90c6-c90780e14b47 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:47.496758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d83e6-84d7-4271-90c6-c90780e14b47 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:47.496913 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d83e6-84d7-4271-90c6-c90780e14b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:47.519393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-198d83e6-84d7-4271-90c6-c90780e14b47 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:47.520563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-198d83e6-84d7-4271-90c6-c90780e14b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:47.528873 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 645/1290] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:47.574674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341dba7-5f66-440f-b616-edf8858fe3cb None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:47.575315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341dba7-5f66-440f-b616-edf8858fe3cb None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:47.575315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341dba7-5f66-440f-b616-edf8858fe3cb None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:47.576910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 646/1291] 10.222.0.21 () {54 vars in 960 bytes} [Mon Feb 28 18:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:47.582278 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171868-b68c-44a2-8248-64e14acf6977 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:47.582573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171868-b68c-44a2-8248-64e14acf6977 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:47.582860 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0171868-b68c-44a2-8248-64e14acf6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:47.604909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-e0171868-b68c-44a2-8248-64e14acf6977 None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:47.606090 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e0171868-b68c-44a2-8248-64e14acf6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:47.614446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 646/1292] 10.222.0.21 () {58 vars in 1057 bytes} [Mon Feb 28 18:53:47 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:47.622879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341dba7-5f66-440f-b616-edf8858fe3cb None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:47.637639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341dba7-5f66-440f-b616-edf8858fe3cb None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:47.643090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb525d-0813-4e96-8e2f-cc2a8144a71a service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09e1f38e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:47.643692 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb525d-0813-4e96-8e2f-cc2a8144a71a service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:47.643983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb525d-0813-4e96-8e2f-cc2a8144a71a service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:47.644268 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb525d-0813-4e96-8e2f-cc2a8144a71a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:47.652304 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb525d-0813-4e96-8e2f-cc2a8144a71a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:47.653890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb525d-0813-4e96-8e2f-cc2a8144a71a service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:47.663087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 647/1293] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:50.002252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012c1c-32f3-4dd4-bd4a-0c85c94c23fb None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:50.002831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012c1c-32f3-4dd4-bd4a-0c85c94c23fb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:50.002831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012c1c-32f3-4dd4-bd4a-0c85c94c23fb None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:50.004530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 647/1294] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:50.009823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adfaeb-e475-4e7a-8c1f-162385c5fd30 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:50.010288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adfaeb-e475-4e7a-8c1f-162385c5fd30 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:50.010571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adfaeb-e475-4e7a-8c1f-162385c5fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:50.033206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-69adfaeb-e475-4e7a-8c1f-162385c5fd30 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:50.034333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-69adfaeb-e475-4e7a-8c1f-162385c5fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:50.042316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 648/1295] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:50.086037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012c1c-32f3-4dd4-bd4a-0c85c94c23fb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:50.099947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012c1c-32f3-4dd4-bd4a-0c85c94c23fb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:50.105530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af6a05-469b-4138-9dd4-9263a1cfbeaf service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09e21e190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:50.106099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af6a05-469b-4138-9dd4-9263a1cfbeaf service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:50.106386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af6a05-469b-4138-9dd4-9263a1cfbeaf service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:50.106666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af6a05-469b-4138-9dd4-9263a1cfbeaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:50.114372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af6a05-469b-4138-9dd4-9263a1cfbeaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:50.115967 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af6a05-469b-4138-9dd4-9263a1cfbeaf service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:50.124861 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 648/1296] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:52.390045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96aae9-94a1-4a7a-940b-de9b9a492910 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:52.390555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96aae9-94a1-4a7a-940b-de9b9a492910 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:52.390555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96aae9-94a1-4a7a-940b-de9b9a492910 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:52.392293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 649/1297] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:52.397662 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007321c5-fd74-4a71-b123-2d0f74de1ef6 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:52.398085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007321c5-fd74-4a71-b123-2d0f74de1ef6 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:52.398264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007321c5-fd74-4a71-b123-2d0f74de1ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:52.421411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-007321c5-fd74-4a71-b123-2d0f74de1ef6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:52.422556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-007321c5-fd74-4a71-b123-2d0f74de1ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:52.429703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 649/1298] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:52.475390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96aae9-94a1-4a7a-940b-de9b9a492910 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:52.489401 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96aae9-94a1-4a7a-940b-de9b9a492910 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:52.494747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1b870-1f92-4828-b11f-e75ee4e310a8 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09e3f0160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:52.495347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b870-1f92-4828-b11f-e75ee4e310a8 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:52.495638 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b870-1f92-4828-b11f-e75ee4e310a8 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:52.495922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b870-1f92-4828-b11f-e75ee4e310a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:52.503951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1b870-1f92-4828-b11f-e75ee4e310a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:52.505525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1b870-1f92-4828-b11f-e75ee4e310a8 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:52.515156 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 650/1299] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:54.820858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756ec30-00d1-4de3-8386-0f6d9d170b2c None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:54.821392 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756ec30-00d1-4de3-8386-0f6d9d170b2c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:54.821392 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756ec30-00d1-4de3-8386-0f6d9d170b2c None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:54.823201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 650/1300] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:54.828536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd88d14-61e9-4fa6-9155-fe243fb0a29a None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:54.828983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd88d14-61e9-4fa6-9155-fe243fb0a29a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:54.829168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd88d14-61e9-4fa6-9155-fe243fb0a29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:54.850956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-7cd88d14-61e9-4fa6-9155-fe243fb0a29a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:54.852113 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7cd88d14-61e9-4fa6-9155-fe243fb0a29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:54.859849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 651/1301] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:54.903909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756ec30-00d1-4de3-8386-0f6d9d170b2c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:54.918279 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756ec30-00d1-4de3-8386-0f6d9d170b2c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:54.923221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb5dd-3cc7-4480-abc2-c34a5d44a2d8 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09e194a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:54.923796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb5dd-3cc7-4480-abc2-c34a5d44a2d8 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:54.924082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb5dd-3cc7-4480-abc2-c34a5d44a2d8 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:54.924369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb5dd-3cc7-4480-abc2-c34a5d44a2d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:54.933068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cb5dd-3cc7-4480-abc2-c34a5d44a2d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:54.934798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cb5dd-3cc7-4480-abc2-c34a5d44a2d8 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:54.944129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 651/1302] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:57.229106 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afde15-30c0-4e5d-bb56-45b25758f0e5 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:57.229650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afde15-30c0-4e5d-bb56-45b25758f0e5 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:57.229650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afde15-30c0-4e5d-bb56-45b25758f0e5 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:57.231301 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 652/1303] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:57.236384 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39657314-3886-4936-afe8-6cfd5bde7301 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:57.236838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39657314-3886-4936-afe8-6cfd5bde7301 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:57.236961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39657314-3886-4936-afe8-6cfd5bde7301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:57.259141 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-39657314-3886-4936-afe8-6cfd5bde7301 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:57.260297 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-39657314-3886-4936-afe8-6cfd5bde7301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:57.267600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 652/1304] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:57.309701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afde15-30c0-4e5d-bb56-45b25758f0e5 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:57.323810 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afde15-30c0-4e5d-bb56-45b25758f0e5 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:57.328925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93015dbe-7231-4f6b-aae6-45efcc6f7417 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09e3eb0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:57.329493 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93015dbe-7231-4f6b-aae6-45efcc6f7417 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:57.329781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93015dbe-7231-4f6b-aae6-45efcc6f7417 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:57.330065 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93015dbe-7231-4f6b-aae6-45efcc6f7417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:57.338737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93015dbe-7231-4f6b-aae6-45efcc6f7417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:57.340363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93015dbe-7231-4f6b-aae6-45efcc6f7417 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:57.349285 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 653/1305] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:57 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:59.521987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eac07b-160b-4f9a-9131-6518904d361e None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:59.522562 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eac07b-160b-4f9a-9131-6518904d361e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:59.522562 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eac07b-160b-4f9a-9131-6518904d361e None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:59.524307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 653/1306] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:53:59.530182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246202bc-2d61-47f8-aa31-713034f9564a None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:59.530592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246202bc-2d61-47f8-aa31-713034f9564a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:59.530756 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246202bc-2d61-47f8-aa31-713034f9564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:59.553164 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-246202bc-2d61-47f8-aa31-713034f9564a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:59.554338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-246202bc-2d61-47f8-aa31-713034f9564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:59.563036 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 654/1307] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:53:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:59.608302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eac07b-160b-4f9a-9131-6518904d361e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:59.622440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eac07b-160b-4f9a-9131-6518904d361e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:59.627493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f6353-caf3-4617-b41d-d77365c392a5 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09defe970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:59.628063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f6353-caf3-4617-b41d-d77365c392a5 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:59.628354 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f6353-caf3-4617-b41d-d77365c392a5 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:59.628640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f6353-caf3-4617-b41d-d77365c392a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:59.637486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f6353-caf3-4617-b41d-d77365c392a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:59.639051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f6353-caf3-4617-b41d-d77365c392a5 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:53:59.647912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 654/1308] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:01.944760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3630e8c-df2b-4297-8fa6-2fbccdb541d8 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:01.945326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3630e8c-df2b-4297-8fa6-2fbccdb541d8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:01.945326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3630e8c-df2b-4297-8fa6-2fbccdb541d8 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:01.947157 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 655/1309] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:54:01.952461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f39ca-cc4f-444b-a8df-f5a944f04204 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:01.952889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f39ca-cc4f-444b-a8df-f5a944f04204 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:01.953063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f39ca-cc4f-444b-a8df-f5a944f04204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:01.975732 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-8e9f39ca-cc4f-444b-a8df-f5a944f04204 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:01.976884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8e9f39ca-cc4f-444b-a8df-f5a944f04204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:01.984825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 655/1310] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:54:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:54:02.028790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3630e8c-df2b-4297-8fa6-2fbccdb541d8 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:02.043083 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3630e8c-df2b-4297-8fa6-2fbccdb541d8 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:02.053827 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef89ea-b911-4460-86f4-392ec89b947a service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09e16e9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:02.054407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef89ea-b911-4460-86f4-392ec89b947a service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:02.054695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef89ea-b911-4460-86f4-392ec89b947a service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:02.054978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef89ea-b911-4460-86f4-392ec89b947a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:02.063534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef89ea-b911-4460-86f4-392ec89b947a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:02.065130 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef89ea-b911-4460-86f4-392ec89b947a service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:54:02.074053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 656/1311] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:04.401153 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba910763-afaa-4584-81bb-004f166e1dac None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:04.401691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba910763-afaa-4584-81bb-004f166e1dac None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:04.401787 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba910763-afaa-4584-81bb-004f166e1dac None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:04.403469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 656/1312] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:04.408568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ea35a-07a9-4934-957d-a06e6767b83a None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:04.409001 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ea35a-07a9-4934-957d-a06e6767b83a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:04.409136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ea35a-07a9-4934-957d-a06e6767b83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:04.433198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-717ea35a-07a9-4934-957d-a06e6767b83a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:04.434326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-717ea35a-07a9-4934-957d-a06e6767b83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:04.441621 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 657/1313] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:54:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:04.485848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba910763-afaa-4584-81bb-004f166e1dac None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:04.499900 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba910763-afaa-4584-81bb-004f166e1dac None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:04.504843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036fcc4-62b2-41cd-a67f-13736a4df630 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09e1aec10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:04.505415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036fcc4-62b2-41cd-a67f-13736a4df630 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:04.505712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036fcc4-62b2-41cd-a67f-13736a4df630 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:04.514616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036fcc4-62b2-41cd-a67f-13736a4df630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:04.514616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036fcc4-62b2-41cd-a67f-13736a4df630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:04.515793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036fcc4-62b2-41cd-a67f-13736a4df630 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:54:04.524750 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 657/1314] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:06.871634 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a7ba0-bb80-4ef7-9b83-3d56ece1145e None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:06.872162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a7ba0-bb80-4ef7-9b83-3d56ece1145e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:06.872162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a7ba0-bb80-4ef7-9b83-3d56ece1145e None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:06.873801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 658/1315] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:06.879068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909c705-c393-4501-9185-f770abbe9106 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:06.879525 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909c705-c393-4501-9185-f770abbe9106 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:06.879672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909c705-c393-4501-9185-f770abbe9106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:06.904593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-1909c705-c393-4501-9185-f770abbe9106 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:06.905751 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-1909c705-c393-4501-9185-f770abbe9106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:06.912795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 658/1316] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:54:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:06.956938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a7ba0-bb80-4ef7-9b83-3d56ece1145e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:06.971399 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a7ba0-bb80-4ef7-9b83-3d56ece1145e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:06.976591 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177dde2-f60c-4def-8382-1f02763fb1e9 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09e1f38e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:06.977189 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177dde2-f60c-4def-8382-1f02763fb1e9 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:06.977488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177dde2-f60c-4def-8382-1f02763fb1e9 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:06.977767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177dde2-f60c-4def-8382-1f02763fb1e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:06.986021 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177dde2-f60c-4def-8382-1f02763fb1e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:06.987646 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177dde2-f60c-4def-8382-1f02763fb1e9 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:54:06.996824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 659/1317] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:09.291886 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679a092-c23a-4e54-9999-628dfe08d0c5 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:09.292426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679a092-c23a-4e54-9999-628dfe08d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:09.292426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679a092-c23a-4e54-9999-628dfe08d0c5 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:09.294055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 659/1318] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:09.299140 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec22d-e1c1-480a-aa4b-4c3e915024ff None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:09.299553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec22d-e1c1-480a-aa4b-4c3e915024ff None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:09.299701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec22d-e1c1-480a-aa4b-4c3e915024ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:09.322891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-8abec22d-e1c1-480a-aa4b-4c3e915024ff None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:09.324067 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8abec22d-e1c1-480a-aa4b-4c3e915024ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:09.331071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 660/1319] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:54:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:09.376097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679a092-c23a-4e54-9999-628dfe08d0c5 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:09.390110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679a092-c23a-4e54-9999-628dfe08d0c5 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:09.395166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5099f1-86fd-4f8c-bb03-17233e5182a8 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09e105370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:09.395747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5099f1-86fd-4f8c-bb03-17233e5182a8 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:09.396037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5099f1-86fd-4f8c-bb03-17233e5182a8 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:09.396320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5099f1-86fd-4f8c-bb03-17233e5182a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:09.404443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5099f1-86fd-4f8c-bb03-17233e5182a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:09.406023 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5099f1-86fd-4f8c-bb03-17233e5182a8 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:54:09.414805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 660/1320] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:19.995395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed3555-9bd5-406c-a8d5-773d243b9551 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:19.995861 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed3555-9bd5-406c-a8d5-773d243b9551 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:19.995974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed3555-9bd5-406c-a8d5-773d243b9551 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:19.997649 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 661/1321] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:20.002986 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f08f8-e825-48c9-9138-95ba3d3ad1e5 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:20.003445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f08f8-e825-48c9-9138-95ba3d3ad1e5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:20.003592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f08f8-e825-48c9-9138-95ba3d3ad1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:20.026945 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-066f08f8-e825-48c9-9138-95ba3d3ad1e5 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:20.028156 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-066f08f8-e825-48c9-9138-95ba3d3ad1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:20.035363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 661/1322] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:54:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:20.098892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2807a04-5c8e-49e1-8d96-0af334d081f9 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:20.099305 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2807a04-5c8e-49e1-8d96-0af334d081f9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:20.099591 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2807a04-5c8e-49e1-8d96-0af334d081f9 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:20.101246 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 662/1323] 10.222.0.21 () {54 vars in 962 bytes} [Mon Feb 28 18:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:20.106678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0a29e-0848-4607-ae79-cc435ddfbfc3 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:20.106975 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0a29e-0848-4607-ae79-cc435ddfbfc3 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:20.107301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0a29e-0848-4607-ae79-cc435ddfbfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:20.173064 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-d8e0a29e-0848-4607-ae79-cc435ddfbfc3 None None] MFA Rules not processed for user `43304b4fcb06440f9d5166ca439a581b`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:20.174267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d8e0a29e-0848-4607-ae79-cc435ddfbfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:20.243214 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 662/1324] 10.222.0.21 () {58 vars in 1059 bytes} [Mon Feb 28 18:54:20 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:20.251535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2807a04-5c8e-49e1-8d96-0af334d081f9 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:20.263604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2807a04-5c8e-49e1-8d96-0af334d081f9 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:20.267137 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf02af0-aa0d-4a4e-946d-5a08e6065bc0 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e162550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:20.267739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02af0-aa0d-4a4e-946d-5a08e6065bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:20.268032 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02af0-aa0d-4a4e-946d-5a08e6065bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:20.268310 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf02af0-aa0d-4a4e-946d-5a08e6065bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:20.278794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf02af0-aa0d-4a4e-946d-5a08e6065bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:20.280295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf02af0-aa0d-4a4e-946d-5a08e6065bc0 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:54:20.292560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 663/1325] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:35.449502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b750a-b3d0-473c-bc81-843c490d195f None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:35.450617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b750a-b3d0-473c-bc81-843c490d195f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:35.450734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b750a-b3d0-473c-bc81-843c490d195f None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:35.452372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 663/1326] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:35.457546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9efb3-b20d-4e92-a37a-629b43de1396 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:35.457951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9efb3-b20d-4e92-a37a-629b43de1396 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:35.458111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9efb3-b20d-4e92-a37a-629b43de1396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:35.479824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-66e9efb3-b20d-4e92-a37a-629b43de1396 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:35.480954 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-66e9efb3-b20d-4e92-a37a-629b43de1396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:35.488491 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 664/1327] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:54:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:35.541966 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db89637-39ed-4764-8e84-16acb89e29fb None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:35.542265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db89637-39ed-4764-8e84-16acb89e29fb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:35.542552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db89637-39ed-4764-8e84-16acb89e29fb None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:35.544569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 664/1328] 10.222.0.21 () {54 vars in 961 bytes} [Mon Feb 28 18:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:35.549425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d41ff-e5de-45e2-be7a-781f053159a8 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:35.549720 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d41ff-e5de-45e2-be7a-781f053159a8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:35.550035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d41ff-e5de-45e2-be7a-781f053159a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:35.617337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-2a1d41ff-e5de-45e2-be7a-781f053159a8 None None] MFA Rules not processed for user `e956656659004428b3aaf23ae962f001`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:35.618418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-2a1d41ff-e5de-45e2-be7a-781f053159a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:35.691977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 665/1329] 10.222.0.21 () {58 vars in 1058 bytes} [Mon Feb 28 18:54:35 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:35.701394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db89637-39ed-4764-8e84-16acb89e29fb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:35.713309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db89637-39ed-4764-8e84-16acb89e29fb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:35.717456 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac785ea1-f13b-4cbf-9350-f516754f37f2 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=IAdTf7zmRlS7ZAE69VgzOQ, audit_chain_id=['IAdTf7zmRlS7ZAE69VgzOQ']) at 0x7fe09e7b7040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e956656659004428b3aaf23ae962f001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:35.718038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac785ea1-f13b-4cbf-9350-f516754f37f2 service glance] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:35.718318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac785ea1-f13b-4cbf-9350-f516754f37f2 service glance] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:35.718598 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac785ea1-f13b-4cbf-9350-f516754f37f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:35.728636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac785ea1-f13b-4cbf-9350-f516754f37f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:35.730071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac785ea1-f13b-4cbf-9350-f516754f37f2 service glance] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:54:35.740327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 665/1330] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:36.551465 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53a329-4b1d-4063-aa6e-c79600b5e3e5 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:36.551993 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53a329-4b1d-4063-aa6e-c79600b5e3e5 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:36.552103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53a329-4b1d-4063-aa6e-c79600b5e3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:36.620860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-7a53a329-4b1d-4063-aa6e-c79600b5e3e5 None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:36.622043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7a53a329-4b1d-4063-aa6e-c79600b5e3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:36.691928 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 666/1331] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 18:54:36 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:36.732909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978a3dc-9d31-4963-9a43-bb2e3461f43f None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:36.733376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978a3dc-9d31-4963-9a43-bb2e3461f43f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:36.733490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978a3dc-9d31-4963-9a43-bb2e3461f43f None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:36.735166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 666/1332] 10.222.0.21 () {54 vars in 942 bytes} [Mon Feb 28 18:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:36.741218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c1b65-2c85-4d98-a941-16b9ed9d4c8f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:36.741508 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c1b65-2c85-4d98-a941-16b9ed9d4c8f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:36.741823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c1b65-2c85-4d98-a941-16b9ed9d4c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:36.808954 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a58c1b65-2c85-4d98-a941-16b9ed9d4c8f None None] MFA Rules not processed for user `5bf96e3d5ba3483896dcb079f8e7b0bb`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:36.810403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a58c1b65-2c85-4d98-a941-16b9ed9d4c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:36.887014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 667/1333] 10.222.0.21 () {58 vars in 1039 bytes} [Mon Feb 28 18:54:36 2022] POST /identity/v3/auth/tokens => generated 3734 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:36.896998 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978a3dc-9d31-4963-9a43-bb2e3461f43f None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:36.910491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978a3dc-9d31-4963-9a43-bb2e3461f43f None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:36.915031 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42628c04-2e99-4ce8-99ee-cee6cf89f316 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e194310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:36.915635 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628c04-2e99-4ce8-99ee-cee6cf89f316 service swift] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:36.915924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628c04-2e99-4ce8-99ee-cee6cf89f316 service swift] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:36.916205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628c04-2e99-4ce8-99ee-cee6cf89f316 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:36.924097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42628c04-2e99-4ce8-99ee-cee6cf89f316 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:36.925685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42628c04-2e99-4ce8-99ee-cee6cf89f316 service swift] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:54:36.933547 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 667/1334] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 18:54:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:54:55.648158 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3313ca-f04a-49ce-962f-4f0894d07507 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:55.648755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3313ca-f04a-49ce-962f-4f0894d07507 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:55.648755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3313ca-f04a-49ce-962f-4f0894d07507 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:55.650434 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 668/1335] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:55.656437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77f6e5-7b1d-4777-8395-5f02345270bb None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:55.656882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77f6e5-7b1d-4777-8395-5f02345270bb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:55.657005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77f6e5-7b1d-4777-8395-5f02345270bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:55.678596 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-6d77f6e5-7b1d-4777-8395-5f02345270bb None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:55.679770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6d77f6e5-7b1d-4777-8395-5f02345270bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:55.687628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 668/1336] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:54:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:55.711041 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3313ca-f04a-49ce-962f-4f0894d07507 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:55.723281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3313ca-f04a-49ce-962f-4f0894d07507 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:55.727496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd8679-44d4-4653-9c60-40fe87889768 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=EKhXmy6wQcCaMcvmWGT3Ag, audit_chain_id=['EKhXmy6wQcCaMcvmWGT3Ag']) at 0x7fe09e3ebf70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:55.728080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd8679-44d4-4653-9c60-40fe87889768 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:55.728368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd8679-44d4-4653-9c60-40fe87889768 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:55.728651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd8679-44d4-4653-9c60-40fe87889768 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:55.729940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd8679-44d4-4653-9c60-40fe87889768 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:55.732546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd8679-44d4-4653-9c60-40fe87889768 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:54:55.746922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 669/1337] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:54:55 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:54:57.839859 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c162ac-0b7b-4306-86c5-b4abfc3908a6 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.840431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c162ac-0b7b-4306-86c5-b4abfc3908a6 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.840431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c162ac-0b7b-4306-86c5-b4abfc3908a6 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.842204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 669/1338] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:57.847570 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b779ab-741b-4271-b1fd-dcdfd2d574d8 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.848264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b779ab-741b-4271-b1fd-dcdfd2d574d8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.848264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b779ab-741b-4271-b1fd-dcdfd2d574d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.870753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-47b779ab-741b-4271-b1fd-dcdfd2d574d8 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:57.871926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-47b779ab-741b-4271-b1fd-dcdfd2d574d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:57.879872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 670/1339] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:54:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:57.902721 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c162ac-0b7b-4306-86c5-b4abfc3908a6 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:57.915785 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c162ac-0b7b-4306-86c5-b4abfc3908a6 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:57.921461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098c66d-785c-4a4a-a6dc-dbf187fa766c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ur7b7PSnQUSkWXpkIMfjqA, audit_chain_id=['Ur7b7PSnQUSkWXpkIMfjqA']) at 0x7fe09dec1e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:57.922310 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c66d-785c-4a4a-a6dc-dbf187fa766c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.922603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c66d-785c-4a4a-a6dc-dbf187fa766c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.922915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c66d-785c-4a4a-a6dc-dbf187fa766c admin admin] PATH_INFO: `/v3/projects/00b56488aed744d7b2ac4fff59ebb674` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.935465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098c66d-785c-4a4a-a6dc-dbf187fa766c admin admin] RBAC: Authorizing `identity:get_project(project_id=00b56488aed744d7b2ac4fff59ebb674)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:57.937514 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098c66d-785c-4a4a-a6dc-dbf187fa766c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:54:57.939151 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 670/1340] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:54:57 2022] GET /identity/v3/projects/00b56488aed744d7b2ac4fff59ebb674 => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:54:57.945373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b779ab-741b-4271-b1fd-dcdfd2d574d8 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:57.954408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b779ab-741b-4271-b1fd-dcdfd2d574d8 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:57.958668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f80cc0-cb89-4233-aea7-a6bcd0a4b0e1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ur7b7PSnQUSkWXpkIMfjqA, audit_chain_id=['Ur7b7PSnQUSkWXpkIMfjqA']) at 0x7fe09e1cc0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:57.959252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80cc0-cb89-4233-aea7-a6bcd0a4b0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.959537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80cc0-cb89-4233-aea7-a6bcd0a4b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.959817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80cc0-cb89-4233-aea7-a6bcd0a4b0e1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.960535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80cc0-cb89-4233-aea7-a6bcd0a4b0e1 admin admin] RBAC: Adding query filter params (scope.project.id=00b56488aed744d7b2ac4fff59ebb674) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:54:57.960828 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80cc0-cb89-4233-aea7-a6bcd0a4b0e1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:57.962703 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80cc0-cb89-4233-aea7-a6bcd0a4b0e1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:54:57.968668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 671/1341] 10.222.0.21 () {56 vars in 1231 bytes} [Mon Feb 28 18:54:57 2022] GET /identity/v3/role_assignments?scope.project.id=00b56488aed744d7b2ac4fff59ebb674 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:54:57.974374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098c66d-785c-4a4a-a6dc-dbf187fa766c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:57.984519 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098c66d-785c-4a4a-a6dc-dbf187fa766c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:57.988842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57feba40-b723-4116-803d-4df49361f57a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ur7b7PSnQUSkWXpkIMfjqA, audit_chain_id=['Ur7b7PSnQUSkWXpkIMfjqA']) at 0x7fe09de556d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:57.989639 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57feba40-b723-4116-803d-4df49361f57a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.989930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57feba40-b723-4116-803d-4df49361f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.990212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57feba40-b723-4116-803d-4df49361f57a admin admin] PATH_INFO: `/v3/users/fb7c84ee0bb84d4e9d85ce46a64f10d0` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:58.008075 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57feba40-b723-4116-803d-4df49361f57a admin admin] RBAC: Authorizing `identity:get_user(user_id=fb7c84ee0bb84d4e9d85ce46a64f10d0)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:58.010189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57feba40-b723-4116-803d-4df49361f57a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:54:58.011735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 671/1342] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:54:57 2022] GET /identity/v3/users/fb7c84ee0bb84d4e9d85ce46a64f10d0 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:00.142625 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d357fc-333f-48d7-a6fd-3ca5fc13b7d1 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:00.143215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d357fc-333f-48d7-a6fd-3ca5fc13b7d1 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:00.143336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d357fc-333f-48d7-a6fd-3ca5fc13b7d1 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:00.144994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 672/1343] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:00.150093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117819bd-f67a-47d4-8010-b384b33286e0 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:00.150535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117819bd-f67a-47d4-8010-b384b33286e0 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:00.150667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117819bd-f67a-47d4-8010-b384b33286e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:00.173551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-117819bd-f67a-47d4-8010-b384b33286e0 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:00.174690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-117819bd-f67a-47d4-8010-b384b33286e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:00.181685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 672/1344] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:55:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:00.205958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d357fc-333f-48d7-a6fd-3ca5fc13b7d1 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:00.218512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d357fc-333f-48d7-a6fd-3ca5fc13b7d1 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:00.222651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed35a1a-7f91-45f1-a80b-0e999680f8b1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ks0toaOXShaGZCs2GrxgqQ, audit_chain_id=['Ks0toaOXShaGZCs2GrxgqQ']) at 0x7fe09e3d10d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:00.223462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35a1a-7f91-45f1-a80b-0e999680f8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:00.223747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35a1a-7f91-45f1-a80b-0e999680f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:00.224023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35a1a-7f91-45f1-a80b-0e999680f8b1 admin admin] PATH_INFO: `/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:00.225103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed35a1a-7f91-45f1-a80b-0e999680f8b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=17d9ce9af82b4fd68fac993b9e9f37e5)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:00.226908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed35a1a-7f91-45f1-a80b-0e999680f8b1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:00.228378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 673/1345] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:55:00 2022] GET /identity/v3/projects/17d9ce9af82b4fd68fac993b9e9f37e5 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:00.234660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117819bd-f67a-47d4-8010-b384b33286e0 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:00.243333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117819bd-f67a-47d4-8010-b384b33286e0 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:00.247694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbacf18-f091-4b5c-a5b7-49fde3d5d1e0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ks0toaOXShaGZCs2GrxgqQ, audit_chain_id=['Ks0toaOXShaGZCs2GrxgqQ']) at 0x7fe09de8b640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:00.248269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbacf18-f091-4b5c-a5b7-49fde3d5d1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:00.248561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbacf18-f091-4b5c-a5b7-49fde3d5d1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:00.248845 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbacf18-f091-4b5c-a5b7-49fde3d5d1e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:00.249560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbacf18-f091-4b5c-a5b7-49fde3d5d1e0 admin admin] RBAC: Adding query filter params (scope.project.id=17d9ce9af82b4fd68fac993b9e9f37e5) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:55:00.249866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbacf18-f091-4b5c-a5b7-49fde3d5d1e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:00.251754 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbacf18-f091-4b5c-a5b7-49fde3d5d1e0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:00.257355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 673/1346] 10.222.0.21 () {56 vars in 1231 bytes} [Mon Feb 28 18:55:00 2022] GET /identity/v3/role_assignments?scope.project.id=17d9ce9af82b4fd68fac993b9e9f37e5 => generated 879 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:00.263178 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed35a1a-7f91-45f1-a80b-0e999680f8b1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:00.272816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed35a1a-7f91-45f1-a80b-0e999680f8b1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:00.277204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72828a9-3052-4a9c-9b20-64b38cf70358 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ks0toaOXShaGZCs2GrxgqQ, audit_chain_id=['Ks0toaOXShaGZCs2GrxgqQ']) at 0x7fe09df1adf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:00.277971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72828a9-3052-4a9c-9b20-64b38cf70358 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:00.278762 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72828a9-3052-4a9c-9b20-64b38cf70358 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:00.279044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72828a9-3052-4a9c-9b20-64b38cf70358 admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:00.280260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72828a9-3052-4a9c-9b20-64b38cf70358 admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:00.282031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72828a9-3052-4a9c-9b20-64b38cf70358 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:00.283509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 674/1347] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:55:00 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:02.416034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53f0ea-5c6d-4a0a-b3c2-175d6f4eb88b None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.416667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53f0ea-5c6d-4a0a-b3c2-175d6f4eb88b None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.416667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53f0ea-5c6d-4a0a-b3c2-175d6f4eb88b None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.418259 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 674/1348] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:02.423404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212102d8-d860-4777-8b0d-35f8b8f59e4d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.423807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212102d8-d860-4777-8b0d-35f8b8f59e4d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.423970 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212102d8-d860-4777-8b0d-35f8b8f59e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.446394 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-212102d8-d860-4777-8b0d-35f8b8f59e4d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:02.447572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-212102d8-d860-4777-8b0d-35f8b8f59e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:02.455419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 675/1349] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:55:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:02.478205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53f0ea-5c6d-4a0a-b3c2-175d6f4eb88b None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:02.490838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53f0ea-5c6d-4a0a-b3c2-175d6f4eb88b None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:02.494942 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a990b5a-24d1-468c-93b4-3ed3fb247276 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rJHrkdZKQPmoGrEgbyuCvw, audit_chain_id=['rJHrkdZKQPmoGrEgbyuCvw']) at 0x7fe09de503a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:02.495885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a990b5a-24d1-468c-93b4-3ed3fb247276 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.496175 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a990b5a-24d1-468c-93b4-3ed3fb247276 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.496454 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a990b5a-24d1-468c-93b4-3ed3fb247276 admin admin] PATH_INFO: `/v3/projects/536234568c1a477aaa466a4b57b0731f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.510611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a990b5a-24d1-468c-93b4-3ed3fb247276 admin admin] RBAC: Authorizing `identity:get_project(project_id=536234568c1a477aaa466a4b57b0731f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:02.517962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a990b5a-24d1-468c-93b4-3ed3fb247276 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:02.517962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 675/1350] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:55:02 2022] GET /identity/v3/projects/536234568c1a477aaa466a4b57b0731f => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:02.521170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212102d8-d860-4777-8b0d-35f8b8f59e4d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:02.532020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212102d8-d860-4777-8b0d-35f8b8f59e4d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:02.536490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326fd17-3c89-499d-ae9d-d1c81533fcae admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rJHrkdZKQPmoGrEgbyuCvw, audit_chain_id=['rJHrkdZKQPmoGrEgbyuCvw']) at 0x7fe09e380100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:02.537081 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326fd17-3c89-499d-ae9d-d1c81533fcae admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.537401 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326fd17-3c89-499d-ae9d-d1c81533fcae admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.537686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326fd17-3c89-499d-ae9d-d1c81533fcae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.538481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326fd17-3c89-499d-ae9d-d1c81533fcae admin admin] RBAC: Adding query filter params (scope.project.id=536234568c1a477aaa466a4b57b0731f) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:55:02.538714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326fd17-3c89-499d-ae9d-d1c81533fcae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:02.540662 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326fd17-3c89-499d-ae9d-d1c81533fcae admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:02.547645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 676/1351] 10.222.0.21 () {56 vars in 1231 bytes} [Mon Feb 28 18:55:02 2022] GET /identity/v3/role_assignments?scope.project.id=536234568c1a477aaa466a4b57b0731f => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:55:02.553462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a990b5a-24d1-468c-93b4-3ed3fb247276 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:02.563750 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a990b5a-24d1-468c-93b4-3ed3fb247276 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:02.568135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6d185-9987-4c62-a805-f1a5c2ec3661 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rJHrkdZKQPmoGrEgbyuCvw, audit_chain_id=['rJHrkdZKQPmoGrEgbyuCvw']) at 0x7fe09de44610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:02.568983 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6d185-9987-4c62-a805-f1a5c2ec3661 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.569257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6d185-9987-4c62-a805-f1a5c2ec3661 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.569537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6d185-9987-4c62-a805-f1a5c2ec3661 admin admin] PATH_INFO: `/v3/users/e3f706901c1d4191ada8dd10650391b6` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.588052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6d185-9987-4c62-a805-f1a5c2ec3661 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3f706901c1d4191ada8dd10650391b6)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:02.590166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6d185-9987-4c62-a805-f1a5c2ec3661 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:02.591732 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 676/1352] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:55:02 2022] GET /identity/v3/users/e3f706901c1d4191ada8dd10650391b6 => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:02.597437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326fd17-3c89-499d-ae9d-d1c81533fcae admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:02.607140 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326fd17-3c89-499d-ae9d-d1c81533fcae admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:02.611408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854fa5f-151b-4316-af5e-3977af7be7d3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rJHrkdZKQPmoGrEgbyuCvw, audit_chain_id=['rJHrkdZKQPmoGrEgbyuCvw']) at 0x7fe09deed640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:02.612193 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854fa5f-151b-4316-af5e-3977af7be7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.612482 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854fa5f-151b-4316-af5e-3977af7be7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.612765 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854fa5f-151b-4316-af5e-3977af7be7d3 admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.613861 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854fa5f-151b-4316-af5e-3977af7be7d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:02.615695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854fa5f-151b-4316-af5e-3977af7be7d3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:02.617149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 677/1353] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:55:02 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:04.818970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66392a3a-5e1e-4c0d-9783-21e12d5f5e25 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:04.819548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66392a3a-5e1e-4c0d-9783-21e12d5f5e25 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:04.819548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66392a3a-5e1e-4c0d-9783-21e12d5f5e25 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:04.821239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 677/1354] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:04.828396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fabced-9114-49ee-9e89-8e8e51f19030 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:04.828860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fabced-9114-49ee-9e89-8e8e51f19030 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:04.828986 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fabced-9114-49ee-9e89-8e8e51f19030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:04.861309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-43fabced-9114-49ee-9e89-8e8e51f19030 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:04.862471 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-43fabced-9114-49ee-9e89-8e8e51f19030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:04.875443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 678/1355] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:55:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:04.898988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66392a3a-5e1e-4c0d-9783-21e12d5f5e25 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:04.910814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66392a3a-5e1e-4c0d-9783-21e12d5f5e25 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:04.915288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b43bbf-f46d-4458-b9d7-9ea01fe5351c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_9728cAGQMCq56_9N5kTfQ, audit_chain_id=['_9728cAGQMCq56_9N5kTfQ']) at 0x7fe09df24610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:04.916069 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b43bbf-f46d-4458-b9d7-9ea01fe5351c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:04.916351 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b43bbf-f46d-4458-b9d7-9ea01fe5351c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:04.916629 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b43bbf-f46d-4458-b9d7-9ea01fe5351c admin admin] PATH_INFO: `/v3/projects/957d6be248554f84b1624d5a66f21ae1` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:04.928591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b43bbf-f46d-4458-b9d7-9ea01fe5351c admin admin] RBAC: Authorizing `identity:get_project(project_id=957d6be248554f84b1624d5a66f21ae1)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:04.930609 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b43bbf-f46d-4458-b9d7-9ea01fe5351c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:04.932189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 678/1356] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:55:04 2022] GET /identity/v3/projects/957d6be248554f84b1624d5a66f21ae1 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:04.938755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fabced-9114-49ee-9e89-8e8e51f19030 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:04.947552 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fabced-9114-49ee-9e89-8e8e51f19030 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:04.952975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caff141-33bb-49b7-b977-15174466e7e6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_9728cAGQMCq56_9N5kTfQ, audit_chain_id=['_9728cAGQMCq56_9N5kTfQ']) at 0x7fe09e439730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:04.953551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caff141-33bb-49b7-b977-15174466e7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:04.953836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caff141-33bb-49b7-b977-15174466e7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:04.954115 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caff141-33bb-49b7-b977-15174466e7e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:04.954834 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caff141-33bb-49b7-b977-15174466e7e6 admin admin] RBAC: Adding query filter params (scope.project.id=957d6be248554f84b1624d5a66f21ae1) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:55:04.955157 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caff141-33bb-49b7-b977-15174466e7e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:04.957005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caff141-33bb-49b7-b977-15174466e7e6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:04.963567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 679/1357] 10.222.0.21 () {56 vars in 1231 bytes} [Mon Feb 28 18:55:04 2022] GET /identity/v3/role_assignments?scope.project.id=957d6be248554f84b1624d5a66f21ae1 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:55:04.970096 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b43bbf-f46d-4458-b9d7-9ea01fe5351c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:04.979436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b43bbf-f46d-4458-b9d7-9ea01fe5351c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:04.983903 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e235a6-2aa5-4ebd-821f-1e2aa134f6cf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_9728cAGQMCq56_9N5kTfQ, audit_chain_id=['_9728cAGQMCq56_9N5kTfQ']) at 0x7fe09e150550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:04.984694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e235a6-2aa5-4ebd-821f-1e2aa134f6cf admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:04.984979 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e235a6-2aa5-4ebd-821f-1e2aa134f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:04.985257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e235a6-2aa5-4ebd-821f-1e2aa134f6cf admin admin] PATH_INFO: `/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:04.986470 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e235a6-2aa5-4ebd-821f-1e2aa134f6cf admin admin] RBAC: Authorizing `identity:get_user(user_id=6ab015dd8bfa4c7bab33bb2ae75070c3)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:04.988336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e235a6-2aa5-4ebd-821f-1e2aa134f6cf admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:04.989833 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 679/1358] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:55:04 2022] GET /identity/v3/users/6ab015dd8bfa4c7bab33bb2ae75070c3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:04.995689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caff141-33bb-49b7-b977-15174466e7e6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:05.005817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caff141-33bb-49b7-b977-15174466e7e6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:05.010060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c433a4-5aff-4aaf-b71d-79d3f85430f1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_9728cAGQMCq56_9N5kTfQ, audit_chain_id=['_9728cAGQMCq56_9N5kTfQ']) at 0x7fe09e1b8370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:05.010837 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c433a4-5aff-4aaf-b71d-79d3f85430f1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:05.011132 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c433a4-5aff-4aaf-b71d-79d3f85430f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:05.011422 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c433a4-5aff-4aaf-b71d-79d3f85430f1 admin admin] PATH_INFO: `/v3/users/fa368b61f4ec43809f98dee2899427d4` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:05.030241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c433a4-5aff-4aaf-b71d-79d3f85430f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=fa368b61f4ec43809f98dee2899427d4)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:05.032391 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c433a4-5aff-4aaf-b71d-79d3f85430f1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:05.033853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 680/1359] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:55:04 2022] GET /identity/v3/users/fa368b61f4ec43809f98dee2899427d4 => generated 283 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:07.350936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08231a08-d048-4423-a4ad-6eb6ebca29c3 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.351509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08231a08-d048-4423-a4ad-6eb6ebca29c3 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.351509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08231a08-d048-4423-a4ad-6eb6ebca29c3 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.353148 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 680/1360] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:07.358390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a852e-fc72-4a70-b781-7e513dc35b48 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.358799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a852e-fc72-4a70-b781-7e513dc35b48 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.359048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a852e-fc72-4a70-b781-7e513dc35b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.381110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-fc7a852e-fc72-4a70-b781-7e513dc35b48 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:07.382250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-fc7a852e-fc72-4a70-b781-7e513dc35b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:07.389944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 681/1361] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:55:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:07.412769 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08231a08-d048-4423-a4ad-6eb6ebca29c3 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:07.424862 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08231a08-d048-4423-a4ad-6eb6ebca29c3 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:07.428982 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9452dd2-008f-4709-bc4b-82624044fe98 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0LX_hVHcSpqqRJgdvA0hXA, audit_chain_id=['0LX_hVHcSpqqRJgdvA0hXA']) at 0x7fe09de42f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:07.429756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9452dd2-008f-4709-bc4b-82624044fe98 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.430039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9452dd2-008f-4709-bc4b-82624044fe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.430319 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9452dd2-008f-4709-bc4b-82624044fe98 admin admin] PATH_INFO: `/v3/projects/a3015b5ef9e64185ad329e29c6fb9132` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.442349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9452dd2-008f-4709-bc4b-82624044fe98 admin admin] RBAC: Authorizing `identity:get_project(project_id=a3015b5ef9e64185ad329e29c6fb9132)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:07.444390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9452dd2-008f-4709-bc4b-82624044fe98 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:07.445912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 681/1362] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:55:07 2022] GET /identity/v3/projects/a3015b5ef9e64185ad329e29c6fb9132 => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:07.452251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a852e-fc72-4a70-b781-7e513dc35b48 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:07.461098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a852e-fc72-4a70-b781-7e513dc35b48 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:07.465369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb50ef-2235-457a-978a-37cf069f20b3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0LX_hVHcSpqqRJgdvA0hXA, audit_chain_id=['0LX_hVHcSpqqRJgdvA0hXA']) at 0x7fe09e3c48e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:07.465939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb50ef-2235-457a-978a-37cf069f20b3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.466222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb50ef-2235-457a-978a-37cf069f20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.466503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb50ef-2235-457a-978a-37cf069f20b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.467812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb50ef-2235-457a-978a-37cf069f20b3 admin admin] RBAC: Adding query filter params (scope.project.id=a3015b5ef9e64185ad329e29c6fb9132) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:55:07.468108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb50ef-2235-457a-978a-37cf069f20b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:07.469959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb50ef-2235-457a-978a-37cf069f20b3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:07.475154 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 682/1363] 10.222.0.21 () {56 vars in 1231 bytes} [Mon Feb 28 18:55:07 2022] GET /identity/v3/role_assignments?scope.project.id=a3015b5ef9e64185ad329e29c6fb9132 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:07.480676 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9452dd2-008f-4709-bc4b-82624044fe98 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:07.489892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9452dd2-008f-4709-bc4b-82624044fe98 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:07.494034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dde6d-3c13-46eb-9474-583acec895b2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0LX_hVHcSpqqRJgdvA0hXA, audit_chain_id=['0LX_hVHcSpqqRJgdvA0hXA']) at 0x7fe09ded1850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:07.494807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dde6d-3c13-46eb-9474-583acec895b2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.495094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dde6d-3c13-46eb-9474-583acec895b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.495407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dde6d-3c13-46eb-9474-583acec895b2 admin admin] PATH_INFO: `/v3/users/c212e52c7aa24814918691132aeb64af` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.513212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dde6d-3c13-46eb-9474-583acec895b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=c212e52c7aa24814918691132aeb64af)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:07.516186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dde6d-3c13-46eb-9474-583acec895b2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:07.517678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 682/1364] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:55:07 2022] GET /identity/v3/users/c212e52c7aa24814918691132aeb64af => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:09.680447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c80cc-bdd1-4b75-b884-a60c8cd0c4ff None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:09.680998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c80cc-bdd1-4b75-b884-a60c8cd0c4ff None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:09.680998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c80cc-bdd1-4b75-b884-a60c8cd0c4ff None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:09.682740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 683/1365] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:09.688354 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf56e-412e-4a4a-bb5e-4462eff64712 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:09.688809 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf56e-412e-4a4a-bb5e-4462eff64712 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:09.688917 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf56e-412e-4a4a-bb5e-4462eff64712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:09.710911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-647cf56e-412e-4a4a-bb5e-4462eff64712 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:09.712092 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-647cf56e-412e-4a4a-bb5e-4462eff64712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:09.720027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 683/1366] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:55:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:09.742734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c80cc-bdd1-4b75-b884-a60c8cd0c4ff None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:09.755380 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c80cc-bdd1-4b75-b884-a60c8cd0c4ff None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:09.759870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b3659-7c25-4508-8ef8-2d5ac240b5de admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=64fVCiTkR1aoSTyULDj5Ew, audit_chain_id=['64fVCiTkR1aoSTyULDj5Ew']) at 0x7fe09de8eb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:09.760651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b3659-7c25-4508-8ef8-2d5ac240b5de admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:09.760939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b3659-7c25-4508-8ef8-2d5ac240b5de admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:09.761222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b3659-7c25-4508-8ef8-2d5ac240b5de admin admin] PATH_INFO: `/v3/projects/ac76409d077b47e09b22f91e992c58e0` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:09.773699 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b3659-7c25-4508-8ef8-2d5ac240b5de admin admin] RBAC: Authorizing `identity:get_project(project_id=ac76409d077b47e09b22f91e992c58e0)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:09.775777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b3659-7c25-4508-8ef8-2d5ac240b5de admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:09.777307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 684/1367] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:55:09 2022] GET /identity/v3/projects/ac76409d077b47e09b22f91e992c58e0 => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:09.783995 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cf56e-412e-4a4a-bb5e-4462eff64712 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:09.792628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cf56e-412e-4a4a-bb5e-4462eff64712 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:09.797021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3374c3-e261-49ff-a41d-c3a02623f277 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=64fVCiTkR1aoSTyULDj5Ew, audit_chain_id=['64fVCiTkR1aoSTyULDj5Ew']) at 0x7fe09e347310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:09.797594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3374c3-e261-49ff-a41d-c3a02623f277 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:09.797880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3374c3-e261-49ff-a41d-c3a02623f277 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:09.798163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3374c3-e261-49ff-a41d-c3a02623f277 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:09.798872 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3374c3-e261-49ff-a41d-c3a02623f277 admin admin] RBAC: Adding query filter params (scope.project.id=ac76409d077b47e09b22f91e992c58e0) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:55:09.799204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3374c3-e261-49ff-a41d-c3a02623f277 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:09.801011 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3374c3-e261-49ff-a41d-c3a02623f277 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:09.806192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 684/1368] 10.222.0.21 () {56 vars in 1231 bytes} [Mon Feb 28 18:55:09 2022] GET /identity/v3/role_assignments?scope.project.id=ac76409d077b47e09b22f91e992c58e0 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:09.812071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b3659-7c25-4508-8ef8-2d5ac240b5de admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:09.821313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b3659-7c25-4508-8ef8-2d5ac240b5de admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:09.825674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9366a05-10ed-40cc-8a6e-26993c280c1e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=64fVCiTkR1aoSTyULDj5Ew, audit_chain_id=['64fVCiTkR1aoSTyULDj5Ew']) at 0x7fe09e3e0eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:09.827077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366a05-10ed-40cc-8a6e-26993c280c1e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:09.827392 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366a05-10ed-40cc-8a6e-26993c280c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:09.827676 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366a05-10ed-40cc-8a6e-26993c280c1e admin admin] PATH_INFO: `/v3/users/e3f706901c1d4191ada8dd10650391b6` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:09.828777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9366a05-10ed-40cc-8a6e-26993c280c1e admin admin] RBAC: Authorizing `identity:get_user(user_id=e3f706901c1d4191ada8dd10650391b6)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:09.830847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9366a05-10ed-40cc-8a6e-26993c280c1e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:09.832314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 685/1369] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:55:09 2022] GET /identity/v3/users/e3f706901c1d4191ada8dd10650391b6 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:11.985413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57750df4-2570-475c-9860-3658e741319a None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:11.985852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57750df4-2570-475c-9860-3658e741319a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:11.985980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57750df4-2570-475c-9860-3658e741319a None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:11.987706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 685/1370] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:11.992809 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb56c7-ac73-4ed2-8ec6-d590c95af443 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:11.993241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb56c7-ac73-4ed2-8ec6-d590c95af443 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:11.993372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb56c7-ac73-4ed2-8ec6-d590c95af443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:12.015587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-2dfb56c7-ac73-4ed2-8ec6-d590c95af443 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:12.016714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-2dfb56c7-ac73-4ed2-8ec6-d590c95af443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:12.023750 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 686/1371] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:55:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:12.048082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57750df4-2570-475c-9860-3658e741319a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:12.060877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57750df4-2570-475c-9860-3658e741319a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:12.065070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97647617-a6e7-4e87-b196-b6e085a7d56e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=I3aRg8EBQY6c4gUZMxf09g, audit_chain_id=['I3aRg8EBQY6c4gUZMxf09g']) at 0x7fe09e108c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:12.065847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97647617-a6e7-4e87-b196-b6e085a7d56e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:12.066139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97647617-a6e7-4e87-b196-b6e085a7d56e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:12.066426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97647617-a6e7-4e87-b196-b6e085a7d56e admin admin] PATH_INFO: `/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:12.079098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97647617-a6e7-4e87-b196-b6e085a7d56e admin admin] RBAC: Authorizing `identity:get_project(project_id=ebf0ce0f7be945acb98504a4a7b8f347)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:12.081169 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97647617-a6e7-4e87-b196-b6e085a7d56e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:12.082717 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 686/1372] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 18:55:12 2022] GET /identity/v3/projects/ebf0ce0f7be945acb98504a4a7b8f347 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:12.088891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb56c7-ac73-4ed2-8ec6-d590c95af443 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:12.098393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb56c7-ac73-4ed2-8ec6-d590c95af443 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:12.102851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f0123-1006-4eb2-b017-50ad23a1df97 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=I3aRg8EBQY6c4gUZMxf09g, audit_chain_id=['I3aRg8EBQY6c4gUZMxf09g']) at 0x7fe09e1983a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:12.103536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0123-1006-4eb2-b017-50ad23a1df97 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:12.103825 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0123-1006-4eb2-b017-50ad23a1df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:12.104102 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0123-1006-4eb2-b017-50ad23a1df97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:12.104820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f0123-1006-4eb2-b017-50ad23a1df97 admin admin] RBAC: Adding query filter params (scope.project.id=ebf0ce0f7be945acb98504a4a7b8f347) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:55:12.105115 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f0123-1006-4eb2-b017-50ad23a1df97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:12.106977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f0123-1006-4eb2-b017-50ad23a1df97 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:12.113027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 687/1373] 10.222.0.21 () {56 vars in 1231 bytes} [Mon Feb 28 18:55:12 2022] GET /identity/v3/role_assignments?scope.project.id=ebf0ce0f7be945acb98504a4a7b8f347 => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:12.118638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97647617-a6e7-4e87-b196-b6e085a7d56e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:12.128914 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97647617-a6e7-4e87-b196-b6e085a7d56e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:12.133218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49633be-dbfe-45ce-b7ef-08041ea4cb12 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=I3aRg8EBQY6c4gUZMxf09g, audit_chain_id=['I3aRg8EBQY6c4gUZMxf09g']) at 0x7fe09df25760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:12.134001 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49633be-dbfe-45ce-b7ef-08041ea4cb12 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:12.134294 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49633be-dbfe-45ce-b7ef-08041ea4cb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:12.134577 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49633be-dbfe-45ce-b7ef-08041ea4cb12 admin admin] PATH_INFO: `/v3/users/7174c05300674bfc821801baf3d17078` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:12.153830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49633be-dbfe-45ce-b7ef-08041ea4cb12 admin admin] RBAC: Authorizing `identity:get_user(user_id=7174c05300674bfc821801baf3d17078)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:12.156567 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49633be-dbfe-45ce-b7ef-08041ea4cb12 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:12.158063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 687/1374] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:55:12 2022] GET /identity/v3/users/7174c05300674bfc821801baf3d17078 => generated 285 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:12.163753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f0123-1006-4eb2-b017-50ad23a1df97 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:12.173643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f0123-1006-4eb2-b017-50ad23a1df97 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:12.178025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c7bf2-0594-4efb-89d6-3bd620f1ea28 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=I3aRg8EBQY6c4gUZMxf09g, audit_chain_id=['I3aRg8EBQY6c4gUZMxf09g']) at 0x7fe09e795d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:12.178855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c7bf2-0594-4efb-89d6-3bd620f1ea28 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:12.179309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c7bf2-0594-4efb-89d6-3bd620f1ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:12.179593 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c7bf2-0594-4efb-89d6-3bd620f1ea28 admin admin] PATH_INFO: `/v3/users/02f12245badd41448bca8b4e8ac507ac` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:12.199204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c7bf2-0594-4efb-89d6-3bd620f1ea28 admin admin] RBAC: Authorizing `identity:get_user(user_id=02f12245badd41448bca8b4e8ac507ac)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:12.213155 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c7bf2-0594-4efb-89d6-3bd620f1ea28 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:12.213155 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 688/1375] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 18:55:12 2022] GET /identity/v3/users/02f12245badd41448bca8b4e8ac507ac => generated 286 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:17.264782 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dba769-1d15-4f35-9af3-7dea3874df70 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:17.265355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dba769-1d15-4f35-9af3-7dea3874df70 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:17.265355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dba769-1d15-4f35-9af3-7dea3874df70 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:17.266999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 688/1376] 10.222.0.21 () {54 vars in 918 bytes} [Mon Feb 28 18:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:17.272108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1a5de-7688-48e5-b3ed-ddd6c4c1f413 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:17.272556 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1a5de-7688-48e5-b3ed-ddd6c4c1f413 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:17.272709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1a5de-7688-48e5-b3ed-ddd6c4c1f413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:17.295570 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-cfb1a5de-7688-48e5-b3ed-ddd6c4c1f413 None None] MFA Rules not processed for user `2f330acd453f445ea31acf9fc43b53ad`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:17.296701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-cfb1a5de-7688-48e5-b3ed-ddd6c4c1f413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:17.304284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 689/1377] 10.222.0.21 () {58 vars in 1015 bytes} [Mon Feb 28 18:55:17 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:17.318505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e51ca-7ad9-4e34-b044-991e20cdbbca None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:17.318804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e51ca-7ad9-4e34-b044-991e20cdbbca None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:17.319138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e51ca-7ad9-4e34-b044-991e20cdbbca None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:17.320795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 689/1378] 10.222.0.21 () {54 vars in 918 bytes} [Mon Feb 28 18:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:17.325519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da4a58-f69c-41c3-bcbb-24c422b04029 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:17.325840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da4a58-f69c-41c3-bcbb-24c422b04029 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:17.326116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da4a58-f69c-41c3-bcbb-24c422b04029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:17.347824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-79da4a58-f69c-41c3-bcbb-24c422b04029 None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:17.348967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-79da4a58-f69c-41c3-bcbb-24c422b04029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:17.357056 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 690/1379] 10.222.0.21 () {58 vars in 1015 bytes} [Mon Feb 28 18:55:17 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:19.836930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d3911-82e3-4675-8506-20d6034364cd None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.837502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d3911-82e3-4675-8506-20d6034364cd None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.837605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d3911-82e3-4675-8506-20d6034364cd None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.839267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 690/1380] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:19.845178 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389bf2a-19d3-4367-860d-d0cd596ad245 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.845603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389bf2a-19d3-4367-860d-d0cd596ad245 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.845773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389bf2a-19d3-4367-860d-d0cd596ad245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.868040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f389bf2a-19d3-4367-860d-d0cd596ad245 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:19.869172 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f389bf2a-19d3-4367-860d-d0cd596ad245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:19.876488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 691/1381] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:55:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:19.918240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d3911-82e3-4675-8506-20d6034364cd None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:19.933137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d3911-82e3-4675-8506-20d6034364cd None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:19.939058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfa794-3596-40d8-ad8a-cf3241a2de53 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09df39df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:19.939668 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfa794-3596-40d8-ad8a-cf3241a2de53 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.939965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfa794-3596-40d8-ad8a-cf3241a2de53 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.940252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfa794-3596-40d8-ad8a-cf3241a2de53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.948269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfa794-3596-40d8-ad8a-cf3241a2de53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:19.949832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfa794-3596-40d8-ad8a-cf3241a2de53 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:19.959394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 691/1382] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:19 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:21.376473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132480d0-f4e7-4e8c-b53c-83c7318a0ee2 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:21.377010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132480d0-f4e7-4e8c-b53c-83c7318a0ee2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:21.377010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132480d0-f4e7-4e8c-b53c-83c7318a0ee2 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:21.378629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 692/1383] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:21.383799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa97e15-bedc-484f-beab-156afe70d62e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:21.384201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa97e15-bedc-484f-beab-156afe70d62e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:21.384408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa97e15-bedc-484f-beab-156afe70d62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:21.406713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-daa97e15-bedc-484f-beab-156afe70d62e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:21.407878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-daa97e15-bedc-484f-beab-156afe70d62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:21.415015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 692/1384] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:55:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:55:21.564393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132480d0-f4e7-4e8c-b53c-83c7318a0ee2 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:21.578476 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132480d0-f4e7-4e8c-b53c-83c7318a0ee2 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:21.583489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8f02f-2918-41eb-a3be-5bbc35dca087 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09e1fb640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:21.584055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8f02f-2918-41eb-a3be-5bbc35dca087 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:21.584361 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8f02f-2918-41eb-a3be-5bbc35dca087 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:21.584639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8f02f-2918-41eb-a3be-5bbc35dca087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:21.593346 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8f02f-2918-41eb-a3be-5bbc35dca087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:21.594917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8f02f-2918-41eb-a3be-5bbc35dca087 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:21.603840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 693/1385] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:21 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:23.018049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02fa66-8e33-4f18-881e-769329e63f84 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:23.018559 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02fa66-8e33-4f18-881e-769329e63f84 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:23.018669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02fa66-8e33-4f18-881e-769329e63f84 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:23.020313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 693/1386] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:23.025211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707feb8e-fa1a-4f9c-8791-bcb09f44d70a None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:23.026162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707feb8e-fa1a-4f9c-8791-bcb09f44d70a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:23.026453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707feb8e-fa1a-4f9c-8791-bcb09f44d70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:23.050020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-707feb8e-fa1a-4f9c-8791-bcb09f44d70a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:23.051202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-707feb8e-fa1a-4f9c-8791-bcb09f44d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:23.058308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 694/1387] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:55:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:23.207965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02fa66-8e33-4f18-881e-769329e63f84 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:23.221590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02fa66-8e33-4f18-881e-769329e63f84 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:23.226774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072d2da-a79e-4b8c-8a3c-e196c35c1bd1 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09df390a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:23.227328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072d2da-a79e-4b8c-8a3c-e196c35c1bd1 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:23.227623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072d2da-a79e-4b8c-8a3c-e196c35c1bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:23.227911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072d2da-a79e-4b8c-8a3c-e196c35c1bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:23.236508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072d2da-a79e-4b8c-8a3c-e196c35c1bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:23.238077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072d2da-a79e-4b8c-8a3c-e196c35c1bd1 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:23.246916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 694/1388] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:24.671124 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0888355-0d22-4391-b32c-e0176c254bfa None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:24.671736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0888355-0d22-4391-b32c-e0176c254bfa None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:24.671736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0888355-0d22-4391-b32c-e0176c254bfa None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:24.673387 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 695/1389] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:55:24.678302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86994c0-e510-41fe-9b7e-5fea5bd0ac69 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:24.678746 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86994c0-e510-41fe-9b7e-5fea5bd0ac69 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:24.678855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86994c0-e510-41fe-9b7e-5fea5bd0ac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:24.701352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-c86994c0-e510-41fe-9b7e-5fea5bd0ac69 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:24.702514 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c86994c0-e510-41fe-9b7e-5fea5bd0ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:24.709527 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 695/1390] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:55:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:24.860751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0888355-0d22-4391-b32c-e0176c254bfa None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:24.876365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0888355-0d22-4391-b32c-e0176c254bfa None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:24.881327 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ce76c-3e5b-4c52-bc5d-7d9a11de2d22 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09e1b0850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:24.881896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce76c-3e5b-4c52-bc5d-7d9a11de2d22 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:24.882182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce76c-3e5b-4c52-bc5d-7d9a11de2d22 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:24.882462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce76c-3e5b-4c52-bc5d-7d9a11de2d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:24.891570 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ce76c-3e5b-4c52-bc5d-7d9a11de2d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:24.893154 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ce76c-3e5b-4c52-bc5d-7d9a11de2d22 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:24.902328 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 696/1391] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:24 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:26.319218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4b240-718e-44eb-8fd0-dc5db588148b None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:26.319789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4b240-718e-44eb-8fd0-dc5db588148b None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:26.319789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4b240-718e-44eb-8fd0-dc5db588148b None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:26.321450 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 696/1392] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:26.327136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8aead-e781-467a-8409-4b909dba4968 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:26.327558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8aead-e781-467a-8409-4b909dba4968 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:26.327711 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8aead-e781-467a-8409-4b909dba4968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:26.350207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-baa8aead-e781-467a-8409-4b909dba4968 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:26.351372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-baa8aead-e781-467a-8409-4b909dba4968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:26.358521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 697/1393] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:55:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:26.511347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4b240-718e-44eb-8fd0-dc5db588148b None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:26.525207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4b240-718e-44eb-8fd0-dc5db588148b None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:26.530867 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013770a-e4a6-47af-bdfe-2d0afd6c0595 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09e21e370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:26.531588 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013770a-e4a6-47af-bdfe-2d0afd6c0595 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:26.531882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013770a-e4a6-47af-bdfe-2d0afd6c0595 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:26.532163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013770a-e4a6-47af-bdfe-2d0afd6c0595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:26.539969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013770a-e4a6-47af-bdfe-2d0afd6c0595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:26.541527 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013770a-e4a6-47af-bdfe-2d0afd6c0595 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:26.551518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 697/1394] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:26 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:27.969353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8b4c3-cc0d-4a87-9766-f24b0ba83c9e None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:27.969891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8b4c3-cc0d-4a87-9766-f24b0ba83c9e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:27.970153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8b4c3-cc0d-4a87-9766-f24b0ba83c9e None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:27.972006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 698/1395] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:27.977231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198315dc-c635-42b6-923b-c2f249f2d208 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:27.977678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198315dc-c635-42b6-923b-c2f249f2d208 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:27.977933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198315dc-c635-42b6-923b-c2f249f2d208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:28.001140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-198315dc-c635-42b6-923b-c2f249f2d208 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:28.002339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-198315dc-c635-42b6-923b-c2f249f2d208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:28.009402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 698/1396] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:55:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:28.160708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8b4c3-cc0d-4a87-9766-f24b0ba83c9e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:28.174830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8b4c3-cc0d-4a87-9766-f24b0ba83c9e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:28.179826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fe967-bb84-4b07-bd3b-310335a0c292 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09e1b0f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:28.180393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fe967-bb84-4b07-bd3b-310335a0c292 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:28.180819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fe967-bb84-4b07-bd3b-310335a0c292 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:28.181125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fe967-bb84-4b07-bd3b-310335a0c292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:28.189800 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fe967-bb84-4b07-bd3b-310335a0c292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:28.191393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fe967-bb84-4b07-bd3b-310335a0c292 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:28.200191 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 699/1397] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:29.617672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3e52f-c4a0-4a1a-a3ca-25c16270dfb2 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:29.618303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3e52f-c4a0-4a1a-a3ca-25c16270dfb2 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:29.618303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3e52f-c4a0-4a1a-a3ca-25c16270dfb2 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:29.619986 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 699/1398] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:29.625111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ccee-3f49-47c7-b106-01cfaab260f6 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:29.625547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ccee-3f49-47c7-b106-01cfaab260f6 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:29.625678 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ccee-3f49-47c7-b106-01cfaab260f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:29.648025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-8bf2ccee-3f49-47c7-b106-01cfaab260f6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:29.649147 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8bf2ccee-3f49-47c7-b106-01cfaab260f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:29.656877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 700/1399] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:55:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:29.806536 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3e52f-c4a0-4a1a-a3ca-25c16270dfb2 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:29.820950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3e52f-c4a0-4a1a-a3ca-25c16270dfb2 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:29.826604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5f9d8-0359-4641-b1ba-4c865bc0dc60 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09e108b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:29.827202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5f9d8-0359-4641-b1ba-4c865bc0dc60 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:29.827492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5f9d8-0359-4641-b1ba-4c865bc0dc60 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:29.827774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5f9d8-0359-4641-b1ba-4c865bc0dc60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:29.835577 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5f9d8-0359-4641-b1ba-4c865bc0dc60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:29.837147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5f9d8-0359-4641-b1ba-4c865bc0dc60 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:29.846044 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 700/1400] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:29 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:31.256771 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9a35-5795-46c1-811c-7f84a5e728dd None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:31.257309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9a35-5795-46c1-811c-7f84a5e728dd None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:31.257309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9a35-5795-46c1-811c-7f84a5e728dd None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:31.258926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 701/1401] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:31.264476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0ad17-0ff1-4f96-af8f-170d51fc7d9e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:31.264916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0ad17-0ff1-4f96-af8f-170d51fc7d9e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:31.265050 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0ad17-0ff1-4f96-af8f-170d51fc7d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:31.287369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-5fa0ad17-0ff1-4f96-af8f-170d51fc7d9e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:31.288517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-5fa0ad17-0ff1-4f96-af8f-170d51fc7d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:31.295924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 701/1402] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:55:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:31.446319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e9a35-5795-46c1-811c-7f84a5e728dd None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:31.460401 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e9a35-5795-46c1-811c-7f84a5e728dd None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:31.465371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4737f-3b45-4345-9759-c243b7ddccf7 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09ded6940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:31.465939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4737f-3b45-4345-9759-c243b7ddccf7 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:31.466263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4737f-3b45-4345-9759-c243b7ddccf7 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:31.466551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4737f-3b45-4345-9759-c243b7ddccf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:31.474450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4737f-3b45-4345-9759-c243b7ddccf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:31.476073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4737f-3b45-4345-9759-c243b7ddccf7 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:31.485070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 702/1403] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:32.889130 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d384a8-88ff-4bb0-ab93-570029f867d4 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:32.889671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d384a8-88ff-4bb0-ab93-570029f867d4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:32.889671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d384a8-88ff-4bb0-ab93-570029f867d4 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:32.891344 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 702/1404] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:32.896347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68443-3d6b-4c13-84af-1d567dff3197 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:32.896787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68443-3d6b-4c13-84af-1d567dff3197 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:32.896950 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68443-3d6b-4c13-84af-1d567dff3197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:32.921475 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-19b68443-3d6b-4c13-84af-1d567dff3197 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:32.922616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-19b68443-3d6b-4c13-84af-1d567dff3197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:32.929935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 703/1405] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:55:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:55:33.079386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d384a8-88ff-4bb0-ab93-570029f867d4 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:33.093280 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d384a8-88ff-4bb0-ab93-570029f867d4 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:33.098220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87974732-0394-4dac-859e-c3d0e07bc1c8 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09defe6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:33.098793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974732-0394-4dac-859e-c3d0e07bc1c8 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:33.099084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974732-0394-4dac-859e-c3d0e07bc1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:33.099403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974732-0394-4dac-859e-c3d0e07bc1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:33.107812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87974732-0394-4dac-859e-c3d0e07bc1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:33.109391 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87974732-0394-4dac-859e-c3d0e07bc1c8 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:33.118191 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 703/1406] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:35.170629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c8461-1445-464b-b151-d5542d3926a8 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:35.170629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c8461-1445-464b-b151-d5542d3926a8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:35.170629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c8461-1445-464b-b151-d5542d3926a8 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:35.170629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 704/1407] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:35.176707 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953aa47-f283-4569-9a5a-2f20b3c19f13 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:35.177153 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953aa47-f283-4569-9a5a-2f20b3c19f13 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:35.177288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953aa47-f283-4569-9a5a-2f20b3c19f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:35.202488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f953aa47-f283-4569-9a5a-2f20b3c19f13 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:35.203686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f953aa47-f283-4569-9a5a-2f20b3c19f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:35.210829 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 704/1408] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:55:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:35.250176 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c8461-1445-464b-b151-d5542d3926a8 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:35.260782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c8461-1445-464b-b151-d5542d3926a8 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:35.265019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88e17d-ee78-4763-ad26-f82ce50d59d9 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09de9d550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:35.265603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e17d-ee78-4763-ad26-f82ce50d59d9 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:35.265887 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e17d-ee78-4763-ad26-f82ce50d59d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:35.266276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88e17d-ee78-4763-ad26-f82ce50d59d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:35.275156 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88e17d-ee78-4763-ad26-f82ce50d59d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:35.276622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88e17d-ee78-4763-ad26-f82ce50d59d9 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:35.285410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 705/1409] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:37.534676 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53d906-f240-46b9-a205-ae12a4da61fd None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:37.535216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53d906-f240-46b9-a205-ae12a4da61fd None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:37.535216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53d906-f240-46b9-a205-ae12a4da61fd None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:37.536855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 705/1410] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:37.542395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e6ffe-53ef-414f-a6a7-1cd6ca3f4fea None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:37.542805 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e6ffe-53ef-414f-a6a7-1cd6ca3f4fea None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:37.542951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e6ffe-53ef-414f-a6a7-1cd6ca3f4fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:37.566590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d16e6ffe-53ef-414f-a6a7-1cd6ca3f4fea None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:37.567901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d16e6ffe-53ef-414f-a6a7-1cd6ca3f4fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:37.576236 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 706/1411] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:55:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:37.614179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53d906-f240-46b9-a205-ae12a4da61fd None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:37.625276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53d906-f240-46b9-a205-ae12a4da61fd None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:37.628750 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02059-c500-42c9-b1d7-e2aeb6ea33e8 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09de8ae20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:37.629322 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02059-c500-42c9-b1d7-e2aeb6ea33e8 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:37.629610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02059-c500-42c9-b1d7-e2aeb6ea33e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:37.629892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02059-c500-42c9-b1d7-e2aeb6ea33e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:37.639488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02059-c500-42c9-b1d7-e2aeb6ea33e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:37.640952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02059-c500-42c9-b1d7-e2aeb6ea33e8 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:37.650133 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 706/1412] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:37 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:40.305509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d5743-30b1-494d-a0df-7f7041e46a11 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:40.306019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d5743-30b1-494d-a0df-7f7041e46a11 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:40.306019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d5743-30b1-494d-a0df-7f7041e46a11 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:40.307804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 707/1413] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:40.313260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad1d54-d91f-4d34-bf4d-1e75a9a9ccd7 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:40.313712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad1d54-d91f-4d34-bf4d-1e75a9a9ccd7 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:40.313808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad1d54-d91f-4d34-bf4d-1e75a9a9ccd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:40.335508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-21ad1d54-d91f-4d34-bf4d-1e75a9a9ccd7 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:40.336638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-21ad1d54-d91f-4d34-bf4d-1e75a9a9ccd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:40.344248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 707/1414] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:55:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:40.383449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d5743-30b1-494d-a0df-7f7041e46a11 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:40.393895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d5743-30b1-494d-a0df-7f7041e46a11 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:40.397252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69c09b-69db-49cd-8cfb-25ed0ffa7427 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e922fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:40.397816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69c09b-69db-49cd-8cfb-25ed0ffa7427 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:40.398106 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69c09b-69db-49cd-8cfb-25ed0ffa7427 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:40.398387 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69c09b-69db-49cd-8cfb-25ed0ffa7427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:40.407790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69c09b-69db-49cd-8cfb-25ed0ffa7427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:40.409213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69c09b-69db-49cd-8cfb-25ed0ffa7427 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:40.417968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 708/1415] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:42.644109 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d770-8e44-4404-b16f-d7014569f476 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:42.644691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d770-8e44-4404-b16f-d7014569f476 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:42.644691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d770-8e44-4404-b16f-d7014569f476 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:42.646355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 708/1416] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:42.651932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7961385-8d5a-4c89-9ab7-0e1bca8c3a40 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:42.652362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7961385-8d5a-4c89-9ab7-0e1bca8c3a40 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:42.652474 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7961385-8d5a-4c89-9ab7-0e1bca8c3a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:42.674818 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f7961385-8d5a-4c89-9ab7-0e1bca8c3a40 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:42.675844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f7961385-8d5a-4c89-9ab7-0e1bca8c3a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:42.686014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 709/1417] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:55:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:42.725635 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7d770-8e44-4404-b16f-d7014569f476 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:42.736410 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7d770-8e44-4404-b16f-d7014569f476 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:42.739747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31680e0-7f6e-49e7-a711-c0faa7e3f482 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09df25160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:42.740321 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31680e0-7f6e-49e7-a711-c0faa7e3f482 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:42.740608 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31680e0-7f6e-49e7-a711-c0faa7e3f482 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:42.740887 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31680e0-7f6e-49e7-a711-c0faa7e3f482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:42.750252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31680e0-7f6e-49e7-a711-c0faa7e3f482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:42.751701 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31680e0-7f6e-49e7-a711-c0faa7e3f482 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:42.760408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 709/1418] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:44.984843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec6a5b-7fb6-4c54-8b76-ebf55ae65946 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:44.985310 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec6a5b-7fb6-4c54-8b76-ebf55ae65946 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:44.985412 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec6a5b-7fb6-4c54-8b76-ebf55ae65946 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:44.987080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 710/1419] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:44.992231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eecb5-4273-4fb2-9209-44c056915a35 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:44.992657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eecb5-4273-4fb2-9209-44c056915a35 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:44.992812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eecb5-4273-4fb2-9209-44c056915a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:45.014488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-ea7eecb5-4273-4fb2-9209-44c056915a35 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:45.015681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ea7eecb5-4273-4fb2-9209-44c056915a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:45.022768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 710/1420] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:55:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:45.062740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec6a5b-7fb6-4c54-8b76-ebf55ae65946 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:45.073415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec6a5b-7fb6-4c54-8b76-ebf55ae65946 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:45.077570 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368518b-f366-47a0-9992-2d01c6c06779 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e3e9730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:45.078162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368518b-f366-47a0-9992-2d01c6c06779 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:45.078447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368518b-f366-47a0-9992-2d01c6c06779 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:45.078724 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368518b-f366-47a0-9992-2d01c6c06779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:45.087730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368518b-f366-47a0-9992-2d01c6c06779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:45.089141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368518b-f366-47a0-9992-2d01c6c06779 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:45.098914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 711/1421] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:47.320552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe335f-dc69-42f2-a83f-b35399b7b75f None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:47.321070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe335f-dc69-42f2-a83f-b35399b7b75f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:47.321070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe335f-dc69-42f2-a83f-b35399b7b75f None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:47.322738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 711/1422] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:47.327931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef4234-2aae-4732-bbb0-726eedf2d733 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:47.328376 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef4234-2aae-4732-bbb0-726eedf2d733 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:47.328478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef4234-2aae-4732-bbb0-726eedf2d733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:47.351342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a1ef4234-2aae-4732-bbb0-726eedf2d733 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:47.352603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a1ef4234-2aae-4732-bbb0-726eedf2d733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:47.360347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 712/1423] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:55:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:47.398570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe335f-dc69-42f2-a83f-b35399b7b75f None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:47.409436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe335f-dc69-42f2-a83f-b35399b7b75f None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:47.412734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c49c3-fa06-4951-b5f3-799609f80b6f service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09defe6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:47.413294 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c49c3-fa06-4951-b5f3-799609f80b6f service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:47.413674 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c49c3-fa06-4951-b5f3-799609f80b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:47.413959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c49c3-fa06-4951-b5f3-799609f80b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:47.422727 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c49c3-fa06-4951-b5f3-799609f80b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:47.424166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c49c3-fa06-4951-b5f3-799609f80b6f service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:47.432935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 712/1424] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:49.715773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4d71b-be16-4592-bbb9-60d0c8aea029 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:49.716349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4d71b-be16-4592-bbb9-60d0c8aea029 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:49.716492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4d71b-be16-4592-bbb9-60d0c8aea029 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:49.718179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 713/1425] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:55:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:49.723587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187a2fc-0218-43a7-8a1c-6904bf405520 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:49.724021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187a2fc-0218-43a7-8a1c-6904bf405520 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:49.724136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187a2fc-0218-43a7-8a1c-6904bf405520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:49.746286 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4187a2fc-0218-43a7-8a1c-6904bf405520 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:49.748141 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4187a2fc-0218-43a7-8a1c-6904bf405520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:49.755251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 713/1426] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:55:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:49.792378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4d71b-be16-4592-bbb9-60d0c8aea029 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:49.803377 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4d71b-be16-4592-bbb9-60d0c8aea029 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:49.806689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb6caa-93a1-463e-8972-1d76bd3c0b40 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09deb4df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:49.807295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb6caa-93a1-463e-8972-1d76bd3c0b40 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:49.807585 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb6caa-93a1-463e-8972-1d76bd3c0b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:49.807867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb6caa-93a1-463e-8972-1d76bd3c0b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:49.817624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb6caa-93a1-463e-8972-1d76bd3c0b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:49.819129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb6caa-93a1-463e-8972-1d76bd3c0b40 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:49.828746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 714/1427] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:49 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:51.982381 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9d791-a0ad-4c68-94e4-79f999c125fd None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:51.982952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9d791-a0ad-4c68-94e4-79f999c125fd None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:51.982952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9d791-a0ad-4c68-94e4-79f999c125fd None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:51.984791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 714/1428] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:51.990217 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aa0dd-011c-4559-80d6-2554b51766f8 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:51.990649 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aa0dd-011c-4559-80d6-2554b51766f8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:51.990789 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aa0dd-011c-4559-80d6-2554b51766f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:52.015060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b58aa0dd-011c-4559-80d6-2554b51766f8 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:52.016244 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b58aa0dd-011c-4559-80d6-2554b51766f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:52.023425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 715/1429] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:55:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:52.061953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9d791-a0ad-4c68-94e4-79f999c125fd None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:52.072625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9d791-a0ad-4c68-94e4-79f999c125fd None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:52.075986 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f379bf-321f-450d-a5c9-abb05eee39c4 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e55f610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:52.076563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f379bf-321f-450d-a5c9-abb05eee39c4 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:52.076849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f379bf-321f-450d-a5c9-abb05eee39c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:52.077157 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f379bf-321f-450d-a5c9-abb05eee39c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:52.085832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f379bf-321f-450d-a5c9-abb05eee39c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:52.087306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f379bf-321f-450d-a5c9-abb05eee39c4 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:52.096389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 715/1430] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:54.239790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e9bc-dd2d-40f6-9668-9d7a1e8b4255 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:54.240332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e9bc-dd2d-40f6-9668-9d7a1e8b4255 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:54.240332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e9bc-dd2d-40f6-9668-9d7a1e8b4255 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:54.241986 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 716/1431] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:54.247964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d943bb-3cfe-4462-960d-698f157a5058 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:54.248422 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d943bb-3cfe-4462-960d-698f157a5058 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:54.248541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d943bb-3cfe-4462-960d-698f157a5058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:54.271354 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-e8d943bb-3cfe-4462-960d-698f157a5058 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:54.272501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e8d943bb-3cfe-4462-960d-698f157a5058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:54.280789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 716/1432] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:55:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:54.318885 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8e9bc-dd2d-40f6-9668-9d7a1e8b4255 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:54.320553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-99f8e9bc-dd2d-40f6-9668-9d7a1e8b4255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:54.333815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8e9bc-dd2d-40f6-9668-9d7a1e8b4255 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:54.337220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe9e81-94a3-4849-b1b9-025ccb7bf00e service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09ea23880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:54.337796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe9e81-94a3-4849-b1b9-025ccb7bf00e service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:54.338087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe9e81-94a3-4849-b1b9-025ccb7bf00e service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:54.338371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe9e81-94a3-4849-b1b9-025ccb7bf00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:54.347945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe9e81-94a3-4849-b1b9-025ccb7bf00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:54.349357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe9e81-94a3-4849-b1b9-025ccb7bf00e service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:54.358353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 717/1433] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:56.531410 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3602f6-d0ce-4c8d-b721-ae191bec680e None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:56.532001 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3602f6-d0ce-4c8d-b721-ae191bec680e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:56.532001 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3602f6-d0ce-4c8d-b721-ae191bec680e None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:56.533657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 717/1434] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:55:56.538943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4aab3-4e2b-4bad-a13d-247b497810b3 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:56.539409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4aab3-4e2b-4bad-a13d-247b497810b3 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:56.539696 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4aab3-4e2b-4bad-a13d-247b497810b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:56.563269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-05b4aab3-4e2b-4bad-a13d-247b497810b3 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:56.564406 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-05b4aab3-4e2b-4bad-a13d-247b497810b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:56.571515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 718/1435] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:55:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:56.609075 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3602f6-d0ce-4c8d-b721-ae191bec680e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:56.619497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3602f6-d0ce-4c8d-b721-ae191bec680e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:56.623515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7550949-4f1e-4f2c-bbfc-b0125fb1bed0 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e15e1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:56.624087 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7550949-4f1e-4f2c-bbfc-b0125fb1bed0 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:56.624376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7550949-4f1e-4f2c-bbfc-b0125fb1bed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:56.624656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7550949-4f1e-4f2c-bbfc-b0125fb1bed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:56.633225 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7550949-4f1e-4f2c-bbfc-b0125fb1bed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:56.634642 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7550949-4f1e-4f2c-bbfc-b0125fb1bed0 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:55:56.643582 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 718/1436] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:56:09.098542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfd1c4-eeae-41a6-968d-6515c39721d9 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:09.099051 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfd1c4-eeae-41a6-968d-6515c39721d9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:09.099216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfd1c4-eeae-41a6-968d-6515c39721d9 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:09.100813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 719/1437] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:56:09.106146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc709d6e-a0b6-4fb6-b3a8-98e24dfee871 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:09.106595 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc709d6e-a0b6-4fb6-b3a8-98e24dfee871 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:09.106803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc709d6e-a0b6-4fb6-b3a8-98e24dfee871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:09.129170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-fc709d6e-a0b6-4fb6-b3a8-98e24dfee871 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:56:09.130309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-fc709d6e-a0b6-4fb6-b3a8-98e24dfee871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:09.138365 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 719/1438] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:56:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:56:09.184889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eca66b-2896-480c-9248-84cbb4776fb0 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:09.185182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eca66b-2896-480c-9248-84cbb4776fb0 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:09.185471 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eca66b-2896-480c-9248-84cbb4776fb0 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:09.187203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 720/1439] 10.222.0.21 () {54 vars in 961 bytes} [Mon Feb 28 18:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:56:09.191698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562bae0-3ab3-457c-a24b-7b68a4a6ef75 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:09.191993 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562bae0-3ab3-457c-a24b-7b68a4a6ef75 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:09.192281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562bae0-3ab3-457c-a24b-7b68a4a6ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:09.214517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-8562bae0-3ab3-457c-a24b-7b68a4a6ef75 None None] MFA Rules not processed for user `e956656659004428b3aaf23ae962f001`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:56:09.215681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8562bae0-3ab3-457c-a24b-7b68a4a6ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:09.221627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 720/1440] 10.222.0.21 () {58 vars in 1058 bytes} [Mon Feb 28 18:56:09 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:56:09.228936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eca66b-2896-480c-9248-84cbb4776fb0 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:56:09.239819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eca66b-2896-480c-9248-84cbb4776fb0 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:56:09.243269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee92cb1-a9f7-4a51-94da-304bc26a05a8 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=TvFjqSIbTa275Kqoum5bnA, audit_chain_id=['TvFjqSIbTa275Kqoum5bnA']) at 0x7fe09e1fbdf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e956656659004428b3aaf23ae962f001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:56:09.243851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee92cb1-a9f7-4a51-94da-304bc26a05a8 service glance] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:09.244123 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee92cb1-a9f7-4a51-94da-304bc26a05a8 service glance] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:09.244403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee92cb1-a9f7-4a51-94da-304bc26a05a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:09.253761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee92cb1-a9f7-4a51-94da-304bc26a05a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:56:09.255202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee92cb1-a9f7-4a51-94da-304bc26a05a8 service glance] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:56:09.264324 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 721/1441] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:56:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:56:11.452388 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd2d0-fd05-419c-80da-efe29ff94a21 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:11.452957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd2d0-fd05-419c-80da-efe29ff94a21 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:11.452957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd2d0-fd05-419c-80da-efe29ff94a21 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:11.454675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 721/1442] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:56:11.459953 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296cd8-73a6-491c-a0eb-9f3e2e4f9583 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:11.460376 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296cd8-73a6-491c-a0eb-9f3e2e4f9583 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:11.460528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296cd8-73a6-491c-a0eb-9f3e2e4f9583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:11.482945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-5b296cd8-73a6-491c-a0eb-9f3e2e4f9583 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:56:11.484113 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5b296cd8-73a6-491c-a0eb-9f3e2e4f9583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:11.492196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 722/1443] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:56:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:56:11.517900 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dd2d0-fd05-419c-80da-efe29ff94a21 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:56:11.529894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dd2d0-fd05-419c-80da-efe29ff94a21 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:56:11.534192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799dc30c-0674-4dcf-aaae-eb5fef955b23 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kvO1eqitTciMH6VOT4ZS1w, audit_chain_id=['kvO1eqitTciMH6VOT4ZS1w']) at 0x7fe09df242e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:56:11.534775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc30c-0674-4dcf-aaae-eb5fef955b23 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:11.535064 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc30c-0674-4dcf-aaae-eb5fef955b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:11.535375 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc30c-0674-4dcf-aaae-eb5fef955b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:11.536063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799dc30c-0674-4dcf-aaae-eb5fef955b23 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:56:11.537910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799dc30c-0674-4dcf-aaae-eb5fef955b23 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:56:11.553079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 722/1444] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 18:56:11 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:56:13.114745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b47f-0748-4ad9-afb6-67b64c876c2c None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:13.115314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b47f-0748-4ad9-afb6-67b64c876c2c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:13.115409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b47f-0748-4ad9-afb6-67b64c876c2c None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:13.117064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 723/1445] 10.222.0.21 () {54 vars in 911 bytes} [Mon Feb 28 18:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:56:13.122160 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53eff-aa62-4fa4-b42f-216dbb2c1743 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:13.122564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53eff-aa62-4fa4-b42f-216dbb2c1743 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:13.122736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53eff-aa62-4fa4-b42f-216dbb2c1743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:13.145017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-aac53eff-aa62-4fa4-b42f-216dbb2c1743 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:56:13.146157 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-aac53eff-aa62-4fa4-b42f-216dbb2c1743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:13.153962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 723/1446] 10.222.0.21 () {58 vars in 1008 bytes} [Mon Feb 28 18:56:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:56:13.303384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651b47f-0748-4ad9-afb6-67b64c876c2c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:56:13.317553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651b47f-0748-4ad9-afb6-67b64c876c2c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:56:13.322754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0ec72-4942-44f5-809d-05a9b776ec58 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=8MuEWiWyRRi3HoNLr4Bqig, audit_chain_id=['8MuEWiWyRRi3HoNLr4Bqig']) at 0x7fe09e3804f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:56:13.323382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0ec72-4942-44f5-809d-05a9b776ec58 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:13.323668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0ec72-4942-44f5-809d-05a9b776ec58 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:13.323949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0ec72-4942-44f5-809d-05a9b776ec58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:13.332783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0ec72-4942-44f5-809d-05a9b776ec58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:56:13.334372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0ec72-4942-44f5-809d-05a9b776ec58 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:56:13.343617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 724/1447] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:56:13 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:56:15.474759 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be83c3-697e-41d4-95e2-3bcaa5cdb441 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:15.475407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be83c3-697e-41d4-95e2-3bcaa5cdb441 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:15.475407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be83c3-697e-41d4-95e2-3bcaa5cdb441 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:15.477068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 724/1448] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:56:15.482812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736bc1c-9332-4f34-b721-03b9fb98a9c7 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:15.483280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736bc1c-9332-4f34-b721-03b9fb98a9c7 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:15.483421 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736bc1c-9332-4f34-b721-03b9fb98a9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:15.505746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e736bc1c-9332-4f34-b721-03b9fb98a9c7 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:56:15.506889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e736bc1c-9332-4f34-b721-03b9fb98a9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:15.514491 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 725/1449] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:56:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:56:15.551366 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be83c3-697e-41d4-95e2-3bcaa5cdb441 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:56:15.562386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be83c3-697e-41d4-95e2-3bcaa5cdb441 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:56:15.565750 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b81860-d1d9-45bd-9890-66b91b21b81b service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e25b0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:56:15.566321 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b81860-d1d9-45bd-9890-66b91b21b81b service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:15.566610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b81860-d1d9-45bd-9890-66b91b21b81b service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:15.566892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b81860-d1d9-45bd-9890-66b91b21b81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:15.575553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b81860-d1d9-45bd-9890-66b91b21b81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:56:15.577015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b81860-d1d9-45bd-9890-66b91b21b81b service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:56:15.586147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 725/1450] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:56:15 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:56:17.755538 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080964a-a185-498f-b269-84c167973428 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:17.756120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080964a-a185-498f-b269-84c167973428 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:17.756120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080964a-a185-498f-b269-84c167973428 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:17.757847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 726/1451] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:56:17.764267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956115f-80ab-473f-8ffa-59c1125aec97 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:17.764731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956115f-80ab-473f-8ffa-59c1125aec97 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:17.765316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956115f-80ab-473f-8ffa-59c1125aec97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:17.787604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4956115f-80ab-473f-8ffa-59c1125aec97 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:56:17.788758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4956115f-80ab-473f-8ffa-59c1125aec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:17.796026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 726/1452] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:56:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:56:17.835098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080964a-a185-498f-b269-84c167973428 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:56:17.846065 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080964a-a185-498f-b269-84c167973428 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:56:17.849408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7125b2-2979-4e2e-85e5-5d1715e32f00 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09eb9f7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:56:17.849975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7125b2-2979-4e2e-85e5-5d1715e32f00 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:17.850261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7125b2-2979-4e2e-85e5-5d1715e32f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:17.850540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7125b2-2979-4e2e-85e5-5d1715e32f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:17.859845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7125b2-2979-4e2e-85e5-5d1715e32f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:56:17.861293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7125b2-2979-4e2e-85e5-5d1715e32f00 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:56:17.870451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 727/1453] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:56:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:56:20.116048 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15e9c-1501-4df3-aa98-d46a8d14dc7d None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:20.116650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15e9c-1501-4df3-aa98-d46a8d14dc7d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:20.116650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15e9c-1501-4df3-aa98-d46a8d14dc7d None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:20.118539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 727/1454] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:56:20.124089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd718e-5d40-4c30-907d-2dda7e783cb2 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:20.124503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd718e-5d40-4c30-907d-2dda7e783cb2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:20.124661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd718e-5d40-4c30-907d-2dda7e783cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:20.147473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-61cd718e-5d40-4c30-907d-2dda7e783cb2 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:56:20.148597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-61cd718e-5d40-4c30-907d-2dda7e783cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:20.155997 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 728/1455] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:56:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:56:20.196429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de15e9c-1501-4df3-aa98-d46a8d14dc7d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:56:20.207830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de15e9c-1501-4df3-aa98-d46a8d14dc7d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:56:20.211329 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf9e78-16df-43db-b6a8-4dacf01fd252 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09de9b910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:56:20.211903 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf9e78-16df-43db-b6a8-4dacf01fd252 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:20.212197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf9e78-16df-43db-b6a8-4dacf01fd252 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:20.212484 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf9e78-16df-43db-b6a8-4dacf01fd252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:20.221517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf9e78-16df-43db-b6a8-4dacf01fd252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:56:20.222949 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf9e78-16df-43db-b6a8-4dacf01fd252 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:56:20.232149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 728/1456] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:56:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:56:22.882964 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0d84b-bc9c-4c5e-b8f6-b6a8a6ecb0fb None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:22.883605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0d84b-bc9c-4c5e-b8f6-b6a8a6ecb0fb None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:22.883605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0d84b-bc9c-4c5e-b8f6-b6a8a6ecb0fb None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:22.885199 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 729/1457] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 18:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:56:22.890494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ec65-116f-4e25-b390-42db3ead72ed None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:22.890926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ec65-116f-4e25-b390-42db3ead72ed None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:22.891075 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ec65-116f-4e25-b390-42db3ead72ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:22.913006 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4444ec65-116f-4e25-b390-42db3ead72ed None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:56:22.914154 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4444ec65-116f-4e25-b390-42db3ead72ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:22.922070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 729/1458] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 18:56:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:56:22.962070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0d84b-bc9c-4c5e-b8f6-b6a8a6ecb0fb None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:56:22.972803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0d84b-bc9c-4c5e-b8f6-b6a8a6ecb0fb None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:56:22.976219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56623e-ecaf-4a5f-9131-c3c87f13bff2 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e204ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:56:22.976792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56623e-ecaf-4a5f-9131-c3c87f13bff2 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:22.977077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56623e-ecaf-4a5f-9131-c3c87f13bff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:22.977358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56623e-ecaf-4a5f-9131-c3c87f13bff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:22.987020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56623e-ecaf-4a5f-9131-c3c87f13bff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:56:22.988471 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56623e-ecaf-4a5f-9131-c3c87f13bff2 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:56:22.998563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 730/1459] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:56:22 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:57:49.396632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baab764-64b4-4e94-895f-3fa2c4f71607 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:49.397209 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baab764-64b4-4e94-895f-3fa2c4f71607 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:49.397209 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baab764-64b4-4e94-895f-3fa2c4f71607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:49.419933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-0baab764-64b4-4e94-895f-3fa2c4f71607 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:57:49.421058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0baab764-64b4-4e94-895f-3fa2c4f71607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:49.428043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 730/1460] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 18:57:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:57:49.435859 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed020b-671a-4fd2-8d69-d4a1c510e904 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:49.436371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed020b-671a-4fd2-8d69-d4a1c510e904 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:49.436485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed020b-671a-4fd2-8d69-d4a1c510e904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:49.458264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-85ed020b-671a-4fd2-8d69-d4a1c510e904 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:57:49.459427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-85ed020b-671a-4fd2-8d69-d4a1c510e904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:49.467083 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 731/1461] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 18:57:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:57:49.472939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baab764-64b4-4e94-895f-3fa2c4f71607 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:49.482492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baab764-64b4-4e94-895f-3fa2c4f71607 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:49.486616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bc4d8-5cf8-4e86-a18f-14bfc8a9d95f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZzP8AcsmRTCEkGScOMG9cw, audit_chain_id=['ZzP8AcsmRTCEkGScOMG9cw']) at 0x7fe09e14a520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:49.487224 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bc4d8-5cf8-4e86-a18f-14bfc8a9d95f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:49.487511 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bc4d8-5cf8-4e86-a18f-14bfc8a9d95f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:49.487792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bc4d8-5cf8-4e86-a18f-14bfc8a9d95f admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:49.488474 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bc4d8-5cf8-4e86-a18f-14bfc8a9d95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 18:57:49.488773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bc4d8-5cf8-4e86-a18f-14bfc8a9d95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:49.490340 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bc4d8-5cf8-4e86-a18f-14bfc8a9d95f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:57:49.503700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 731/1462] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 18:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:57:49.511532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed020b-671a-4fd2-8d69-d4a1c510e904 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:49.520417 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed020b-671a-4fd2-8d69-d4a1c510e904 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:49.524863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038c13-51e5-487c-8abc-4c888a5cd298 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZzP8AcsmRTCEkGScOMG9cw, audit_chain_id=['ZzP8AcsmRTCEkGScOMG9cw']) at 0x7fe09ea18d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:49.525452 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038c13-51e5-487c-8abc-4c888a5cd298 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:49.525737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038c13-51e5-487c-8abc-4c888a5cd298 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:49.526020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04038c13-51e5-487c-8abc-4c888a5cd298 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:49.526650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04038c13-51e5-487c-8abc-4c888a5cd298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:49.529145 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04038c13-51e5-487c-8abc-4c888a5cd298 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:57:49.635495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 732/1463] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 18:57:49 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:57:49.640681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bc4d8-5cf8-4e86-a18f-14bfc8a9d95f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:49.650556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bc4d8-5cf8-4e86-a18f-14bfc8a9d95f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:49.712111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a78d1-0ad2-461f-8309-5667cacfa093 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZzP8AcsmRTCEkGScOMG9cw, audit_chain_id=['ZzP8AcsmRTCEkGScOMG9cw']) at 0x7fe09e7b70d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:49.712716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a78d1-0ad2-461f-8309-5667cacfa093 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:49.713009 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a78d1-0ad2-461f-8309-5667cacfa093 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:49.713292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a78d1-0ad2-461f-8309-5667cacfa093 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:49.713924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a78d1-0ad2-461f-8309-5667cacfa093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:49.716573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a78d1-0ad2-461f-8309-5667cacfa093 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:57:49.788935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 732/1464] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 18:57:49 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:57:49.793491 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038c13-51e5-487c-8abc-4c888a5cd298 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:49.803432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04038c13-51e5-487c-8abc-4c888a5cd298 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:49.808011 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca9e9b-0e83-4ba6-80bd-3d025a8d0720 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZzP8AcsmRTCEkGScOMG9cw, audit_chain_id=['ZzP8AcsmRTCEkGScOMG9cw']) at 0x7fe09df0b9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:49.808651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca9e9b-0e83-4ba6-80bd-3d025a8d0720 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:49.808942 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca9e9b-0e83-4ba6-80bd-3d025a8d0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:49.809225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca9e9b-0e83-4ba6-80bd-3d025a8d0720 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:49.809917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca9e9b-0e83-4ba6-80bd-3d025a8d0720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:49.811682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca9e9b-0e83-4ba6-80bd-3d025a8d0720 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:57:49.821924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 733/1465] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 18:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:57:49.827598 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a78d1-0ad2-461f-8309-5667cacfa093 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:49.835772 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a78d1-0ad2-461f-8309-5667cacfa093 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:49.840686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fc2b3-eaca-4360-b700-ab0216388487 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZzP8AcsmRTCEkGScOMG9cw, audit_chain_id=['ZzP8AcsmRTCEkGScOMG9cw']) at 0x7fe09e1a12e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:49.841276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fc2b3-eaca-4360-b700-ab0216388487 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:49.841564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fc2b3-eaca-4360-b700-ab0216388487 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:49.841842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fc2b3-eaca-4360-b700-ab0216388487 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:49.842522 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fc2b3-eaca-4360-b700-ab0216388487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:49.844106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fc2b3-eaca-4360-b700-ab0216388487 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:57:49.854196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 733/1466] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 18:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:57:49.860492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca9e9b-0e83-4ba6-80bd-3d025a8d0720 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:49.869917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca9e9b-0e83-4ba6-80bd-3d025a8d0720 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:49.874595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7a09f-e2cb-47bb-8fac-7f431836b568 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZzP8AcsmRTCEkGScOMG9cw, audit_chain_id=['ZzP8AcsmRTCEkGScOMG9cw']) at 0x7fe09e3e0c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:49.875428 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7a09f-e2cb-47bb-8fac-7f431836b568 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:49.875720 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7a09f-e2cb-47bb-8fac-7f431836b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:49.876003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7a09f-e2cb-47bb-8fac-7f431836b568 admin admin] PATH_INFO: `/v3/projects/c0fe86c4d6f14bd29fb323b5c084937a/users/5ff4188ba61846c2b5024f890a2d7cc2/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:49.896274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7a09f-e2cb-47bb-8fac-7f431836b568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fe86c4d6f14bd29fb323b5c084937a, user_id=5ff4188ba61846c2b5024f890a2d7cc2, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:49.899094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7a09f-e2cb-47bb-8fac-7f431836b568 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:57:49.972496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 734/1467] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 18:57:49 2022] PUT /identity/v3/projects/c0fe86c4d6f14bd29fb323b5c084937a/users/5ff4188ba61846c2b5024f890a2d7cc2/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:57:49.983736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda0d9-8e8a-4995-a577-41b1898da72e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:49.984035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda0d9-8e8a-4995-a577-41b1898da72e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:49.984373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda0d9-8e8a-4995-a577-41b1898da72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:50.019992 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-89bda0d9-8e8a-4995-a577-41b1898da72e None None] MFA Rules not processed for user `5ff4188ba61846c2b5024f890a2d7cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:57:50.021140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-89bda0d9-8e8a-4995-a577-41b1898da72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:50.090346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 734/1468] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 18:57:49 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:57:50.100680 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7a09f-e2cb-47bb-8fac-7f431836b568 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:50.176572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7a09f-e2cb-47bb-8fac-7f431836b568 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:50.181867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb7b78-9cee-42cc-bd81-cef2fa8f4801 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09e3f8fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:50.182463 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb7b78-9cee-42cc-bd81-cef2fa8f4801 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:50.182736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb7b78-9cee-42cc-bd81-cef2fa8f4801 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:50.183919 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb7b78-9cee-42cc-bd81-cef2fa8f4801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:50.191425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb7b78-9cee-42cc-bd81-cef2fa8f4801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:50.193047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb7b78-9cee-42cc-bd81-cef2fa8f4801 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:57:50.202356 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 735/1469] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:57:50 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:57:50.269047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbc6a-a528-425d-954b-6c7c0e73b14f None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:50.269348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbc6a-a528-425d-954b-6c7c0e73b14f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:50.269635 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbc6a-a528-425d-954b-6c7c0e73b14f None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:50.271271 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 735/1470] 10.222.0.21 () {52 vars in 829 bytes} [Mon Feb 28 18:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:57:50.274733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb7b78-9cee-42cc-bd81-cef2fa8f4801 service nova] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:50.342621 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb7b78-9cee-42cc-bd81-cef2fa8f4801 service nova] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:50.346873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZzP8AcsmRTCEkGScOMG9cw, audit_chain_id=['ZzP8AcsmRTCEkGScOMG9cw']) at 0x7fe09e3e7340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:50.347691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:50.347976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:50.348255 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] PATH_INFO: `/v3/users/5ff4188ba61846c2b5024f890a2d7cc2` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:50.349337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ff4188ba61846c2b5024f890a2d7cc2)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:50.350338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:57:50.350338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 18:57:50.350338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 18:57:50.351549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:57:50.579773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ff4188ba61846c2b5024f890a2d7cc2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:50.663551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ff4188ba61846c2b5024f890a2d7cc2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:50.681957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ff4188ba61846c2b5024f890a2d7cc2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:50.682661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ff4188ba61846c2b5024f890a2d7cc2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:50.683979 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ff4188ba61846c2b5024f890a2d7cc2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:50.699151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 736/1471] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 18:57:50 2022] DELETE /identity/v3/users/5ff4188ba61846c2b5024f890a2d7cc2 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:57:50.703570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5651a-451c-418c-9c16-88345208507d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:50.704070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5651a-451c-418c-9c16-88345208507d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:50.704229 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5651a-451c-418c-9c16-88345208507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:50.726640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a9b5651a-451c-418c-9c16-88345208507d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:57:50.727832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a9b5651a-451c-418c-9c16-88345208507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:50.795345 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 736/1472] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 18:57:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:57:50.806171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:50.807627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:50.871900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3f504-cc1f-413a-a1db-af83907cd721 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:50.875370 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148eaccb-1338-4668-a8bf-e40b7b3f8fe6 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09eb453d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:50.875951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eaccb-1338-4668-a8bf-e40b7b3f8fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:50.876239 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eaccb-1338-4668-a8bf-e40b7b3f8fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:50.876521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eaccb-1338-4668-a8bf-e40b7b3f8fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:50.885385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148eaccb-1338-4668-a8bf-e40b7b3f8fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:50.887464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148eaccb-1338-4668-a8bf-e40b7b3f8fe6 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:57:50.896354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 737/1473] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:57:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:57:51.508895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5651a-451c-418c-9c16-88345208507d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:51.510238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a9b5651a-451c-418c-9c16-88345208507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:51.521597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5651a-451c-418c-9c16-88345208507d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:51.526096 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZzP8AcsmRTCEkGScOMG9cw, audit_chain_id=['ZzP8AcsmRTCEkGScOMG9cw']) at 0x7fe09e680f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:51.527584 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:51.527883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:51.528257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] PATH_INFO: `/v3/projects/c0fe86c4d6f14bd29fb323b5c084937a` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:51.529389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0fe86c4d6f14bd29fb323b5c084937a)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:51.530396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:57:51.530396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 18:57:51.530396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 18:57:51.531664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:57:51.645271 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0fe86c4d6f14bd29fb323b5c084937a', 'request_id': 'req-6b8f41c1-4fa4-4f10-a432-5502fe196535'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:51.697867 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0fe86c4d6f14bd29fb323b5c084937a', 'request_id': 'req-6b8f41c1-4fa4-4f10-a432-5502fe196535'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:51.711498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0fe86c4d6f14bd29fb323b5c084937a', 'request_id': 'req-6b8f41c1-4fa4-4f10-a432-5502fe196535'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:51.721067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] The token cache is being invalidate because project c0fe86c4d6f14bd29fb323b5c084937a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:57:51.721359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:51.721982 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6b8f41c1-4fa4-4f10-a432-5502fe196535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:51.723555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 737/1474] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 18:57:51 2022] DELETE /identity/v3/projects/c0fe86c4d6f14bd29fb323b5c084937a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:59:26.045251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e653b-c4cb-4993-a19f-05e6dc1c2b3b None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:26.045831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e653b-c4cb-4993-a19f-05e6dc1c2b3b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:26.045831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e653b-c4cb-4993-a19f-05e6dc1c2b3b None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:26.047534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 738/1475] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:59:26.052702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26940df6-1d88-4908-b9b7-f14dea443918 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:26.053139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26940df6-1d88-4908-b9b7-f14dea443918 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:26.053275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26940df6-1d88-4908-b9b7-f14dea443918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:26.075484 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-26940df6-1d88-4908-b9b7-f14dea443918 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:26.076643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-26940df6-1d88-4908-b9b7-f14dea443918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:26.142628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 738/1476] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:59:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:59:26.291514 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e653b-c4cb-4993-a19f-05e6dc1c2b3b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:26.293157 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3f1e653b-c4cb-4993-a19f-05e6dc1c2b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:26.371707 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e653b-c4cb-4993-a19f-05e6dc1c2b3b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:26.376711 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e84fe6-e98a-4718-805f-ed46695120bf service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09eb9f8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:26.377293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e84fe6-e98a-4718-805f-ed46695120bf service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:26.377583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e84fe6-e98a-4718-805f-ed46695120bf service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:26.377867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e84fe6-e98a-4718-805f-ed46695120bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:26.385720 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e84fe6-e98a-4718-805f-ed46695120bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:26.387880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e84fe6-e98a-4718-805f-ed46695120bf service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:59:26.396688 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 739/1477] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:26 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:59:26.877111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a835e-5eb6-43dc-ac03-b2550a8dd480 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:26.877419 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a835e-5eb6-43dc-ac03-b2550a8dd480 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:26.877703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a835e-5eb6-43dc-ac03-b2550a8dd480 None None] PATH_INFO: `/v3` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:26.878926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 739/1478] 10.222.0.61 () {54 vars in 925 bytes} [Mon Feb 28 18:59:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:59:26.909036 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b4ed-5e75-4756-9a1c-f6c9d9ecf31d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:26.909275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b4ed-5e75-4756-9a1c-f6c9d9ecf31d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:26.909562 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b4ed-5e75-4756-9a1c-f6c9d9ecf31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:26.932854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-6b33b4ed-5e75-4756-9a1c-f6c9d9ecf31d None None] MFA Rules not processed for user `2f330acd453f445ea31acf9fc43b53ad`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:26.935153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-6b33b4ed-5e75-4756-9a1c-f6c9d9ecf31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:27.010281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 740/1479] 10.222.0.61 () {58 vars in 1015 bytes} [Mon Feb 28 18:59:26 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:59:27.763275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637f61a-aa5a-4214-81a2-bb479ee7a3f4 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:27.763885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637f61a-aa5a-4214-81a2-bb479ee7a3f4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:27.763885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637f61a-aa5a-4214-81a2-bb479ee7a3f4 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:27.765629 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 740/1480] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:59:27.770893 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867ed6-e6c3-4e74-85cb-9794f8c90f56 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:27.771429 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867ed6-e6c3-4e74-85cb-9794f8c90f56 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:27.771540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867ed6-e6c3-4e74-85cb-9794f8c90f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:27.794089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b3867ed6-e6c3-4e74-85cb-9794f8c90f56 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:27.795270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b3867ed6-e6c3-4e74-85cb-9794f8c90f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:27.802595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 741/1481] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:59:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:59:27.958590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637f61a-aa5a-4214-81a2-bb479ee7a3f4 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:27.973898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637f61a-aa5a-4214-81a2-bb479ee7a3f4 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:27.979088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9ee87-fc59-44b0-b981-ad76b7d9ef82 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09e108a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:27.979776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ee87-fc59-44b0-b981-ad76b7d9ef82 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:27.980132 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ee87-fc59-44b0-b981-ad76b7d9ef82 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:27.980533 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ee87-fc59-44b0-b981-ad76b7d9ef82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:27.988765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9ee87-fc59-44b0-b981-ad76b7d9ef82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:27.990348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9ee87-fc59-44b0-b981-ad76b7d9ef82 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:59:27.999371 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 741/1482] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:27 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:59:30.762197 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09731c51-d8ee-44ef-aa60-89fcf83fd4d2 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:30.762639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09731c51-d8ee-44ef-aa60-89fcf83fd4d2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:30.762789 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09731c51-d8ee-44ef-aa60-89fcf83fd4d2 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:30.764509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 742/1483] 10.222.0.21 () {54 vars in 960 bytes} [Mon Feb 28 18:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:59:30.769288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f5233-e5d6-4e7b-9cce-29b277d94ef4 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:30.779256 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f5233-e5d6-4e7b-9cce-29b277d94ef4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:30.779256 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f5233-e5d6-4e7b-9cce-29b277d94ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:30.792365 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-b20f5233-e5d6-4e7b-9cce-29b277d94ef4 None None] MFA Rules not processed for user `2f330acd453f445ea31acf9fc43b53ad`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:30.794280 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b20f5233-e5d6-4e7b-9cce-29b277d94ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:30.802896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 742/1484] 10.222.0.21 () {58 vars in 1057 bytes} [Mon Feb 28 18:59:30 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:59:30.811247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09731c51-d8ee-44ef-aa60-89fcf83fd4d2 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:30.824116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09731c51-d8ee-44ef-aa60-89fcf83fd4d2 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:30.828774 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400a8e4-605d-45c3-81ff-5e9cd00dca83 service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=RLyH0N9xSwiZDKvJxMSolg, audit_chain_id=['RLyH0N9xSwiZDKvJxMSolg']) at 0x7fe09e3637f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f330acd453f445ea31acf9fc43b53ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:30.829336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a8e4-605d-45c3-81ff-5e9cd00dca83 service placement] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:30.829619 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a8e4-605d-45c3-81ff-5e9cd00dca83 service placement] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:30.829896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a8e4-605d-45c3-81ff-5e9cd00dca83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:30.837817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400a8e4-605d-45c3-81ff-5e9cd00dca83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:30.839441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400a8e4-605d-45c3-81ff-5e9cd00dca83 service placement] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:59:30.848599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 743/1485] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:30 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:59:39.770885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fd33d-1d35-40cc-be78-56a4bbef650e None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:39.771468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fd33d-1d35-40cc-be78-56a4bbef650e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:39.771468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fd33d-1d35-40cc-be78-56a4bbef650e None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:39.773181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 743/1486] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:59:39.778011 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408fd6-d6c9-47e4-85a2-b110a76c33b9 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:39.778395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408fd6-d6c9-47e4-85a2-b110a76c33b9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:39.778607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408fd6-d6c9-47e4-85a2-b110a76c33b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:39.802238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c6408fd6-d6c9-47e4-85a2-b110a76c33b9 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:39.803488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c6408fd6-d6c9-47e4-85a2-b110a76c33b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:39.810684 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 744/1487] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:59:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:59:39.964295 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fd33d-1d35-40cc-be78-56a4bbef650e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:39.978582 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fd33d-1d35-40cc-be78-56a4bbef650e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:39.983810 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39003f-25a1-4190-a74a-05e46cde8018 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09de5e730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:39.984391 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39003f-25a1-4190-a74a-05e46cde8018 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:39.984682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39003f-25a1-4190-a74a-05e46cde8018 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:39.984966 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39003f-25a1-4190-a74a-05e46cde8018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:39.992915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39003f-25a1-4190-a74a-05e46cde8018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:39.994482 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39003f-25a1-4190-a74a-05e46cde8018 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:59:40.003662 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 744/1488] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:39 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:59:41.370355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886caa54-e0de-41bd-84af-debc7523456f None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:41.370876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886caa54-e0de-41bd-84af-debc7523456f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:41.370876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886caa54-e0de-41bd-84af-debc7523456f None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:41.372558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 745/1489] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:59:41.377748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c946c-22a3-4075-b52e-3f006681928b None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:41.378180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c946c-22a3-4075-b52e-3f006681928b None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:41.378315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c946c-22a3-4075-b52e-3f006681928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:41.400945 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3f3c946c-22a3-4075-b52e-3f006681928b None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:41.402077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3f3c946c-22a3-4075-b52e-3f006681928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:41.410133 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 745/1490] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:59:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:59:41.564445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886caa54-e0de-41bd-84af-debc7523456f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:41.578993 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886caa54-e0de-41bd-84af-debc7523456f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:41.584044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6055680-517c-44cb-a1d6-b2b49e6f9d84 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=843MkhQqSe6NtHoM452O0Q, audit_chain_id=['843MkhQqSe6NtHoM452O0Q']) at 0x7fe09e3f8ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:41.584613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6055680-517c-44cb-a1d6-b2b49e6f9d84 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:41.584897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6055680-517c-44cb-a1d6-b2b49e6f9d84 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:41.585174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6055680-517c-44cb-a1d6-b2b49e6f9d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:41.593344 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6055680-517c-44cb-a1d6-b2b49e6f9d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:41.596662 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6055680-517c-44cb-a1d6-b2b49e6f9d84 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:59:41.603852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 746/1491] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:41 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:59:45.762856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187e087-ef59-4809-ba69-9a39fd95c05a None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:45.763469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187e087-ef59-4809-ba69-9a39fd95c05a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:45.763469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187e087-ef59-4809-ba69-9a39fd95c05a None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:45.765231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 746/1492] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:59:45.770289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83d6f-01e4-447c-ab86-fa222a703b17 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:45.770748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83d6f-01e4-447c-ab86-fa222a703b17 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:45.770870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83d6f-01e4-447c-ab86-fa222a703b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:45.793666 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-7cf83d6f-01e4-447c-ab86-fa222a703b17 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:45.794821 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7cf83d6f-01e4-447c-ab86-fa222a703b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:45.803192 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 747/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:59:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:59:45.841684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187e087-ef59-4809-ba69-9a39fd95c05a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:45.843611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3187e087-ef59-4809-ba69-9a39fd95c05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:45.908266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187e087-ef59-4809-ba69-9a39fd95c05a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:45.911922 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6142117-fa4f-4bad-bef7-528a295e2d5b service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe0a2701c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:45.912430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142117-fa4f-4bad-bef7-528a295e2d5b service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:45.912727 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142117-fa4f-4bad-bef7-528a295e2d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:45.913010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142117-fa4f-4bad-bef7-528a295e2d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:45.922973 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6142117-fa4f-4bad-bef7-528a295e2d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:45.924489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6142117-fa4f-4bad-bef7-528a295e2d5b service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:59:45.933854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 747/1494] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:59:48.054566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2cd9-fb7c-4e1d-aed2-eab0698e8d2a None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:48.055152 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2cd9-fb7c-4e1d-aed2-eab0698e8d2a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:48.055152 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc2cd9-fb7c-4e1d-aed2-eab0698e8d2a None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:48.056821 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 748/1495] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:59:48.062073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977edf5-3414-4baa-9ace-1d71a3f618c8 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:48.062530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977edf5-3414-4baa-9ace-1d71a3f618c8 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:48.062697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977edf5-3414-4baa-9ace-1d71a3f618c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:48.085386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-1977edf5-3414-4baa-9ace-1d71a3f618c8 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:48.086522 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-1977edf5-3414-4baa-9ace-1d71a3f618c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:48.094414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 748/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:59:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:59:48.129986 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc2cd9-fb7c-4e1d-aed2-eab0698e8d2a None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:48.141806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc2cd9-fb7c-4e1d-aed2-eab0698e8d2a None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:48.145275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424925ef-ff14-471b-8a40-976cab9bf13b service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09dec9fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:48.145843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424925ef-ff14-471b-8a40-976cab9bf13b service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:48.146129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424925ef-ff14-471b-8a40-976cab9bf13b service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:48.146408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424925ef-ff14-471b-8a40-976cab9bf13b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:48.156304 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424925ef-ff14-471b-8a40-976cab9bf13b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:48.157773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424925ef-ff14-471b-8a40-976cab9bf13b service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:59:48.166714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 749/1497] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:59:51.843869 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36f216-34ae-4948-a5c8-7675c29f9022 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:51.844482 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36f216-34ae-4948-a5c8-7675c29f9022 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:51.844482 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36f216-34ae-4948-a5c8-7675c29f9022 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:51.846118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 749/1498] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:59:51.851155 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1057dc-33ce-40c0-9dad-ab7332ef6aba None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:51.851608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1057dc-33ce-40c0-9dad-ab7332ef6aba None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:51.851712 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1057dc-33ce-40c0-9dad-ab7332ef6aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:51.875089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-1d1057dc-33ce-40c0-9dad-ab7332ef6aba None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:51.876440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1d1057dc-33ce-40c0-9dad-ab7332ef6aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:51.883494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 750/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:59:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:59:51.942925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36f216-34ae-4948-a5c8-7675c29f9022 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:51.944653 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6f36f216-34ae-4948-a5c8-7675c29f9022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:52.009703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36f216-34ae-4948-a5c8-7675c29f9022 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:52.013112 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28108aed-44b1-4cd2-aa53-1f5ea0a28c36 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e1e6640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:52.013707 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108aed-44b1-4cd2-aa53-1f5ea0a28c36 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:52.014125 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108aed-44b1-4cd2-aa53-1f5ea0a28c36 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:52.014553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108aed-44b1-4cd2-aa53-1f5ea0a28c36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:52.026229 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28108aed-44b1-4cd2-aa53-1f5ea0a28c36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:52.027693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28108aed-44b1-4cd2-aa53-1f5ea0a28c36 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:59:52.037369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 750/1500] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:59:54.170150 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65f36-59db-4c7f-a111-df40f134cd98 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:54.170741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65f36-59db-4c7f-a111-df40f134cd98 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:54.170914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65f36-59db-4c7f-a111-df40f134cd98 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:54.172677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 751/1501] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:59:54.178235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07e890-572e-4433-a7b4-e76cd8e8c9a4 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:54.178699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07e890-572e-4433-a7b4-e76cd8e8c9a4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:54.178805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07e890-572e-4433-a7b4-e76cd8e8c9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:54.201701 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4c07e890-572e-4433-a7b4-e76cd8e8c9a4 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:54.202970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4c07e890-572e-4433-a7b4-e76cd8e8c9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:54.210044 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 751/1502] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:59:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:59:54.267306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb1d72-99f7-46d2-93d7-fbd9e281646d None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:54.267529 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb1d72-99f7-46d2-93d7-fbd9e281646d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:54.267815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb1d72-99f7-46d2-93d7-fbd9e281646d None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:54.269537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 752/1503] 10.222.0.21 () {54 vars in 962 bytes} [Mon Feb 28 18:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:59:54.274483 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7525b7-dae3-4178-9cdd-ff4a3e86723f None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:54.274782 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7525b7-dae3-4178-9cdd-ff4a3e86723f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:54.275066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7525b7-dae3-4178-9cdd-ff4a3e86723f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:54.298614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3a7525b7-dae3-4178-9cdd-ff4a3e86723f None None] MFA Rules not processed for user `43304b4fcb06440f9d5166ca439a581b`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:54.299790 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3a7525b7-dae3-4178-9cdd-ff4a3e86723f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:54.305883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 752/1504] 10.222.0.21 () {58 vars in 1059 bytes} [Mon Feb 28 18:59:54 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:59:54.313992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb1d72-99f7-46d2-93d7-fbd9e281646d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:54.324390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb1d72-99f7-46d2-93d7-fbd9e281646d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:54.328442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9c11d-8ede-4ccb-8b50-42cf4e7174e8 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09deedfd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:54.329002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c11d-8ede-4ccb-8b50-42cf4e7174e8 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:54.329288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c11d-8ede-4ccb-8b50-42cf4e7174e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:54.329567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c11d-8ede-4ccb-8b50-42cf4e7174e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:54.338157 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9c11d-8ede-4ccb-8b50-42cf4e7174e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:54.339601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9c11d-8ede-4ccb-8b50-42cf4e7174e8 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 18:59:54.348574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 753/1505] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:30.837499 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e04ca-413f-4fe9-9467-597a55a00303 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:30.838086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e04ca-413f-4fe9-9467-597a55a00303 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:30.838086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e04ca-413f-4fe9-9467-597a55a00303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:30.864341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-373e04ca-413f-4fe9-9467-597a55a00303 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:30.865664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-373e04ca-413f-4fe9-9467-597a55a00303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:30.878116 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 753/1506] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:30.879746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e62f79-8761-482e-a714-7697e89dc78d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:30.880796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e62f79-8761-482e-a714-7697e89dc78d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:30.881306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e62f79-8761-482e-a714-7697e89dc78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:30.910095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aabe5-f3bb-4956-80f1-ec64d740950c None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:30.910419 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aabe5-f3bb-4956-80f1-ec64d740950c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:30.910670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695aabe5-f3bb-4956-80f1-ec64d740950c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:30.916123 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-98e62f79-8761-482e-a714-7697e89dc78d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:30.917566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-98e62f79-8761-482e-a714-7697e89dc78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:30.936886 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 754/1507] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:30.947371 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-695aabe5-f3bb-4956-80f1-ec64d740950c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:30.948405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565200b-9591-40e3-9196-ef4bb5c77a35 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:30.948530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-695aabe5-f3bb-4956-80f1-ec64d740950c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:30.949030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565200b-9591-40e3-9196-ef4bb5c77a35 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:30.949613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565200b-9591-40e3-9196-ef4bb5c77a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.002448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 754/1508] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:31.009088 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c565200b-9591-40e3-9196-ef4bb5c77a35 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.013259 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695aabe5-f3bb-4956-80f1-ec64d740950c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.015712 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c565200b-9591-40e3-9196-ef4bb5c77a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.041297 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695aabe5-f3bb-4956-80f1-ec64d740950c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.046333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 755/1509] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:31.051764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565200b-9591-40e3-9196-ef4bb5c77a35 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.061446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70014a-7b60-42f9-9e7b-d2080ca9d2c3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mRWjwkslTrGvKArrwz4jSA, audit_chain_id=['mRWjwkslTrGvKArrwz4jSA']) at 0x7fe09dec1070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.062068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70014a-7b60-42f9-9e7b-d2080ca9d2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.065749 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70014a-7b60-42f9-9e7b-d2080ca9d2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.066072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70014a-7b60-42f9-9e7b-d2080ca9d2c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.066785 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70014a-7b60-42f9-9e7b-d2080ca9d2c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:01:31.067093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70014a-7b60-42f9-9e7b-d2080ca9d2c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.068744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70014a-7b60-42f9-9e7b-d2080ca9d2c3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.076871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565200b-9591-40e3-9196-ef4bb5c77a35 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.092683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c4c32-87c9-4a73-a5b7-4fa5a272daae admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PQsHLq5kQBacvE0ZAbog-w, audit_chain_id=['PQsHLq5kQBacvE0ZAbog-w']) at 0x7fe09e411df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.093295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4c32-87c9-4a73-a5b7-4fa5a272daae admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.093587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4c32-87c9-4a73-a5b7-4fa5a272daae admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.093873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4c32-87c9-4a73-a5b7-4fa5a272daae admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.094582 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c4c32-87c9-4a73-a5b7-4fa5a272daae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:01:31.094884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c4c32-87c9-4a73-a5b7-4fa5a272daae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.096526 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c4c32-87c9-4a73-a5b7-4fa5a272daae admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.107597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 755/1510] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:01:31.115854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70014a-7b60-42f9-9e7b-d2080ca9d2c3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.127446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70014a-7b60-42f9-9e7b-d2080ca9d2c3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.128313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 756/1511] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:01:31.129629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e45d16-bce2-45b8-879f-89b05ae7265d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.129927 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e45d16-bce2-45b8-879f-89b05ae7265d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.130215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e45d16-bce2-45b8-879f-89b05ae7265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.144904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc10189-40cd-4cb1-98fd-53fa73433e36 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mRWjwkslTrGvKArrwz4jSA, audit_chain_id=['mRWjwkslTrGvKArrwz4jSA']) at 0x7fe09e14adc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.145517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc10189-40cd-4cb1-98fd-53fa73433e36 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.145812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc10189-40cd-4cb1-98fd-53fa73433e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.146100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc10189-40cd-4cb1-98fd-53fa73433e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.146744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc10189-40cd-4cb1-98fd-53fa73433e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.148804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc10189-40cd-4cb1-98fd-53fa73433e36 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.175735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-16e45d16-bce2-45b8-879f-89b05ae7265d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.176931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-16e45d16-bce2-45b8-879f-89b05ae7265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.190748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 757/1512] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.191814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e45d16-bce2-45b8-879f-89b05ae7265d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.208190 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e45d16-bce2-45b8-879f-89b05ae7265d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.216855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe2315-5d38-44d2-b397-85c796845b7f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PQsHLq5kQBacvE0ZAbog-w, audit_chain_id=['PQsHLq5kQBacvE0ZAbog-w']) at 0x7fe09e3e7ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.217478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe2315-5d38-44d2-b397-85c796845b7f admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.217768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe2315-5d38-44d2-b397-85c796845b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.218048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe2315-5d38-44d2-b397-85c796845b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.218709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe2315-5d38-44d2-b397-85c796845b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.220763 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe2315-5d38-44d2-b397-85c796845b7f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.295051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 756/1513] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/projects => generated 393 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:01:31.296503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4436f0-9051-48ac-aebe-699b0b92a645 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.296811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4436f0-9051-48ac-aebe-699b0b92a645 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.297102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4436f0-9051-48ac-aebe-699b0b92a645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.310747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 758/1514] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:31.311699 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe2315-5d38-44d2-b397-85c796845b7f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.337231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-9b4436f0-9051-48ac-aebe-699b0b92a645 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.338556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9b4436f0-9051-48ac-aebe-699b0b92a645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.444515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe2315-5d38-44d2-b397-85c796845b7f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.449764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0aa53a-8641-46d6-b32c-5d57ecfb5bdd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mRWjwkslTrGvKArrwz4jSA, audit_chain_id=['mRWjwkslTrGvKArrwz4jSA']) at 0x7fe09e1c8e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.450959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aa53a-8641-46d6-b32c-5d57ecfb5bdd admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.451281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aa53a-8641-46d6-b32c-5d57ecfb5bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.451606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 757/1515] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.451912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aa53a-8641-46d6-b32c-5d57ecfb5bdd admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.452565 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0aa53a-8641-46d6-b32c-5d57ecfb5bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.452675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4436f0-9051-48ac-aebe-699b0b92a645 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.454815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0aa53a-8641-46d6-b32c-5d57ecfb5bdd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.466691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4436f0-9051-48ac-aebe-699b0b92a645 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.471724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78286f05-6751-40b4-8852-e697f11b16b8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PQsHLq5kQBacvE0ZAbog-w, audit_chain_id=['PQsHLq5kQBacvE0ZAbog-w']) at 0x7fe09e150220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.472328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78286f05-6751-40b4-8852-e697f11b16b8 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.472617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78286f05-6751-40b4-8852-e697f11b16b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.472896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78286f05-6751-40b4-8852-e697f11b16b8 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.473584 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78286f05-6751-40b4-8852-e697f11b16b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.475552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78286f05-6751-40b4-8852-e697f11b16b8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.529087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 759/1516] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:31.530496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aede0-4181-4172-bb6a-bf62fcce1be6 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.530758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aede0-4181-4172-bb6a-bf62fcce1be6 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.531038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aede0-4181-4172-bb6a-bf62fcce1be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.549853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 758/1517] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:31.549853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc729-32dc-41a1-b1d3-90a4e482ffb7 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.549853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc729-32dc-41a1-b1d3-90a4e482ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.549853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc729-32dc-41a1-b1d3-90a4e482ffb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.555611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-902aede0-4181-4172-bb6a-bf62fcce1be6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.556761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-902aede0-4181-4172-bb6a-bf62fcce1be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.564879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 760/1518] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.566455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f501849-0152-4d4b-b6c6-8c62974ca99d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.566871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f501849-0152-4d4b-b6c6-8c62974ca99d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.567349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f501849-0152-4d4b-b6c6-8c62974ca99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.571390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-128fc729-32dc-41a1-b1d3-90a4e482ffb7 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.572796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-128fc729-32dc-41a1-b1d3-90a4e482ffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.580715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 759/1519] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.581495 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fc729-32dc-41a1-b1d3-90a4e482ffb7 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.590464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fc729-32dc-41a1-b1d3-90a4e482ffb7 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.594657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2044c59-0ec9-4775-95f4-2bb2394da6b3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dkegMpGlQM2uRlIZcEkIwQ, audit_chain_id=['dkegMpGlQM2uRlIZcEkIwQ']) at 0x7fe09e14adc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.595293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044c59-0ec9-4775-95f4-2bb2394da6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.595588 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044c59-0ec9-4775-95f4-2bb2394da6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.595873 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044c59-0ec9-4775-95f4-2bb2394da6b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.596352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-2f501849-0152-4d4b-b6c6-8c62974ca99d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.596562 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2044c59-0ec9-4775-95f4-2bb2394da6b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:01:31.596864 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2044c59-0ec9-4775-95f4-2bb2394da6b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.597498 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-2f501849-0152-4d4b-b6c6-8c62974ca99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.598687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2044c59-0ec9-4775-95f4-2bb2394da6b3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.604570 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 761/1520] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.607369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4c195-5e82-41ae-96c8-4fc1a8aa70ac None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.607369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4c195-5e82-41ae-96c8-4fc1a8aa70ac None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.607369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4c195-5e82-41ae-96c8-4fc1a8aa70ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.611616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 760/1521] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:01:31.612692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb5c54-097f-498c-9b78-57ba2020e97c None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.612989 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb5c54-097f-498c-9b78-57ba2020e97c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.613278 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb5c54-097f-498c-9b78-57ba2020e97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.636444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-dfeb5c54-097f-498c-9b78-57ba2020e97c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.636870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-07d4c195-5e82-41ae-96c8-4fc1a8aa70ac None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.637602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-dfeb5c54-097f-498c-9b78-57ba2020e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.638891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-07d4c195-5e82-41ae-96c8-4fc1a8aa70ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.645553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 761/1522] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.646218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 762/1523] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.646814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4c195-5e82-41ae-96c8-4fc1a8aa70ac None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.651446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb5c54-097f-498c-9b78-57ba2020e97c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.659193 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4c195-5e82-41ae-96c8-4fc1a8aa70ac None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.662112 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb5c54-097f-498c-9b78-57ba2020e97c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.663689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e478d4-c3c2-46d8-91da-e32141bba283 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PQsHLq5kQBacvE0ZAbog-w, audit_chain_id=['PQsHLq5kQBacvE0ZAbog-w']) at 0x7fe09e143e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.664281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e478d4-c3c2-46d8-91da-e32141bba283 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.664563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e478d4-c3c2-46d8-91da-e32141bba283 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.664839 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e478d4-c3c2-46d8-91da-e32141bba283 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.665528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e478d4-c3c2-46d8-91da-e32141bba283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.666302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a39f4f-f3dc-4dc2-a744-134da4d54ffb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mRWjwkslTrGvKArrwz4jSA, audit_chain_id=['mRWjwkslTrGvKArrwz4jSA']) at 0x7fe09e108b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.666896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a39f4f-f3dc-4dc2-a744-134da4d54ffb admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.667142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e478d4-c3c2-46d8-91da-e32141bba283 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.667564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a39f4f-f3dc-4dc2-a744-134da4d54ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.667908 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a39f4f-f3dc-4dc2-a744-134da4d54ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.668367 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a39f4f-f3dc-4dc2-a744-134da4d54ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.670149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a39f4f-f3dc-4dc2-a744-134da4d54ffb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.680823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 763/1524] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:31.680823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c361184-f267-4662-bc94-dccfa8f7b76f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.680823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c361184-f267-4662-bc94-dccfa8f7b76f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.680823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c361184-f267-4662-bc94-dccfa8f7b76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.681202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 762/1525] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:31.681631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82211bea-b7ff-4e8e-89df-c5aac8f1197c None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.681921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82211bea-b7ff-4e8e-89df-c5aac8f1197c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.682201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82211bea-b7ff-4e8e-89df-c5aac8f1197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.705446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-82211bea-b7ff-4e8e-89df-c5aac8f1197c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.705655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-6c361184-f267-4662-bc94-dccfa8f7b76f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.706584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-6c361184-f267-4662-bc94-dccfa8f7b76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.706691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-82211bea-b7ff-4e8e-89df-c5aac8f1197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.713797 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 764/1526] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.714228 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 763/1527] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.715169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567f067-006c-4a8c-b0e4-10dd97cec7cd None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.715463 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567f067-006c-4a8c-b0e4-10dd97cec7cd None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.715602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82211bea-b7ff-4e8e-89df-c5aac8f1197c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.715792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567f067-006c-4a8c-b0e4-10dd97cec7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.726612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82211bea-b7ff-4e8e-89df-c5aac8f1197c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.730982 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a2590-2c78-4eed-90a9-089eee8588d1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dkegMpGlQM2uRlIZcEkIwQ, audit_chain_id=['dkegMpGlQM2uRlIZcEkIwQ']) at 0x7fe09de72940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.732459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a2590-2c78-4eed-90a9-089eee8588d1 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.732853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a2590-2c78-4eed-90a9-089eee8588d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.733237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a2590-2c78-4eed-90a9-089eee8588d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.733982 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a2590-2c78-4eed-90a9-089eee8588d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.735982 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a2590-2c78-4eed-90a9-089eee8588d1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.738822 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-9567f067-006c-4a8c-b0e4-10dd97cec7cd None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.740072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9567f067-006c-4a8c-b0e4-10dd97cec7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.748461 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 765/1528] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.756256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f687-a060-4cf3-aad4-5f9d7bc2f654 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.756256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f687-a060-4cf3-aad4-5f9d7bc2f654 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.756256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f687-a060-4cf3-aad4-5f9d7bc2f654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.772590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d065f687-a060-4cf3-aad4-5f9d7bc2f654 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.776626 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d065f687-a060-4cf3-aad4-5f9d7bc2f654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.781335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 766/1529] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.782550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319133e-ccb7-4eee-acd2-6207239a320e None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.782842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319133e-ccb7-4eee-acd2-6207239a320e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.783131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319133e-ccb7-4eee-acd2-6207239a320e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.806096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-3319133e-ccb7-4eee-acd2-6207239a320e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:31.807267 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3319133e-ccb7-4eee-acd2-6207239a320e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:31.816003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 767/1530] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:31.816786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319133e-ccb7-4eee-acd2-6207239a320e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.826159 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319133e-ccb7-4eee-acd2-6207239a320e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.827025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 764/1531] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:31.827025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a2590-2c78-4eed-90a9-089eee8588d1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.894002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2097ef6-ee25-4fff-bc07-976b1d592ded admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PQsHLq5kQBacvE0ZAbog-w, audit_chain_id=['PQsHLq5kQBacvE0ZAbog-w']) at 0x7fe09e411670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.894610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2097ef6-ee25-4fff-bc07-976b1d592ded admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.894897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2097ef6-ee25-4fff-bc07-976b1d592ded admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.895208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2097ef6-ee25-4fff-bc07-976b1d592ded admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.895911 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2097ef6-ee25-4fff-bc07-976b1d592ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.897509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2097ef6-ee25-4fff-bc07-976b1d592ded admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.898544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a2590-2c78-4eed-90a9-089eee8588d1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.903150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20ac13-809a-4c8b-a666-4044a1c94137 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mRWjwkslTrGvKArrwz4jSA, audit_chain_id=['mRWjwkslTrGvKArrwz4jSA']) at 0x7fe09e4f3220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.903840 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ac13-809a-4c8b-a666-4044a1c94137 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.904276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ac13-809a-4c8b-a666-4044a1c94137 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.904640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ac13-809a-4c8b-a666-4044a1c94137 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.905413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20ac13-809a-4c8b-a666-4044a1c94137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.907077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20ac13-809a-4c8b-a666-4044a1c94137 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.907411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 768/1532] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:31.911297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2097ef6-ee25-4fff-bc07-976b1d592ded admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.921999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 765/1533] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:31.921999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20ac13-809a-4c8b-a666-4044a1c94137 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.924727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2097ef6-ee25-4fff-bc07-976b1d592ded admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.929193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20ac13-809a-4c8b-a666-4044a1c94137 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.929418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564c51f-6446-4d5c-8c0a-38cc6b58cc63 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7Ipew5rTa2aB3lKmqx7Kw, audit_chain_id=['L7Ipew5rTa2aB3lKmqx7Kw']) at 0x7fe09e17f850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.930134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564c51f-6446-4d5c-8c0a-38cc6b58cc63 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.930441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564c51f-6446-4d5c-8c0a-38cc6b58cc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.930896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564c51f-6446-4d5c-8c0a-38cc6b58cc63 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.931754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564c51f-6446-4d5c-8c0a-38cc6b58cc63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:01:31.932083 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564c51f-6446-4d5c-8c0a-38cc6b58cc63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.933636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdbce1-3793-4e96-b075-5a8c33a154af admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09de19760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.933819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564c51f-6446-4d5c-8c0a-38cc6b58cc63 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.934216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdbce1-3793-4e96-b075-5a8c33a154af admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.934510 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdbce1-3793-4e96-b075-5a8c33a154af admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.936169 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdbce1-3793-4e96-b075-5a8c33a154af admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.936867 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdbce1-3793-4e96-b075-5a8c33a154af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:01:31.937177 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdbce1-3793-4e96-b075-5a8c33a154af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.938735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdbce1-3793-4e96-b075-5a8c33a154af admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.955910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 769/1534] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:01:31.955910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564c51f-6446-4d5c-8c0a-38cc6b58cc63 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.958344 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564c51f-6446-4d5c-8c0a-38cc6b58cc63 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.967411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 766/1535] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:01:31.967411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdbce1-3793-4e96-b075-5a8c33a154af admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.970901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e4cd1-e414-422b-bfbe-97948c94d5eb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FiTF_CooSCmXNU1uc82Y7A, audit_chain_id=['FiTF_CooSCmXNU1uc82Y7A']) at 0x7fe09e439730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.971645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4cd1-e414-422b-bfbe-97948c94d5eb admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.971963 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4cd1-e414-422b-bfbe-97948c94d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.972266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4cd1-e414-422b-bfbe-97948c94d5eb admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.972943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e4cd1-e414-422b-bfbe-97948c94d5eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:01:31.973269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e4cd1-e414-422b-bfbe-97948c94d5eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.973606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdbce1-3793-4e96-b075-5a8c33a154af admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:31.974888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e4cd1-e414-422b-bfbe-97948c94d5eb admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.978444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08a0d4-d808-4ba1-b572-3d7b0fd77545 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nkr7LLNVT8SZgjM1WEnvvg, audit_chain_id=['nkr7LLNVT8SZgjM1WEnvvg']) at 0x7fe09e155ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:31.979241 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a0d4-d808-4ba1-b572-3d7b0fd77545 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:31.979532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a0d4-d808-4ba1-b572-3d7b0fd77545 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:31.979890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a0d4-d808-4ba1-b572-3d7b0fd77545 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:31.980735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08a0d4-d808-4ba1-b572-3d7b0fd77545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:01:31.981023 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08a0d4-d808-4ba1-b572-3d7b0fd77545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:31.983005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08a0d4-d808-4ba1-b572-3d7b0fd77545 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:31.987745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 770/1536] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:01:31.991994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e4cd1-e414-422b-bfbe-97948c94d5eb admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:31.997028 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 767/1537] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:01:31.997028 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08a0d4-d808-4ba1-b572-3d7b0fd77545 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.002056 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e4cd1-e414-422b-bfbe-97948c94d5eb admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.006702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08a0d4-d808-4ba1-b572-3d7b0fd77545 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.007540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e7ef3-4ffd-4bf3-b789-e86b839236b5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gU-NNndDTn-_6n0xbdaVQA, audit_chain_id=['gU-NNndDTn-_6n0xbdaVQA']) at 0x7fe09df25c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.008139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e7ef3-4ffd-4bf3-b789-e86b839236b5 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.008432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e7ef3-4ffd-4bf3-b789-e86b839236b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.008775 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e7ef3-4ffd-4bf3-b789-e86b839236b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.009475 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e7ef3-4ffd-4bf3-b789-e86b839236b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:01:32.009780 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e7ef3-4ffd-4bf3-b789-e86b839236b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.011151 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cff04-1b4a-4894-9ceb-211a20656055 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dkegMpGlQM2uRlIZcEkIwQ, audit_chain_id=['dkegMpGlQM2uRlIZcEkIwQ']) at 0x7fe09e15efd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.011686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e7ef3-4ffd-4bf3-b789-e86b839236b5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.011806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cff04-1b4a-4894-9ceb-211a20656055 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.012062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cff04-1b4a-4894-9ceb-211a20656055 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.012350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cff04-1b4a-4894-9ceb-211a20656055 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.013815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cff04-1b4a-4894-9ceb-211a20656055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.015854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cff04-1b4a-4894-9ceb-211a20656055 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.026031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 771/1538] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:01:32.026960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e7ef3-4ffd-4bf3-b789-e86b839236b5 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.037317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e7ef3-4ffd-4bf3-b789-e86b839236b5 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.042035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877a2d8-43d0-4599-b3e7-bfe1957f541c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PQsHLq5kQBacvE0ZAbog-w, audit_chain_id=['PQsHLq5kQBacvE0ZAbog-w']) at 0x7fe09de6c5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.042839 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877a2d8-43d0-4599-b3e7-bfe1957f541c admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.043156 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877a2d8-43d0-4599-b3e7-bfe1957f541c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.043451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877a2d8-43d0-4599-b3e7-bfe1957f541c admin admin] PATH_INFO: `/v3/projects/2234b3391e204ea49d8e31d3731b822c/users/46e4e775395f4f01b37ae1e6efe87898/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.064446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877a2d8-43d0-4599-b3e7-bfe1957f541c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2234b3391e204ea49d8e31d3731b822c, user_id=46e4e775395f4f01b37ae1e6efe87898, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.066029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877a2d8-43d0-4599-b3e7-bfe1957f541c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.117308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 768/1539] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:31 2022] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:32.118240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cff04-1b4a-4894-9ceb-211a20656055 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.128307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cff04-1b4a-4894-9ceb-211a20656055 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.132665 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c7aa6-dc0a-4556-b539-a15e76b982e2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mRWjwkslTrGvKArrwz4jSA, audit_chain_id=['mRWjwkslTrGvKArrwz4jSA']) at 0x7fe09defe9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.133468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c7aa6-dc0a-4556-b539-a15e76b982e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.133756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c7aa6-dc0a-4556-b539-a15e76b982e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.134040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c7aa6-dc0a-4556-b539-a15e76b982e2 admin admin] PATH_INFO: `/v3/projects/e8d685b5629d4a8185474969249dbc6e/users/b929b39cef7546a59987075cdef32d3b/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.140865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 772/1540] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:32 2022] PUT /identity/v3/projects/2234b3391e204ea49d8e31d3731b822c/users/46e4e775395f4f01b37ae1e6efe87898/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:32.141671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877a2d8-43d0-4599-b3e7-bfe1957f541c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.158013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c7aa6-dc0a-4556-b539-a15e76b982e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d685b5629d4a8185474969249dbc6e, user_id=b929b39cef7546a59987075cdef32d3b, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.160775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c7aa6-dc0a-4556-b539-a15e76b982e2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.209647 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877a2d8-43d0-4599-b3e7-bfe1957f541c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.214048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400fed3-a7f5-447a-9f89-17903d5e7905 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7Ipew5rTa2aB3lKmqx7Kw, audit_chain_id=['L7Ipew5rTa2aB3lKmqx7Kw']) at 0x7fe09e1dfc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.214639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400fed3-a7f5-447a-9f89-17903d5e7905 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.214925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400fed3-a7f5-447a-9f89-17903d5e7905 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.215245 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400fed3-a7f5-447a-9f89-17903d5e7905 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.215923 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400fed3-a7f5-447a-9f89-17903d5e7905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.217813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400fed3-a7f5-447a-9f89-17903d5e7905 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.233284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 769/1541] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:32 2022] PUT /identity/v3/projects/e8d685b5629d4a8185474969249dbc6e/users/b929b39cef7546a59987075cdef32d3b/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:32.234387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c7aa6-dc0a-4556-b539-a15e76b982e2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.296003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 773/1542] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:32.300391 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400fed3-a7f5-447a-9f89-17903d5e7905 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.303080 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c7aa6-dc0a-4556-b539-a15e76b982e2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.364760 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40ed09-9bc6-48f0-90ec-c489424b91c2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09e15e550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.365276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40ed09-9bc6-48f0-90ec-c489424b91c2 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.365566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40ed09-9bc6-48f0-90ec-c489424b91c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.365847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40ed09-9bc6-48f0-90ec-c489424b91c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.366481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40ed09-9bc6-48f0-90ec-c489424b91c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.368395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40ed09-9bc6-48f0-90ec-c489424b91c2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.371740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400fed3-a7f5-447a-9f89-17903d5e7905 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.377267 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fb348-04ef-479a-92f3-0070f8ccbe27 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FiTF_CooSCmXNU1uc82Y7A, audit_chain_id=['FiTF_CooSCmXNU1uc82Y7A']) at 0x7fe09e3f8ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.377869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fb348-04ef-479a-92f3-0070f8ccbe27 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.378163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fb348-04ef-479a-92f3-0070f8ccbe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.378449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fb348-04ef-479a-92f3-0070f8ccbe27 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.379087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fb348-04ef-479a-92f3-0070f8ccbe27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.381012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fb348-04ef-479a-92f3-0070f8ccbe27 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.443508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 770/1543] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/projects => generated 371 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:32.444318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40ed09-9bc6-48f0-90ec-c489424b91c2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.464703 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 774/1544] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:32.464703 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fb348-04ef-479a-92f3-0070f8ccbe27 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.515037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40ed09-9bc6-48f0-90ec-c489424b91c2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.531221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fb348-04ef-479a-92f3-0070f8ccbe27 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.535575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3c90e-2e9a-434d-99bf-e4e0ef957f56 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gU-NNndDTn-_6n0xbdaVQA, audit_chain_id=['gU-NNndDTn-_6n0xbdaVQA']) at 0x7fe09e424400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.536169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3c90e-2e9a-434d-99bf-e4e0ef957f56 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.536453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3c90e-2e9a-434d-99bf-e4e0ef957f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.536733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3c90e-2e9a-434d-99bf-e4e0ef957f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.537367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3c90e-2e9a-434d-99bf-e4e0ef957f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.539290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3c90e-2e9a-434d-99bf-e4e0ef957f56 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.579637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada63bd-ea3a-44a6-aa72-9ff43f9355d8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nkr7LLNVT8SZgjM1WEnvvg, audit_chain_id=['nkr7LLNVT8SZgjM1WEnvvg']) at 0x7fe09e4f3940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.580322 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada63bd-ea3a-44a6-aa72-9ff43f9355d8 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.580653 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada63bd-ea3a-44a6-aa72-9ff43f9355d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.580981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada63bd-ea3a-44a6-aa72-9ff43f9355d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.581664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada63bd-ea3a-44a6-aa72-9ff43f9355d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.583839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada63bd-ea3a-44a6-aa72-9ff43f9355d8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.610403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 775/1545] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:32.611264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3c90e-2e9a-434d-99bf-e4e0ef957f56 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.670766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 771/1546] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/projects => generated 369 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:32.670766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998838f7-b4e3-448c-ac3b-aad8ae7d9435 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.670766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998838f7-b4e3-448c-ac3b-aad8ae7d9435 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.670766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998838f7-b4e3-448c-ac3b-aad8ae7d9435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.678843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3c90e-2e9a-434d-99bf-e4e0ef957f56 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.691939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-998838f7-b4e3-448c-ac3b-aad8ae7d9435 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:32.693140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-998838f7-b4e3-448c-ac3b-aad8ae7d9435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:32.743617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ea39f-8ebe-4697-b6a7-8b102d7705d2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dkegMpGlQM2uRlIZcEkIwQ, audit_chain_id=['dkegMpGlQM2uRlIZcEkIwQ']) at 0x7fe09e411670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.744233 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea39f-8ebe-4697-b6a7-8b102d7705d2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.744526 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea39f-8ebe-4697-b6a7-8b102d7705d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.744830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea39f-8ebe-4697-b6a7-8b102d7705d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.745579 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ea39f-8ebe-4697-b6a7-8b102d7705d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.747824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ea39f-8ebe-4697-b6a7-8b102d7705d2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.757246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 772/1547] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:32.760479 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 776/1548] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:32.760585 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959894-ca0b-41ff-aa85-ec45c851ca40 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.760683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ea39f-8ebe-4697-b6a7-8b102d7705d2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.760779 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959894-ca0b-41ff-aa85-ec45c851ca40 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.760779 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959894-ca0b-41ff-aa85-ec45c851ca40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.772655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ea39f-8ebe-4697-b6a7-8b102d7705d2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.777151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66187db7-e31a-420b-a027-971160e3ba8a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7Ipew5rTa2aB3lKmqx7Kw, audit_chain_id=['L7Ipew5rTa2aB3lKmqx7Kw']) at 0x7fe0a38b1910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.777740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66187db7-e31a-420b-a027-971160e3ba8a admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.778025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66187db7-e31a-420b-a027-971160e3ba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.778462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66187db7-e31a-420b-a027-971160e3ba8a admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.779454 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66187db7-e31a-420b-a027-971160e3ba8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.781122 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-9e959894-ca0b-41ff-aa85-ec45c851ca40 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:32.781373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66187db7-e31a-420b-a027-971160e3ba8a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.782271 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9e959894-ca0b-41ff-aa85-ec45c851ca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:32.789172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 773/1549] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:32.789919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959894-ca0b-41ff-aa85-ec45c851ca40 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.799847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959894-ca0b-41ff-aa85-ec45c851ca40 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.804339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91284d51-410f-40fc-9e92-9a3bc438b6e3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09e4f32b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.804936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91284d51-410f-40fc-9e92-9a3bc438b6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.805228 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91284d51-410f-40fc-9e92-9a3bc438b6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.805512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91284d51-410f-40fc-9e92-9a3bc438b6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.806146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91284d51-410f-40fc-9e92-9a3bc438b6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.808078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91284d51-410f-40fc-9e92-9a3bc438b6e3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.857488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 777/1550] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:32.857488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66187db7-e31a-420b-a027-971160e3ba8a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.864280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66187db7-e31a-420b-a027-971160e3ba8a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.868751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90833f45-6c4c-4ebc-9e51-ab1e5eca1112 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FiTF_CooSCmXNU1uc82Y7A, audit_chain_id=['FiTF_CooSCmXNU1uc82Y7A']) at 0x7fe09de5f8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.869336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90833f45-6c4c-4ebc-9e51-ab1e5eca1112 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.869622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90833f45-6c4c-4ebc-9e51-ab1e5eca1112 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.869906 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90833f45-6c4c-4ebc-9e51-ab1e5eca1112 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.870541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90833f45-6c4c-4ebc-9e51-ab1e5eca1112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.874550 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 774/1551] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/users => generated 286 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:32.874550 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91284d51-410f-40fc-9e92-9a3bc438b6e3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.874816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90833f45-6c4c-4ebc-9e51-ab1e5eca1112 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.881614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91284d51-410f-40fc-9e92-9a3bc438b6e3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.885861 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe438f01-6cd5-4f48-b797-5eb34ef2487a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gU-NNndDTn-_6n0xbdaVQA, audit_chain_id=['gU-NNndDTn-_6n0xbdaVQA']) at 0x7fe09e21e250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.886455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438f01-6cd5-4f48-b797-5eb34ef2487a admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.886749 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438f01-6cd5-4f48-b797-5eb34ef2487a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.887070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438f01-6cd5-4f48-b797-5eb34ef2487a admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.887732 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe438f01-6cd5-4f48-b797-5eb34ef2487a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.889713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe438f01-6cd5-4f48-b797-5eb34ef2487a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.934177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 778/1552] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/users => generated 287 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:32.938330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90833f45-6c4c-4ebc-9e51-ab1e5eca1112 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.947722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90833f45-6c4c-4ebc-9e51-ab1e5eca1112 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.953520 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dc451-919a-4f7c-bd2c-391a2b0c4a7e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nkr7LLNVT8SZgjM1WEnvvg, audit_chain_id=['nkr7LLNVT8SZgjM1WEnvvg']) at 0x7fe09e3ed250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.954056 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dc451-919a-4f7c-bd2c-391a2b0c4a7e admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.954348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dc451-919a-4f7c-bd2c-391a2b0c4a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.967973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dc451-919a-4f7c-bd2c-391a2b0c4a7e admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.967973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867dc451-919a-4f7c-bd2c-391a2b0c4a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.967973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867dc451-919a-4f7c-bd2c-391a2b0c4a7e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.968264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 775/1553] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:32.968264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe438f01-6cd5-4f48-b797-5eb34ef2487a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:32.968736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe438f01-6cd5-4f48-b797-5eb34ef2487a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:32.973576 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c70c6-4866-410f-9f2b-d9f3b5b8a09a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dkegMpGlQM2uRlIZcEkIwQ, audit_chain_id=['dkegMpGlQM2uRlIZcEkIwQ']) at 0x7fe09de98820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:32.974192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c70c6-4866-410f-9f2b-d9f3b5b8a09a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:32.974475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c70c6-4866-410f-9f2b-d9f3b5b8a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:32.974761 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c70c6-4866-410f-9f2b-d9f3b5b8a09a admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:32.975492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c70c6-4866-410f-9f2b-d9f3b5b8a09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:32.977080 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c70c6-4866-410f-9f2b-d9f3b5b8a09a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:32.988521 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 776/1554] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:32.989333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c70c6-4866-410f-9f2b-d9f3b5b8a09a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.021891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 779/1555] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:32 2022] POST /identity/v3/users => generated 285 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:33.022932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dc451-919a-4f7c-bd2c-391a2b0c4a7e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.024497 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-867dc451-919a-4f7c-bd2c-391a2b0c4a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:33.050864 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c70c6-4866-410f-9f2b-d9f3b5b8a09a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.054403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9ffa5-c3e6-43e2-9b40-8e705fcda912 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e55f820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.054988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9ffa5-c3e6-43e2-9b40-8e705fcda912 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.055319 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9ffa5-c3e6-43e2-9b40-8e705fcda912 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.055634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9ffa5-c3e6-43e2-9b40-8e705fcda912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.064699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9ffa5-c3e6-43e2-9b40-8e705fcda912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.066126 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9ffa5-c3e6-43e2-9b40-8e705fcda912 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.075208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 777/1556] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:33.076072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9ffa5-c3e6-43e2-9b40-8e705fcda912 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.085131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9ffa5-c3e6-43e2-9b40-8e705fcda912 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.089422 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae99ac-8452-4c38-87f9-4655803c7df6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7Ipew5rTa2aB3lKmqx7Kw, audit_chain_id=['L7Ipew5rTa2aB3lKmqx7Kw']) at 0x7fe09ded1340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.090022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae99ac-8452-4c38-87f9-4655803c7df6 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.090315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae99ac-8452-4c38-87f9-4655803c7df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.090601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae99ac-8452-4c38-87f9-4655803c7df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.091944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae99ac-8452-4c38-87f9-4655803c7df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.092845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dc451-919a-4f7c-bd2c-391a2b0c4a7e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.093512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae99ac-8452-4c38-87f9-4655803c7df6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.096690 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641efb2e-a220-4714-9a2c-74bb5b616eb9 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e8a0700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.097283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641efb2e-a220-4714-9a2c-74bb5b616eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.097572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641efb2e-a220-4714-9a2c-74bb5b616eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.097856 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641efb2e-a220-4714-9a2c-74bb5b616eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.104441 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 778/1557] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:33.105311 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae99ac-8452-4c38-87f9-4655803c7df6 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.108972 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641efb2e-a220-4714-9a2c-74bb5b616eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.110693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641efb2e-a220-4714-9a2c-74bb5b616eb9 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.117271 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae99ac-8452-4c38-87f9-4655803c7df6 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.120542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 780/1558] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:33.121340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641efb2e-a220-4714-9a2c-74bb5b616eb9 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.122020 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78d86e-57fe-4a12-92bf-0a3952c5d6eb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09e14ea60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.122696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78d86e-57fe-4a12-92bf-0a3952c5d6eb admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.123076 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78d86e-57fe-4a12-92bf-0a3952c5d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.123468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78d86e-57fe-4a12-92bf-0a3952c5d6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.124275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78d86e-57fe-4a12-92bf-0a3952c5d6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.125921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78d86e-57fe-4a12-92bf-0a3952c5d6eb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.130954 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641efb2e-a220-4714-9a2c-74bb5b616eb9 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.135537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bc5d5-8eeb-44c9-95dd-a87c18b40f27 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FiTF_CooSCmXNU1uc82Y7A, audit_chain_id=['FiTF_CooSCmXNU1uc82Y7A']) at 0x7fe09e3f8ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.136136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bc5d5-8eeb-44c9-95dd-a87c18b40f27 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.136468 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bc5d5-8eeb-44c9-95dd-a87c18b40f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.136856 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bc5d5-8eeb-44c9-95dd-a87c18b40f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.137487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bc5d5-8eeb-44c9-95dd-a87c18b40f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.138019 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 779/1559] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:33.138878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78d86e-57fe-4a12-92bf-0a3952c5d6eb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.139498 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bc5d5-8eeb-44c9-95dd-a87c18b40f27 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.148465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78d86e-57fe-4a12-92bf-0a3952c5d6eb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.152636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 781/1560] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:33.154693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bc5d5-8eeb-44c9-95dd-a87c18b40f27 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.159935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9476b-8f2f-4f9d-bad8-7217cd3316c6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gU-NNndDTn-_6n0xbdaVQA, audit_chain_id=['gU-NNndDTn-_6n0xbdaVQA']) at 0x7fe09e705850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.160683 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9476b-8f2f-4f9d-bad8-7217cd3316c6 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.160981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9476b-8f2f-4f9d-bad8-7217cd3316c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.161268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9476b-8f2f-4f9d-bad8-7217cd3316c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.161970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9476b-8f2f-4f9d-bad8-7217cd3316c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.163620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9476b-8f2f-4f9d-bad8-7217cd3316c6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.164559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bc5d5-8eeb-44c9-95dd-a87c18b40f27 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.170738 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923adf75-6c81-402d-8fa2-96f85311d3a9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dkegMpGlQM2uRlIZcEkIwQ, audit_chain_id=['dkegMpGlQM2uRlIZcEkIwQ']) at 0x7fe09e9a0ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.171333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923adf75-6c81-402d-8fa2-96f85311d3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.171668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923adf75-6c81-402d-8fa2-96f85311d3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.172017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923adf75-6c81-402d-8fa2-96f85311d3a9 admin admin] PATH_INFO: `/v3/projects/1947aa3088ee4fcb8cc3a8ba8f83047f/users/dbceb8637d6b4980bbc5d8011275a587/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.175609 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 780/1561] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:33.176275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9476b-8f2f-4f9d-bad8-7217cd3316c6 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.190033 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9476b-8f2f-4f9d-bad8-7217cd3316c6 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.201970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33946-5059-4b26-80c2-143789c51d4e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nkr7LLNVT8SZgjM1WEnvvg, audit_chain_id=['nkr7LLNVT8SZgjM1WEnvvg']) at 0x7fe09e14adc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.201970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33946-5059-4b26-80c2-143789c51d4e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.201970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33946-5059-4b26-80c2-143789c51d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.201970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c33946-5059-4b26-80c2-143789c51d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.202348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c33946-5059-4b26-80c2-143789c51d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.202348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c33946-5059-4b26-80c2-143789c51d4e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.205753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923adf75-6c81-402d-8fa2-96f85311d3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1947aa3088ee4fcb8cc3a8ba8f83047f, user_id=dbceb8637d6b4980bbc5d8011275a587, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.209978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923adf75-6c81-402d-8fa2-96f85311d3a9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.214859 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 781/1562] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:33.216995 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33946-5059-4b26-80c2-143789c51d4e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.228518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c33946-5059-4b26-80c2-143789c51d4e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.234814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d0060-3f08-42b0-8207-9a9531edb669 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7Ipew5rTa2aB3lKmqx7Kw, audit_chain_id=['L7Ipew5rTa2aB3lKmqx7Kw']) at 0x7fe09e106b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.235462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d0060-3f08-42b0-8207-9a9531edb669 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.235798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d0060-3f08-42b0-8207-9a9531edb669 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.236780 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d0060-3f08-42b0-8207-9a9531edb669 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.237277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d0060-3f08-42b0-8207-9a9531edb669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.239340 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d0060-3f08-42b0-8207-9a9531edb669 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.255216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 782/1563] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:33.255216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d0060-3f08-42b0-8207-9a9531edb669 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.268162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d0060-3f08-42b0-8207-9a9531edb669 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.273650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc982a8f-6180-4a1b-8fcb-adb44f7f2b98 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09de0ee50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.274284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc982a8f-6180-4a1b-8fcb-adb44f7f2b98 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.274960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc982a8f-6180-4a1b-8fcb-adb44f7f2b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.275281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc982a8f-6180-4a1b-8fcb-adb44f7f2b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.276065 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc982a8f-6180-4a1b-8fcb-adb44f7f2b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.277592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc982a8f-6180-4a1b-8fcb-adb44f7f2b98 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.287333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 782/1564] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:33 2022] PUT /identity/v3/projects/1947aa3088ee4fcb8cc3a8ba8f83047f/users/dbceb8637d6b4980bbc5d8011275a587/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:33.288896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923adf75-6c81-402d-8fa2-96f85311d3a9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.291576 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 783/1565] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:33.295951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc982a8f-6180-4a1b-8fcb-adb44f7f2b98 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.306069 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc982a8f-6180-4a1b-8fcb-adb44f7f2b98 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.371163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923adf75-6c81-402d-8fa2-96f85311d3a9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.375940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560e095-f627-45ce-9406-99a02fb4986b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FiTF_CooSCmXNU1uc82Y7A, audit_chain_id=['FiTF_CooSCmXNU1uc82Y7A']) at 0x7fe09e198bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.376466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa415507-3d56-45f7-ac95-e919d7a8b32c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gU-NNndDTn-_6n0xbdaVQA, audit_chain_id=['gU-NNndDTn-_6n0xbdaVQA']) at 0x7fe09de55490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.376607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e095-f627-45ce-9406-99a02fb4986b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.376832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e095-f627-45ce-9406-99a02fb4986b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.377116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e095-f627-45ce-9406-99a02fb4986b admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.377444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa415507-3d56-45f7-ac95-e919d7a8b32c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.377807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa415507-3d56-45f7-ac95-e919d7a8b32c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.377924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560e095-f627-45ce-9406-99a02fb4986b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.378194 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa415507-3d56-45f7-ac95-e919d7a8b32c admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.378965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa415507-3d56-45f7-ac95-e919d7a8b32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.379485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560e095-f627-45ce-9406-99a02fb4986b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.380929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa415507-3d56-45f7-ac95-e919d7a8b32c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.391437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 783/1566] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:33.394030 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 784/1567] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:33.394030 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa415507-3d56-45f7-ac95-e919d7a8b32c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.395714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560e095-f627-45ce-9406-99a02fb4986b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.405916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa415507-3d56-45f7-ac95-e919d7a8b32c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.407103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560e095-f627-45ce-9406-99a02fb4986b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.410790 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90625ed-a2b4-4239-af9b-203134497474 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7Ipew5rTa2aB3lKmqx7Kw, audit_chain_id=['L7Ipew5rTa2aB3lKmqx7Kw']) at 0x7fe09e3b5f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.413612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90625ed-a2b4-4239-af9b-203134497474 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.413612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90625ed-a2b4-4239-af9b-203134497474 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.413766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9ec5f-09c1-4dad-a636-42da520f5b5f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nkr7LLNVT8SZgjM1WEnvvg, audit_chain_id=['nkr7LLNVT8SZgjM1WEnvvg']) at 0x7fe09de54400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.413854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90625ed-a2b4-4239-af9b-203134497474 admin admin] PATH_INFO: `/v3/projects/a73fa98b1d974ed1935c4d3e2879abad/users/b9371804d1f943a6b6b3b2a9901030c8/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.413935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ec5f-09c1-4dad-a636-42da520f5b5f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.414594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ec5f-09c1-4dad-a636-42da520f5b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.414594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ec5f-09c1-4dad-a636-42da520f5b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.415670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9ec5f-09c1-4dad-a636-42da520f5b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.417225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9ec5f-09c1-4dad-a636-42da520f5b5f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.434089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 784/1568] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:33.434089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9ec5f-09c1-4dad-a636-42da520f5b5f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.443790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9ec5f-09c1-4dad-a636-42da520f5b5f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.449483 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90625ed-a2b4-4239-af9b-203134497474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73fa98b1d974ed1935c4d3e2879abad, user_id=b9371804d1f943a6b6b3b2a9901030c8, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.453603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce1670-694b-4afe-ba87-3b06ddc94c32 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09e411790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.454446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce1670-694b-4afe-ba87-3b06ddc94c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.454845 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90625ed-a2b4-4239-af9b-203134497474 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.454962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce1670-694b-4afe-ba87-3b06ddc94c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.455162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce1670-694b-4afe-ba87-3b06ddc94c32 admin admin] PATH_INFO: `/v3/projects/ffda43370858402fa901bfd286c88ee4/users/1137606a463c4aa889859fb8c9915340/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.477108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce1670-694b-4afe-ba87-3b06ddc94c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffda43370858402fa901bfd286c88ee4, user_id=1137606a463c4aa889859fb8c9915340, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.479809 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce1670-694b-4afe-ba87-3b06ddc94c32 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.522909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 785/1569] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:33 2022] PUT /identity/v3/projects/a73fa98b1d974ed1935c4d3e2879abad/users/b9371804d1f943a6b6b3b2a9901030c8/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:33.524435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeca6a-5a2a-4e65-bba6-5d290f7208ab None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.524732 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeca6a-5a2a-4e65-bba6-5d290f7208ab None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.525018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeca6a-5a2a-4e65-bba6-5d290f7208ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.558144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 785/1570] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:33 2022] PUT /identity/v3/projects/ffda43370858402fa901bfd286c88ee4/users/1137606a463c4aa889859fb8c9915340/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:33.559195 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce1670-694b-4afe-ba87-3b06ddc94c32 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.565361 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3cbeca6a-5a2a-4e65-bba6-5d290f7208ab None None] MFA Rules not processed for user `dbceb8637d6b4980bbc5d8011275a587`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:33.566620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3cbeca6a-5a2a-4e65-bba6-5d290f7208ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:33.633596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce1670-694b-4afe-ba87-3b06ddc94c32 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.639935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829a69c-6736-4a04-84c1-f812549c75b3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FiTF_CooSCmXNU1uc82Y7A, audit_chain_id=['FiTF_CooSCmXNU1uc82Y7A']) at 0x7fe09de54400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.640896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829a69c-6736-4a04-84c1-f812549c75b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.641335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829a69c-6736-4a04-84c1-f812549c75b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.641462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829a69c-6736-4a04-84c1-f812549c75b3 admin admin] PATH_INFO: `/v3/projects/e00c264516ff48bdb7d2411e37b27ff4/users/d7a958a47ae44558a637dbe34b5a8f9b/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.665187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829a69c-6736-4a04-84c1-f812549c75b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00c264516ff48bdb7d2411e37b27ff4, user_id=d7a958a47ae44558a637dbe34b5a8f9b, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.667982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829a69c-6736-4a04-84c1-f812549c75b3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.672397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 786/1571] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:33 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:33.672397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbeca6a-5a2a-4e65-bba6-5d290f7208ab None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.681651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbeca6a-5a2a-4e65-bba6-5d290f7208ab None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.687185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382a1b5-8984-4b7e-a1d7-0c5062c31814 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gU-NNndDTn-_6n0xbdaVQA, audit_chain_id=['gU-NNndDTn-_6n0xbdaVQA']) at 0x7fe09de8aee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:33.689915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a1b5-8984-4b7e-a1d7-0c5062c31814 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.689915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a1b5-8984-4b7e-a1d7-0c5062c31814 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.689915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a1b5-8984-4b7e-a1d7-0c5062c31814 admin admin] PATH_INFO: `/v3/projects/498eaf5c78e54296ac5cdeef3489e3ef/users/46e767d2e3624a3fa799c8c1b20b0516/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.713208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382a1b5-8984-4b7e-a1d7-0c5062c31814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498eaf5c78e54296ac5cdeef3489e3ef, user_id=46e767d2e3624a3fa799c8c1b20b0516, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:33.716323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382a1b5-8984-4b7e-a1d7-0c5062c31814 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:33.758025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 786/1572] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:33 2022] PUT /identity/v3/projects/e00c264516ff48bdb7d2411e37b27ff4/users/d7a958a47ae44558a637dbe34b5a8f9b/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:33.762188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829a69c-6736-4a04-84c1-f812549c75b3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:33.793503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 787/1573] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:33 2022] PUT /identity/v3/projects/498eaf5c78e54296ac5cdeef3489e3ef/users/46e767d2e3624a3fa799c8c1b20b0516/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:33.795686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4725-6a89-4804-a762-be8b80d55bb1 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.796177 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4725-6a89-4804-a762-be8b80d55bb1 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.796690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4725-6a89-4804-a762-be8b80d55bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.829925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-230f4725-6a89-4804-a762-be8b80d55bb1 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:33.831783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-230f4725-6a89-4804-a762-be8b80d55bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:33.868345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829a69c-6736-4a04-84c1-f812549c75b3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:33.919549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 788/1574] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:33.920980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0bf91-af67-4c43-aadc-59348cd6556a None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:33.921281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0bf91-af67-4c43-aadc-59348cd6556a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:33.921564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0bf91-af67-4c43-aadc-59348cd6556a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:33.959414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-26f0bf91-af67-4c43-aadc-59348cd6556a None None] MFA Rules not processed for user `1137606a463c4aa889859fb8c9915340`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:33.960641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-26f0bf91-af67-4c43-aadc-59348cd6556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:34.019510 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5eb7e2-c6cf-4a56-8379-771710e9224a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nkr7LLNVT8SZgjM1WEnvvg, audit_chain_id=['nkr7LLNVT8SZgjM1WEnvvg']) at 0x7fe09de5fbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:34.020356 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5eb7e2-c6cf-4a56-8379-771710e9224a admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.020646 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5eb7e2-c6cf-4a56-8379-771710e9224a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.020931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5eb7e2-c6cf-4a56-8379-771710e9224a admin admin] PATH_INFO: `/v3/projects/58471ac4dd184d36938ad9148255f8c0/users/bd7926a93dd14540a46805c1981322aa/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.045544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 789/1575] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:33 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:34.050407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0bf91-af67-4c43-aadc-59348cd6556a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:34.059143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5eb7e2-c6cf-4a56-8379-771710e9224a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58471ac4dd184d36938ad9148255f8c0, user_id=bd7926a93dd14540a46805c1981322aa, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:34.062429 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5eb7e2-c6cf-4a56-8379-771710e9224a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:34.111603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0bf91-af67-4c43-aadc-59348cd6556a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:34.115158 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5f642-a214-4ec9-b445-34ebcc28e066 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09de10850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:34.115791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f642-a214-4ec9-b445-34ebcc28e066 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.116091 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f642-a214-4ec9-b445-34ebcc28e066 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.116376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f642-a214-4ec9-b445-34ebcc28e066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.123730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 787/1576] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:33 2022] PUT /identity/v3/projects/58471ac4dd184d36938ad9148255f8c0/users/bd7926a93dd14540a46805c1981322aa/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:34.125328 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff73337-ae98-4203-80fe-f5cdbbb71deb None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.125610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff73337-ae98-4203-80fe-f5cdbbb71deb None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.125896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff73337-ae98-4203-80fe-f5cdbbb71deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.149272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-dff73337-ae98-4203-80fe-f5cdbbb71deb None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:34.150455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-dff73337-ae98-4203-80fe-f5cdbbb71deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:34.200384 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5f642-a214-4ec9-b445-34ebcc28e066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:34.217587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5f642-a214-4ec9-b445-34ebcc28e066 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:34.223615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 788/1577] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:34.225833 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d687c7-eaf5-4694-90d7-4fc3eceeb0d5 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.226135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d687c7-eaf5-4694-90d7-4fc3eceeb0d5 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.226420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d687c7-eaf5-4694-90d7-4fc3eceeb0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.237129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 790/1578] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:34 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:34.237968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5f642-a214-4ec9-b445-34ebcc28e066 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:34.252006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e2d687c7-eaf5-4694-90d7-4fc3eceeb0d5 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:34.253174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e2d687c7-eaf5-4694-90d7-4fc3eceeb0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:34.257695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5f642-a214-4ec9-b445-34ebcc28e066 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:34.262806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 789/1579] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:34.262806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d687c7-eaf5-4694-90d7-4fc3eceeb0d5 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:34.269653 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c3772-787d-4180-8b89-41b7bc2a8a79 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09e25b880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:34.270383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c3772-787d-4180-8b89-41b7bc2a8a79 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.270770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c3772-787d-4180-8b89-41b7bc2a8a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.271056 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c3772-787d-4180-8b89-41b7bc2a8a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.273015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c3772-787d-4180-8b89-41b7bc2a8a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:34.277967 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c3772-787d-4180-8b89-41b7bc2a8a79 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:34.341364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d687c7-eaf5-4694-90d7-4fc3eceeb0d5 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:34.345037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7953c-1b46-4f94-b3ca-1b8fe0e96d41 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e3f8ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:34.345630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7953c-1b46-4f94-b3ca-1b8fe0e96d41 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.345915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7953c-1b46-4f94-b3ca-1b8fe0e96d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.346195 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7953c-1b46-4f94-b3ca-1b8fe0e96d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.355549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7953c-1b46-4f94-b3ca-1b8fe0e96d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:34.357618 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7953c-1b46-4f94-b3ca-1b8fe0e96d41 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:34.365681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 791/1580] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:34 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:34.366891 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f212fd7-a59d-46a3-829a-534f299f12f0 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.367320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f212fd7-a59d-46a3-829a-534f299f12f0 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.367683 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f212fd7-a59d-46a3-829a-534f299f12f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.368076 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 790/1581] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:34.369064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7953c-1b46-4f94-b3ca-1b8fe0e96d41 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:34.379371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7953c-1b46-4f94-b3ca-1b8fe0e96d41 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:34.416399 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-9f212fd7-a59d-46a3-829a-534f299f12f0 None None] MFA Rules not processed for user `bd7926a93dd14540a46805c1981322aa`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:34.417592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9f212fd7-a59d-46a3-829a-534f299f12f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:34.446939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a17a41-44d3-4753-a305-08e1a0051bcc service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e3e7310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:34.447748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17a41-44d3-4753-a305-08e1a0051bcc service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.448137 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17a41-44d3-4753-a305-08e1a0051bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.448522 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17a41-44d3-4753-a305-08e1a0051bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.505960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 792/1582] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:34 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:34.505960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f212fd7-a59d-46a3-829a-534f299f12f0 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:34.525552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f212fd7-a59d-46a3-829a-534f299f12f0 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:34.536591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e546134-f754-441a-9f75-37ee1aca3e5a service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e4f3a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:34.537335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e546134-f754-441a-9f75-37ee1aca3e5a service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.537703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e546134-f754-441a-9f75-37ee1aca3e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.538099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e546134-f754-441a-9f75-37ee1aca3e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.568135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a17a41-44d3-4753-a305-08e1a0051bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:34.569794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a17a41-44d3-4753-a305-08e1a0051bcc service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:34.583263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 791/1583] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:34.591339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a17a41-44d3-4753-a305-08e1a0051bcc service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:34.597733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a17a41-44d3-4753-a305-08e1a0051bcc service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:34.603190 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eec3ec-3a1e-405f-98ed-dd8c0704467a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09defe9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:34.604352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eec3ec-3a1e-405f-98ed-dd8c0704467a admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.604820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eec3ec-3a1e-405f-98ed-dd8c0704467a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.605263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eec3ec-3a1e-405f-98ed-dd8c0704467a admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.607224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eec3ec-3a1e-405f-98ed-dd8c0704467a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:34.610488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eec3ec-3a1e-405f-98ed-dd8c0704467a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:34.652808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e546134-f754-441a-9f75-37ee1aca3e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:34.665546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e546134-f754-441a-9f75-37ee1aca3e5a service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:34.677909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 793/1584] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:34.679366 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb659c78-b0e2-43d0-bf3f-3b91535b06e1 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.679750 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb659c78-b0e2-43d0-bf3f-3b91535b06e1 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.680107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb659c78-b0e2-43d0-bf3f-3b91535b06e1 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.682477 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 794/1585] 10.222.0.21 () {54 vars in 960 bytes} [Mon Feb 28 19:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:01:34.683581 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5540f-4db4-4219-aa69-e16205c56555 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.688791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5540f-4db4-4219-aa69-e16205c56555 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.688791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5540f-4db4-4219-aa69-e16205c56555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.717540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 792/1586] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:34 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:34.723004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b26ff-7879-4f22-99cb-926481fae751 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.723004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b26ff-7879-4f22-99cb-926481fae751 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.723004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b26ff-7879-4f22-99cb-926481fae751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.744882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-522b26ff-7879-4f22-99cb-926481fae751 None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:34.745500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4cf5540f-4db4-4219-aa69-e16205c56555 None None] MFA Rules not processed for user `46e4e775395f4f01b37ae1e6efe87898`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:34.746214 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-522b26ff-7879-4f22-99cb-926481fae751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:34.746847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4cf5540f-4db4-4219-aa69-e16205c56555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:34.839423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 795/1587] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:34 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:34.840441 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5540f-4db4-4219-aa69-e16205c56555 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:34.854641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5540f-4db4-4219-aa69-e16205c56555 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:34.861731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421d319-e29d-46c7-8bf0-7c4f66f8c3e8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09df3bf40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:34.862348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421d319-e29d-46c7-8bf0-7c4f66f8c3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.862638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421d319-e29d-46c7-8bf0-7c4f66f8c3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.862922 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421d319-e29d-46c7-8bf0-7c4f66f8c3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.863664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421d319-e29d-46c7-8bf0-7c4f66f8c3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:34.866086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421d319-e29d-46c7-8bf0-7c4f66f8c3e8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:34.881017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 796/1588] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:34.881017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000239c7-9747-4854-824c-969faf4696a1 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.881017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000239c7-9747-4854-824c-969faf4696a1 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.881017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000239c7-9747-4854-824c-969faf4696a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:34.906854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-000239c7-9747-4854-824c-969faf4696a1 None None] MFA Rules not processed for user `46e4e775395f4f01b37ae1e6efe87898`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:34.908369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-000239c7-9747-4854-824c-969faf4696a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:34.913777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 793/1589] 10.222.0.21 () {58 vars in 1057 bytes} [Mon Feb 28 19:01:34 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:34.921729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b26ff-7879-4f22-99cb-926481fae751 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:34.933940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 797/1590] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:34 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:34.949674 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000239c7-9747-4854-824c-969faf4696a1 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:34.960708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b26ff-7879-4f22-99cb-926481fae751 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:34.984280 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000239c7-9747-4854-824c-969faf4696a1 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:34.985542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e72bf-482e-4fa2-a35b-108f7f2f6c0f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09eb9f8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:34.988946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e72bf-482e-4fa2-a35b-108f7f2f6c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:34.989359 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e72bf-482e-4fa2-a35b-108f7f2f6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:34.990994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e72bf-482e-4fa2-a35b-108f7f2f6c0f admin admin] PATH_INFO: `/v3/projects/520c09252e4849f1bda2f6674464f115/users/ebcaa80678c7491cb0e6055c41ed5708/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.000758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb9faf-ab76-4f9a-a683-aa6a68c8e505 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=VPv8sXhDS8CbQz_czxciPg, audit_chain_id=['VPv8sXhDS8CbQz_czxciPg']) at 0x7fe09de56730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:35.001416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb9faf-ab76-4f9a-a683-aa6a68c8e505 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:35.001713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb9faf-ab76-4f9a-a683-aa6a68c8e505 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:35.002001 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb9faf-ab76-4f9a-a683-aa6a68c8e505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.025685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb9faf-ab76-4f9a-a683-aa6a68c8e505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:35.027461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb9faf-ab76-4f9a-a683-aa6a68c8e505 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:35.044743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e72bf-482e-4fa2-a35b-108f7f2f6c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=520c09252e4849f1bda2f6674464f115, user_id=ebcaa80678c7491cb0e6055c41ed5708, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:35.052990 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e72bf-482e-4fa2-a35b-108f7f2f6c0f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:35.055221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 798/1591] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:34 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:35.059687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d93e-c19a-436e-a491-2973883d2f5d None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:35.060593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d93e-c19a-436e-a491-2973883d2f5d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:35.060892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d93e-c19a-436e-a491-2973883d2f5d None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.071010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 799/1592] 10.222.0.21 () {54 vars in 960 bytes} [Mon Feb 28 19:01:35 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:01:35.072347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b9ccf-074c-4ae8-8c18-5472ff4632b8 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:35.072647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b9ccf-074c-4ae8-8c18-5472ff4632b8 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:35.072936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b9ccf-074c-4ae8-8c18-5472ff4632b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.112940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-857b9ccf-074c-4ae8-8c18-5472ff4632b8 None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:35.114138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-857b9ccf-074c-4ae8-8c18-5472ff4632b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:35.125958 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 800/1593] 10.222.0.21 () {58 vars in 1057 bytes} [Mon Feb 28 19:01:35 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:35.135245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b9ccf-074c-4ae8-8c18-5472ff4632b8 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:35.148302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b9ccf-074c-4ae8-8c18-5472ff4632b8 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:35.160683 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71cabe-08c4-4b93-9eb5-0af7afa56f73 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=wTjUJdAdSkmocIsusTZBDA, audit_chain_id=['wTjUJdAdSkmocIsusTZBDA']) at 0x7fe09e5408e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:35.161334 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cabe-08c4-4b93-9eb5-0af7afa56f73 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:35.161629 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cabe-08c4-4b93-9eb5-0af7afa56f73 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:35.161916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cabe-08c4-4b93-9eb5-0af7afa56f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.176007 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71cabe-08c4-4b93-9eb5-0af7afa56f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:35.179454 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71cabe-08c4-4b93-9eb5-0af7afa56f73 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:35.203395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 801/1594] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:35 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:35.207958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 794/1595] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:34 2022] PUT /identity/v3/projects/520c09252e4849f1bda2f6674464f115/users/ebcaa80678c7491cb0e6055c41ed5708/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:35.209186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71cabe-08c4-4b93-9eb5-0af7afa56f73 service nova] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:35.228220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71cabe-08c4-4b93-9eb5-0af7afa56f73 service nova] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:35.374099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c597b3-4143-4f2c-9e07-68a840f6bdf6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09de5e6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:35.375165 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c597b3-4143-4f2c-9e07-68a840f6bdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:35.375628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c597b3-4143-4f2c-9e07-68a840f6bdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:35.376505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c597b3-4143-4f2c-9e07-68a840f6bdf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.377492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c597b3-4143-4f2c-9e07-68a840f6bdf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:35.379407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c597b3-4143-4f2c-9e07-68a840f6bdf6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:35.418372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 802/1596] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:01:35.422772 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e72bf-482e-4fa2-a35b-108f7f2f6c0f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:35.442952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e72bf-482e-4fa2-a35b-108f7f2f6c0f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:35.469203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e3016-508e-466c-a4ae-c9f1631bf32e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09e887070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:35.471466 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e3016-508e-466c-a4ae-c9f1631bf32e admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:35.471868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e3016-508e-466c-a4ae-c9f1631bf32e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:35.474572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e3016-508e-466c-a4ae-c9f1631bf32e admin admin] PATH_INFO: `/v3/projects/520c09252e4849f1bda2f6674464f115/users/ebcaa80678c7491cb0e6055c41ed5708/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.483362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e3016-508e-466c-a4ae-c9f1631bf32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=520c09252e4849f1bda2f6674464f115, user_id=ebcaa80678c7491cb0e6055c41ed5708, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:35.489853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e3016-508e-466c-a4ae-c9f1631bf32e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:35.544098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 795/1597] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:35 2022] PUT /identity/v3/projects/520c09252e4849f1bda2f6674464f115/users/ebcaa80678c7491cb0e6055c41ed5708/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:01:35.555182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811e99-d80e-444e-94b0-c112e9a1f1db None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:35.556018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811e99-d80e-444e-94b0-c112e9a1f1db None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:35.556495 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811e99-d80e-444e-94b0-c112e9a1f1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.695373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-47811e99-d80e-444e-94b0-c112e9a1f1db None None] MFA Rules not processed for user `ebcaa80678c7491cb0e6055c41ed5708`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:35.696793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-47811e99-d80e-444e-94b0-c112e9a1f1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:35.814103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 803/1598] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:35 2022] POST /identity/v3/auth/tokens => generated 3745 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:35.827370 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e3016-508e-466c-a4ae-c9f1631bf32e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:35.908332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddadd9a-2ad0-4710-9935-d7625790915e None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:35.908687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddadd9a-2ad0-4710-9935-d7625790915e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:35.908976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddadd9a-2ad0-4710-9935-d7625790915e None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.917508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 804/1599] 10.222.0.21 () {54 vars in 912 bytes} [Mon Feb 28 19:01:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:01:35.928606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48881cb-5174-4e22-a891-5b5d5e999b4d None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:35.933452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48881cb-5174-4e22-a891-5b5d5e999b4d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:35.933452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48881cb-5174-4e22-a891-5b5d5e999b4d None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.940075 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 805/1600] 10.222.0.21 () {54 vars in 912 bytes} [Mon Feb 28 19:01:35 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:01:35.942889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c0597-d09a-42ed-9ba3-697d89079d61 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:35.944308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c0597-d09a-42ed-9ba3-697d89079d61 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:35.945316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c0597-d09a-42ed-9ba3-697d89079d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.976523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e3016-508e-466c-a4ae-c9f1631bf32e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:35.985722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b0e4f-f400-4736-99ac-96502c9d5848 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09debce80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:35.990407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b0e4f-f400-4736-99ac-96502c9d5848 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:35.990407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b0e4f-f400-4736-99ac-96502c9d5848 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:35.990407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b0e4f-f400-4736-99ac-96502c9d5848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:35.990723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-2a2c0597-d09a-42ed-9ba3-697d89079d61 None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:35.990723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2a2c0597-d09a-42ed-9ba3-697d89079d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:36.009207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b0e4f-f400-4736-99ac-96502c9d5848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:36.010630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b0e4f-f400-4736-99ac-96502c9d5848 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:36.029266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 796/1601] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:35 2022] GET /identity/v3/auth/tokens => generated 3745 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:36.031383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa941-23ea-47eb-8088-d49f9abd8a03 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:36.031891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa941-23ea-47eb-8088-d49f9abd8a03 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:36.032326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa941-23ea-47eb-8088-d49f9abd8a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:36.089967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-86bfa941-23ea-47eb-8088-d49f9abd8a03 None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:36.092982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-86bfa941-23ea-47eb-8088-d49f9abd8a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:36.127852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 806/1602] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:01:35 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:36.143447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c0597-d09a-42ed-9ba3-697d89079d61 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:36.145863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2a2c0597-d09a-42ed-9ba3-697d89079d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:36.205943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 797/1603] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:01:36 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:36.218619 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfa941-23ea-47eb-8088-d49f9abd8a03 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:36.231149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfa941-23ea-47eb-8088-d49f9abd8a03 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:36.240283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca500ce-64f8-4df4-96e5-6f7763451083 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09df0b1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:36.241241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca500ce-64f8-4df4-96e5-6f7763451083 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:36.241727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca500ce-64f8-4df4-96e5-6f7763451083 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:36.242629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca500ce-64f8-4df4-96e5-6f7763451083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:36.259627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca500ce-64f8-4df4-96e5-6f7763451083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:36.262166 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca500ce-64f8-4df4-96e5-6f7763451083 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:36.277585 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c0597-d09a-42ed-9ba3-697d89079d61 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:36.280108 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309279b7-0677-4319-808b-28529e418e4f service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=IAdTf7zmRlS7ZAE69VgzOQ, audit_chain_id=['IAdTf7zmRlS7ZAE69VgzOQ']) at 0x7fe09de500a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e956656659004428b3aaf23ae962f001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:36.280911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309279b7-0677-4319-808b-28529e418e4f service glance] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:36.281438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309279b7-0677-4319-808b-28529e418e4f service glance] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:36.281775 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 798/1604] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:36 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:36.281978 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309279b7-0677-4319-808b-28529e418e4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:36.294524 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309279b7-0677-4319-808b-28529e418e4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:36.296587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309279b7-0677-4319-808b-28529e418e4f service glance] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:36.311162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 807/1605] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:36 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:01:37.138449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedf8fc-94cb-4aff-8da4-873620ef8053 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:37.139487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedf8fc-94cb-4aff-8da4-873620ef8053 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:37.139900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedf8fc-94cb-4aff-8da4-873620ef8053 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:37.142075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 799/1606] 10.222.0.21 () {54 vars in 912 bytes} [Mon Feb 28 19:01:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:01:37.148267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af565b6-8914-4cd2-b36c-8a7f92a5ecdd None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:37.148781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af565b6-8914-4cd2-b36c-8a7f92a5ecdd None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:37.148889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af565b6-8914-4cd2-b36c-8a7f92a5ecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:37.214805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3af565b6-8914-4cd2-b36c-8a7f92a5ecdd None None] MFA Rules not processed for user `65a9c92fb5144e3dacc922eede1131fd`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:37.216356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3af565b6-8914-4cd2-b36c-8a7f92a5ecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:37.316273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 808/1607] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:01:37 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:37.331846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedf8fc-94cb-4aff-8da4-873620ef8053 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:37.347198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedf8fc-94cb-4aff-8da4-873620ef8053 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:37.359428 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100e56b-2d4d-4330-9bea-bf4ccf4e08eb service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09debc940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:37.360844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100e56b-2d4d-4330-9bea-bf4ccf4e08eb service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:37.361298 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100e56b-2d4d-4330-9bea-bf4ccf4e08eb service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:37.361729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100e56b-2d4d-4330-9bea-bf4ccf4e08eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:37.383967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100e56b-2d4d-4330-9bea-bf4ccf4e08eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:37.385627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100e56b-2d4d-4330-9bea-bf4ccf4e08eb service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:37.405662 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 800/1608] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:37 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:37.445269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af565b6-8914-4cd2-b36c-8a7f92a5ecdd None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:37.603042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af565b6-8914-4cd2-b36c-8a7f92a5ecdd None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:37.609184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09de8ae20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:37.610129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:37.610430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:37.611389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] PATH_INFO: `/v3/users/1137606a463c4aa889859fb8c9915340` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:37.615138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1137606a463c4aa889859fb8c9915340)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:37.617349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: WARNING py.warnings [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:01:37.617349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: warnings.warn(msg) Feb 28 19:01:37.617349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: Feb 28 19:01:37.620949 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:37.929220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1137606a463c4aa889859fb8c9915340'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:37.956510 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1137606a463c4aa889859fb8c9915340'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:37.960847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1137606a463c4aa889859fb8c9915340'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:37.961495 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1137606a463c4aa889859fb8c9915340'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:38.001204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29516344-1089-4ded-bee1-ddae53077fdf None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:38.001392 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29516344-1089-4ded-bee1-ddae53077fdf None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:38.001657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29516344-1089-4ded-bee1-ddae53077fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:38.065348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-2ca44cff-73f7-4e94-b567-fe742c344908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1137606a463c4aa889859fb8c9915340'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:38.082209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-29516344-1089-4ded-bee1-ddae53077fdf None None] MFA Rules not processed for user `46e767d2e3624a3fa799c8c1b20b0516`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:38.083553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-29516344-1089-4ded-bee1-ddae53077fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:38.086696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 809/1609] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:01:37 2022] DELETE /identity/v3/users/1137606a463c4aa889859fb8c9915340 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:38.091984 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01c2ea-17e1-4b1c-b536-fa40a4b8a17f None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:38.092376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01c2ea-17e1-4b1c-b536-fa40a4b8a17f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:38.092654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01c2ea-17e1-4b1c-b536-fa40a4b8a17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:38.139400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-aa01c2ea-17e1-4b1c-b536-fa40a4b8a17f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:38.140612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-aa01c2ea-17e1-4b1c-b536-fa40a4b8a17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:38.171652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 801/1610] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:37 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:38.182962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615faf3-73a8-4609-b6ea-53ee206cf77b None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:38.183291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615faf3-73a8-4609-b6ea-53ee206cf77b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:38.183576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615faf3-73a8-4609-b6ea-53ee206cf77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:38.217675 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-0615faf3-73a8-4609-b6ea-53ee206cf77b None None] MFA Rules not processed for user `46e767d2e3624a3fa799c8c1b20b0516`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:38.219473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-0615faf3-73a8-4609-b6ea-53ee206cf77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:38.289949 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 810/1611] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:38.314026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01c2ea-17e1-4b1c-b536-fa40a4b8a17f None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:38.315644 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-aa01c2ea-17e1-4b1c-b536-fa40a4b8a17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:38.321224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 802/1612] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:38 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:38.334549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615faf3-73a8-4609-b6ea-53ee206cf77b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:38.336641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-0615faf3-73a8-4609-b6ea-53ee206cf77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:38.453126 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01c2ea-17e1-4b1c-b536-fa40a4b8a17f None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:38.459593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43609ba3-d38b-44b8-bf9a-25fb54d37620 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09eba9a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:38.461415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609ba3-d38b-44b8-bf9a-25fb54d37620 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:38.461999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609ba3-d38b-44b8-bf9a-25fb54d37620 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:38.463288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43609ba3-d38b-44b8-bf9a-25fb54d37620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:38.474234 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43609ba3-d38b-44b8-bf9a-25fb54d37620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:38.476128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43609ba3-d38b-44b8-bf9a-25fb54d37620 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:38.508065 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 811/1613] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:01:38.510396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615faf3-73a8-4609-b6ea-53ee206cf77b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:38.517771 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536393e-ed71-44ee-b8fe-d5f72756ab93 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=VPv8sXhDS8CbQz_czxciPg, audit_chain_id=['VPv8sXhDS8CbQz_czxciPg']) at 0x7fe09df3d490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:38.520766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536393e-ed71-44ee-b8fe-d5f72756ab93 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:38.520766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536393e-ed71-44ee-b8fe-d5f72756ab93 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:38.520766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536393e-ed71-44ee-b8fe-d5f72756ab93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:38.529200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536393e-ed71-44ee-b8fe-d5f72756ab93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:38.530816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536393e-ed71-44ee-b8fe-d5f72756ab93 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:38.541010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 803/1614] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:38 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:38.774987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7e3c-26df-4eea-a034-df80664fe21a None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:38.774987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7e3c-26df-4eea-a034-df80664fe21a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:38.774987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7e3c-26df-4eea-a034-df80664fe21a None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:38.777021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 812/1615] 10.222.0.21 () {54 vars in 960 bytes} [Mon Feb 28 19:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:01:38.784566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317992e9-64c0-4e50-812d-f73e914fc4c9 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:38.784911 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317992e9-64c0-4e50-812d-f73e914fc4c9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:38.785205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317992e9-64c0-4e50-812d-f73e914fc4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:38.819050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-317992e9-64c0-4e50-812d-f73e914fc4c9 None None] MFA Rules not processed for user `2f330acd453f445ea31acf9fc43b53ad`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:38.822308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-317992e9-64c0-4e50-812d-f73e914fc4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:38.931945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 804/1616] 10.222.0.21 () {58 vars in 1057 bytes} [Mon Feb 28 19:01:38 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:38.943052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c7e3c-26df-4eea-a034-df80664fe21a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:38.977907 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c7e3c-26df-4eea-a034-df80664fe21a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:38.994385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fe06e-b9ff-4651-93d6-e7bf7a27ec12 service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=PTVXDCHNQWCQjy3BZQYY3Q, audit_chain_id=['PTVXDCHNQWCQjy3BZQYY3Q']) at 0x7fe09e705be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f330acd453f445ea31acf9fc43b53ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:38.994994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fe06e-b9ff-4651-93d6-e7bf7a27ec12 service placement] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:38.995312 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fe06e-b9ff-4651-93d6-e7bf7a27ec12 service placement] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:38.995599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fe06e-b9ff-4651-93d6-e7bf7a27ec12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:39.000595 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4b9fe06e-b9ff-4651-93d6-e7bf7a27ec12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:39.024190 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fe06e-b9ff-4651-93d6-e7bf7a27ec12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:39.026545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fe06e-b9ff-4651-93d6-e7bf7a27ec12 service placement] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:39.062960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 813/1617] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:38 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:39.414439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317992e9-64c0-4e50-812d-f73e914fc4c9 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:39.416061 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-317992e9-64c0-4e50-812d-f73e914fc4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:39.438697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317992e9-64c0-4e50-812d-f73e914fc4c9 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:39.458748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a014bbc-2e95-412c-b5d8-9dcbb406639b service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=RLyH0N9xSwiZDKvJxMSolg, audit_chain_id=['RLyH0N9xSwiZDKvJxMSolg']) at 0x7fe09e8a0670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f330acd453f445ea31acf9fc43b53ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:39.458748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a014bbc-2e95-412c-b5d8-9dcbb406639b service placement] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:39.458748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a014bbc-2e95-412c-b5d8-9dcbb406639b service placement] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:39.458748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a014bbc-2e95-412c-b5d8-9dcbb406639b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:39.459072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9a014bbc-2e95-412c-b5d8-9dcbb406639b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:39.475518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a014bbc-2e95-412c-b5d8-9dcbb406639b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:39.477586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a014bbc-2e95-412c-b5d8-9dcbb406639b service placement] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:39.492572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 805/1618] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:39 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:40.084999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b98e9-ad49-490d-b5e0-04c49f8245bb None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:40.085536 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b98e9-ad49-490d-b5e0-04c49f8245bb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:40.085637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b98e9-ad49-490d-b5e0-04c49f8245bb None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:40.087741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 814/1619] 10.222.0.21 () {54 vars in 912 bytes} [Mon Feb 28 19:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:01:40.094307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ba8e-7e49-47eb-88b6-4e2affde7996 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:40.096559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ba8e-7e49-47eb-88b6-4e2affde7996 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:40.096559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ba8e-7e49-47eb-88b6-4e2affde7996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:40.130196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-aea8ba8e-7e49-47eb-88b6-4e2affde7996 None None] MFA Rules not processed for user `65a9c92fb5144e3dacc922eede1131fd`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:40.131997 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-aea8ba8e-7e49-47eb-88b6-4e2affde7996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:40.142064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 806/1620] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:01:40 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:40.235864 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b98e9-ad49-490d-b5e0-04c49f8245bb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:40.250797 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b98e9-ad49-490d-b5e0-04c49f8245bb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:40.264608 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405fbde-33c6-4f2f-aa7a-2a091244a5f2 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09de0eeb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:40.265465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405fbde-33c6-4f2f-aa7a-2a091244a5f2 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:40.265944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405fbde-33c6-4f2f-aa7a-2a091244a5f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:40.266369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405fbde-33c6-4f2f-aa7a-2a091244a5f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:40.278795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405fbde-33c6-4f2f-aa7a-2a091244a5f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:40.282610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405fbde-33c6-4f2f-aa7a-2a091244a5f2 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:40.304190 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 815/1621] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:40 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:40.660170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ba8e-7e49-47eb-88b6-4e2affde7996 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:40.662454 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-aea8ba8e-7e49-47eb-88b6-4e2affde7996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:40.682098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ba8e-7e49-47eb-88b6-4e2affde7996 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:40.712553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09dec9fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:40.713798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:40.714245 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:40.714675 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] PATH_INFO: `/v3/projects/ffda43370858402fa901bfd286c88ee4` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:40.719071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffda43370858402fa901bfd286c88ee4)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:40.720326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: WARNING py.warnings [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:01:40.720326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: warnings.warn(msg) Feb 28 19:01:40.720326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: Feb 28 19:01:40.726862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:40.938348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405fbde-33c6-4f2f-aa7a-2a091244a5f2 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:40.942782 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2405fbde-33c6-4f2f-aa7a-2a091244a5f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:40.969309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405fbde-33c6-4f2f-aa7a-2a091244a5f2 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:40.986810 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffda43370858402fa901bfd286c88ee4', 'request_id': 'req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.018695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffda43370858402fa901bfd286c88ee4', 'request_id': 'req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.098745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d926e0-f3f2-447c-ae2a-41a23d5a7b1f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nkr7LLNVT8SZgjM1WEnvvg, audit_chain_id=['nkr7LLNVT8SZgjM1WEnvvg']) at 0x7fe09de2fd30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:41.100787 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d926e0-f3f2-447c-ae2a-41a23d5a7b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:41.101347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d926e0-f3f2-447c-ae2a-41a23d5a7b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:41.103208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d926e0-f3f2-447c-ae2a-41a23d5a7b1f admin admin] PATH_INFO: `/v3/users/bd7926a93dd14540a46805c1981322aa` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:41.105403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffda43370858402fa901bfd286c88ee4', 'request_id': 'req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.105565 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d926e0-f3f2-447c-ae2a-41a23d5a7b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7926a93dd14540a46805c1981322aa)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:41.108533 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d926e0-f3f2-447c-ae2a-41a23d5a7b1f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:41.123594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] The token cache is being invalidate because project ffda43370858402fa901bfd286c88ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:01:41.123882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.125583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.127714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 807/1622] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:01:40 2022] DELETE /identity/v3/projects/ffda43370858402fa901bfd286c88ee4 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:41.131695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:41.133074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:41.164729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5847f7-d694-4bad-a0c0-9fb68e9adc8a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:41.178275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09e1b8b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:41.179099 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:41.186932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:41.186932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] PATH_INFO: `/v3/users/ebcaa80678c7491cb0e6055c41ed5708` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:41.186932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebcaa80678c7491cb0e6055c41ed5708)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:41.186932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:41.352197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f8d926e0-f3f2-447c-ae2a-41a23d5a7b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7926a93dd14540a46805c1981322aa'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.386533 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f8d926e0-f3f2-447c-ae2a-41a23d5a7b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7926a93dd14540a46805c1981322aa'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.388019 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f8d926e0-f3f2-447c-ae2a-41a23d5a7b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7926a93dd14540a46805c1981322aa'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.389865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f8d926e0-f3f2-447c-ae2a-41a23d5a7b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7926a93dd14540a46805c1981322aa'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.483394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f8d926e0-f3f2-447c-ae2a-41a23d5a7b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7926a93dd14540a46805c1981322aa'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.491403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebcaa80678c7491cb0e6055c41ed5708'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.511414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 816/1623] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:01:40 2022] DELETE /identity/v3/users/bd7926a93dd14540a46805c1981322aa => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:41.522110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eceef4-9a31-4244-a0bb-75033c7f646d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:41.522857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eceef4-9a31-4244-a0bb-75033c7f646d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:41.523421 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eceef4-9a31-4244-a0bb-75033c7f646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:41.578583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-22eceef4-9a31-4244-a0bb-75033c7f646d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:41.580290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebcaa80678c7491cb0e6055c41ed5708'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.582233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-22eceef4-9a31-4244-a0bb-75033c7f646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:41.598995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebcaa80678c7491cb0e6055c41ed5708'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.601066 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebcaa80678c7491cb0e6055c41ed5708'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.603866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebcaa80678c7491cb0e6055c41ed5708'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:41.651487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 808/1624] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:01:41 2022] DELETE /identity/v3/users/ebcaa80678c7491cb0e6055c41ed5708 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:01:41.734999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 817/1625] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:41.816164 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:41.819270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:41.978798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c1744-9958-4b0b-b934-a9bd0861e9c0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:41.986240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bab5b-e454-422c-bcf4-b0510a483fbf service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e8fa340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:41.986849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bab5b-e454-422c-bcf4-b0510a483fbf service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:41.987153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bab5b-e454-422c-bcf4-b0510a483fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:41.987444 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bab5b-e454-422c-bcf4-b0510a483fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:42.150308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0bab5b-e454-422c-bcf4-b0510a483fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:42.180288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0bab5b-e454-422c-bcf4-b0510a483fbf service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:42.206552 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 809/1626] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:41 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:44.036004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f84e67-2562-4942-9a7f-975a792310a7 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:44.036004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f84e67-2562-4942-9a7f-975a792310a7 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:44.036004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f84e67-2562-4942-9a7f-975a792310a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:44.036004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f7f84e67-2562-4942-9a7f-975a792310a7 None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:44.036004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f7f84e67-2562-4942-9a7f-975a792310a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:44.092409 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 818/1627] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:01:43 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:44.603896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bab5b-e454-422c-bcf4-b0510a483fbf service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:44.606523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4b0bab5b-e454-422c-bcf4-b0510a483fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:44.807398 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bab5b-e454-422c-bcf4-b0510a483fbf service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:44.816967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503caca1-ce05-41a3-b112-324e614a9ed2 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e411670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:44.817584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503caca1-ce05-41a3-b112-324e614a9ed2 service swift] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:44.817704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f84e67-2562-4942-9a7f-975a792310a7 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:44.817871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503caca1-ce05-41a3-b112-324e614a9ed2 service swift] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:44.818313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503caca1-ce05-41a3-b112-324e614a9ed2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:44.819075 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f7f84e67-2562-4942-9a7f-975a792310a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:44.842858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503caca1-ce05-41a3-b112-324e614a9ed2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:44.845944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503caca1-ce05-41a3-b112-324e614a9ed2 service swift] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:44.857826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f84e67-2562-4942-9a7f-975a792310a7 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:44.863323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nkr7LLNVT8SZgjM1WEnvvg, audit_chain_id=['nkr7LLNVT8SZgjM1WEnvvg']) at 0x7fe09e5408e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:44.864323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:44.864624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:44.864910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] PATH_INFO: `/v3/projects/58471ac4dd184d36938ad9148255f8c0` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:44.866043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58471ac4dd184d36938ad9148255f8c0)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:44.870605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:44.890345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 810/1628] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:01:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 19:01:44.953143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503caca1-ce05-41a3-b112-324e614a9ed2 service swift] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:44.955871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-503caca1-ce05-41a3-b112-324e614a9ed2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:45.005406 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503caca1-ce05-41a3-b112-324e614a9ed2 service swift] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:45.018697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wlIVVX6kQ7S7B6ynuTmgHA, audit_chain_id=['wlIVVX6kQ7S7B6ynuTmgHA']) at 0x7fe09e9a0220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:45.019545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:45.023760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:45.024258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] PATH_INFO: `/v3/projects/520c09252e4849f1bda2f6674464f115` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:45.032975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=520c09252e4849f1bda2f6674464f115)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:45.034921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:45.126454 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58471ac4dd184d36938ad9148255f8c0', 'request_id': 'req-af6e81df-6a25-469e-b3cf-6a13212a7905'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:45.219469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58471ac4dd184d36938ad9148255f8c0', 'request_id': 'req-af6e81df-6a25-469e-b3cf-6a13212a7905'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:45.235222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58471ac4dd184d36938ad9148255f8c0', 'request_id': 'req-af6e81df-6a25-469e-b3cf-6a13212a7905'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:45.283986 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] The token cache is being invalidate because project 58471ac4dd184d36938ad9148255f8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:01:45.284579 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:45.288818 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-af6e81df-6a25-469e-b3cf-6a13212a7905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:45.295917 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 819/1629] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:01:44 2022] DELETE /identity/v3/projects/58471ac4dd184d36938ad9148255f8c0 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:45.303599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7010-b044-428e-b655-a6022b03b689 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:45.305287 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7010-b044-428e-b655-a6022b03b689 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:45.307014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7010-b044-428e-b655-a6022b03b689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:45.324206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520c09252e4849f1bda2f6674464f115', 'request_id': 'req-0ca8814a-7ea8-43d4-adad-c963d6525fba'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:45.358093 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520c09252e4849f1bda2f6674464f115', 'request_id': 'req-0ca8814a-7ea8-43d4-adad-c963d6525fba'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:45.404942 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-99da7010-b044-428e-b655-a6022b03b689 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:45.412134 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-99da7010-b044-428e-b655-a6022b03b689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:45.476634 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520c09252e4849f1bda2f6674464f115', 'request_id': 'req-0ca8814a-7ea8-43d4-adad-c963d6525fba'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:45.508264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] The token cache is being invalidate because project 520c09252e4849f1bda2f6674464f115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:01:45.508264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:45.513188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0ca8814a-7ea8-43d4-adad-c963d6525fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:45.518478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 811/1630] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:01:44 2022] DELETE /identity/v3/projects/520c09252e4849f1bda2f6674464f115 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:01:45.520866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36f04-b873-4851-90be-ffbb51c9db5a None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:45.521120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36f04-b873-4851-90be-ffbb51c9db5a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:45.521474 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36f04-b873-4851-90be-ffbb51c9db5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:45.607864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-cdf36f04-b873-4851-90be-ffbb51c9db5a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:45.609082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-cdf36f04-b873-4851-90be-ffbb51c9db5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:45.702290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 820/1631] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:45.706608 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e48cfa-6773-48f8-aa92-6bd57bfc021e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:45.707233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e48cfa-6773-48f8-aa92-6bd57bfc021e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:45.707531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e48cfa-6773-48f8-aa92-6bd57bfc021e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:45.819863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f9e48cfa-6773-48f8-aa92-6bd57bfc021e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:45.821063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f9e48cfa-6773-48f8-aa92-6bd57bfc021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:45.846618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 821/1632] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:45.847505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e48cfa-6773-48f8-aa92-6bd57bfc021e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:45.870106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e48cfa-6773-48f8-aa92-6bd57bfc021e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:45.883343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555f241-0ad2-400b-8809-2798868c933a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09e155d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:45.883967 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f241-0ad2-400b-8809-2798868c933a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:45.884261 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f241-0ad2-400b-8809-2798868c933a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:45.884770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f241-0ad2-400b-8809-2798868c933a admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:45.885841 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555f241-0ad2-400b-8809-2798868c933a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:01:45.886418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555f241-0ad2-400b-8809-2798868c933a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:45.888938 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555f241-0ad2-400b-8809-2798868c933a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:45.890498 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 812/1633] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:45.906260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a6487-34bf-40dd-8110-914a7dcd798a None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:45.908073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a6487-34bf-40dd-8110-914a7dcd798a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:45.908588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a6487-34bf-40dd-8110-914a7dcd798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:45.924406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 822/1634] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:01:45.926994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555f241-0ad2-400b-8809-2798868c933a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:45.948395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555f241-0ad2-400b-8809-2798868c933a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:45.981768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22be80-01b3-454a-896a-8d9fd0cda7f2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09e105e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:45.984655 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22be80-01b3-454a-896a-8d9fd0cda7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:45.985400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22be80-01b3-454a-896a-8d9fd0cda7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:45.985873 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22be80-01b3-454a-896a-8d9fd0cda7f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:45.989593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22be80-01b3-454a-896a-8d9fd0cda7f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:45.989593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22be80-01b3-454a-896a-8d9fd0cda7f2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:46.013314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b83a6487-34bf-40dd-8110-914a7dcd798a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:46.015735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b83a6487-34bf-40dd-8110-914a7dcd798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:46.049353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 813/1635] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:46.061464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a6487-34bf-40dd-8110-914a7dcd798a None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:46.118339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a6487-34bf-40dd-8110-914a7dcd798a None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:46.142295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8ed87-1dbe-4a36-bd09-8ebc83adcfdd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e1dfbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:46.142913 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ed87-1dbe-4a36-bd09-8ebc83adcfdd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:46.143232 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ed87-1dbe-4a36-bd09-8ebc83adcfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:46.144665 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ed87-1dbe-4a36-bd09-8ebc83adcfdd admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:46.145723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8ed87-1dbe-4a36-bd09-8ebc83adcfdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:01:46.146170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8ed87-1dbe-4a36-bd09-8ebc83adcfdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:46.148234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8ed87-1dbe-4a36-bd09-8ebc83adcfdd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:46.179585 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 823/1636] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:45 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:46.188733 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22be80-01b3-454a-896a-8d9fd0cda7f2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:46.224695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 814/1637] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:01:46.225992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8ed87-1dbe-4a36-bd09-8ebc83adcfdd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:46.266681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8ed87-1dbe-4a36-bd09-8ebc83adcfdd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:46.451849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683546-7a25-4b54-87de-6cd2bcf1f281 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09defee80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:46.452855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683546-7a25-4b54-87de-6cd2bcf1f281 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:46.453342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683546-7a25-4b54-87de-6cd2bcf1f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:46.453817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683546-7a25-4b54-87de-6cd2bcf1f281 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:46.454665 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d683546-7a25-4b54-87de-6cd2bcf1f281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:46.456897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d683546-7a25-4b54-87de-6cd2bcf1f281 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:46.611606 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 815/1638] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:46 2022] POST /identity/v3/projects => generated 367 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:46.615698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683546-7a25-4b54-87de-6cd2bcf1f281 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:46.657142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22be80-01b3-454a-896a-8d9fd0cda7f2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:46.776570 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683546-7a25-4b54-87de-6cd2bcf1f281 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:46.794801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b821d-666d-4af0-be68-a9e7166f2d5f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e8faa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:46.796270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b821d-666d-4af0-be68-a9e7166f2d5f admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:46.796741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b821d-666d-4af0-be68-a9e7166f2d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:46.797162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b821d-666d-4af0-be68-a9e7166f2d5f admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:46.798634 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b821d-666d-4af0-be68-a9e7166f2d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:46.809941 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9be02-02d8-4f62-93ac-d5e12ad38337 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09e21e250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:46.810585 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9be02-02d8-4f62-93ac-d5e12ad38337 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:46.810914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b821d-666d-4af0-be68-a9e7166f2d5f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:46.811137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9be02-02d8-4f62-93ac-d5e12ad38337 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:46.813067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9be02-02d8-4f62-93ac-d5e12ad38337 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:46.813805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9be02-02d8-4f62-93ac-d5e12ad38337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:46.818898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9be02-02d8-4f62-93ac-d5e12ad38337 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:46.964120 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 824/1639] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:46 2022] POST /identity/v3/users => generated 289 bytes in 770 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:46.964332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 816/1640] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:46 2022] POST /identity/v3/users => generated 284 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:46.964423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9be02-02d8-4f62-93ac-d5e12ad38337 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:46.965912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b821d-666d-4af0-be68-a9e7166f2d5f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:47.017018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9be02-02d8-4f62-93ac-d5e12ad38337 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:47.020211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b821d-666d-4af0-be68-a9e7166f2d5f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:47.041510 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e02a7e-05e9-4ad0-94df-7770d1cee4b1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09ddd5520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:47.043003 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e02a7e-05e9-4ad0-94df-7770d1cee4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:47.043421 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e02a7e-05e9-4ad0-94df-7770d1cee4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:47.043715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e02a7e-05e9-4ad0-94df-7770d1cee4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:47.044603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e02a7e-05e9-4ad0-94df-7770d1cee4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:47.046900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc46b8a-16a9-44e2-bcdd-e1b5e4be99bc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e1dfbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:47.047550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc46b8a-16a9-44e2-bcdd-e1b5e4be99bc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:47.048097 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc46b8a-16a9-44e2-bcdd-e1b5e4be99bc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:47.048385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc46b8a-16a9-44e2-bcdd-e1b5e4be99bc admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:47.057682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e02a7e-05e9-4ad0-94df-7770d1cee4b1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:47.061499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc46b8a-16a9-44e2-bcdd-e1b5e4be99bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:47.062153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc46b8a-16a9-44e2-bcdd-e1b5e4be99bc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:47.087802 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 825/1641] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:47.089507 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e02a7e-05e9-4ad0-94df-7770d1cee4b1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:47.107269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 817/1642] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:47.107450 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e02a7e-05e9-4ad0-94df-7770d1cee4b1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:47.108275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc46b8a-16a9-44e2-bcdd-e1b5e4be99bc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:47.133250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294543a-5faa-468c-9e19-b76f687ae0ec admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09de0fb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:47.133909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294543a-5faa-468c-9e19-b76f687ae0ec admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:47.134184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294543a-5faa-468c-9e19-b76f687ae0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:47.134460 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294543a-5faa-468c-9e19-b76f687ae0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:47.138129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294543a-5faa-468c-9e19-b76f687ae0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:47.139830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294543a-5faa-468c-9e19-b76f687ae0ec admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:47.145445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc46b8a-16a9-44e2-bcdd-e1b5e4be99bc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:47.159812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea147f7-3c1b-437b-b835-0d41c44711fd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09de48b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:47.160534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea147f7-3c1b-437b-b835-0d41c44711fd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:47.160817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea147f7-3c1b-437b-b835-0d41c44711fd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:47.161072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea147f7-3c1b-437b-b835-0d41c44711fd admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:47.161845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea147f7-3c1b-437b-b835-0d41c44711fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:47.176918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea147f7-3c1b-437b-b835-0d41c44711fd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:47.183959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 826/1643] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:01:47.187882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294543a-5faa-468c-9e19-b76f687ae0ec admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:47.212184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294543a-5faa-468c-9e19-b76f687ae0ec admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:47.214340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 818/1644] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:47.225337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d14c2c-06c7-4b86-97f7-64c84c4578b3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09ddfde80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:47.225830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d14c2c-06c7-4b86-97f7-64c84c4578b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:47.226116 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d14c2c-06c7-4b86-97f7-64c84c4578b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:47.226403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d14c2c-06c7-4b86-97f7-64c84c4578b3 admin admin] PATH_INFO: `/v3/projects/f9277fbed6f345fbbac0afd19b045aa7/users/1230b33352424e3e9d476a726caac6b5/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:47.226530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea147f7-3c1b-437b-b835-0d41c44711fd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:47.252570 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea147f7-3c1b-437b-b835-0d41c44711fd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:47.272144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ec695-05e3-46de-807a-6acdb8175601 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e159100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:47.273009 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ec695-05e3-46de-807a-6acdb8175601 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:47.273289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ec695-05e3-46de-807a-6acdb8175601 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:47.273594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ec695-05e3-46de-807a-6acdb8175601 admin admin] PATH_INFO: `/v3/projects/b50d0ce5f5d3468aa113a9d096470706/users/4f2afad1df114c949de85cd0bbab22c4/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:47.326608 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d14c2c-06c7-4b86-97f7-64c84c4578b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9277fbed6f345fbbac0afd19b045aa7, user_id=1230b33352424e3e9d476a726caac6b5, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:47.337190 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d14c2c-06c7-4b86-97f7-64c84c4578b3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:47.342581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ec695-05e3-46de-807a-6acdb8175601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50d0ce5f5d3468aa113a9d096470706, user_id=4f2afad1df114c949de85cd0bbab22c4, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:47.346023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ec695-05e3-46de-807a-6acdb8175601 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:47.458355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 827/1645] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:47 2022] PUT /identity/v3/projects/f9277fbed6f345fbbac0afd19b045aa7/users/1230b33352424e3e9d476a726caac6b5/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:47.465320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fb852-36c9-46fe-abd7-c77005909b11 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:47.466423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fb852-36c9-46fe-abd7-c77005909b11 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:47.466971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fb852-36c9-46fe-abd7-c77005909b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:47.473448 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 819/1646] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:47 2022] PUT /identity/v3/projects/b50d0ce5f5d3468aa113a9d096470706/users/4f2afad1df114c949de85cd0bbab22c4/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:47.484949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ab3f8-7602-42f9-8f67-a6cb55d944fa None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:47.485490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ab3f8-7602-42f9-8f67-a6cb55d944fa None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:47.485971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ab3f8-7602-42f9-8f67-a6cb55d944fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:47.568756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-2f9fb852-36c9-46fe-abd7-c77005909b11 None None] MFA Rules not processed for user `1230b33352424e3e9d476a726caac6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:47.570257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2f9fb852-36c9-46fe-abd7-c77005909b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:47.600040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-560ab3f8-7602-42f9-8f67-a6cb55d944fa None None] MFA Rules not processed for user `4f2afad1df114c949de85cd0bbab22c4`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:47.603525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-560ab3f8-7602-42f9-8f67-a6cb55d944fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:47.773026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 828/1647] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:47 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:47.777519 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fb852-36c9-46fe-abd7-c77005909b11 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:47.839431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 820/1648] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:47 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:47.844905 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ab3f8-7602-42f9-8f67-a6cb55d944fa None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:47.968230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fb852-36c9-46fe-abd7-c77005909b11 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:47.977025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1488aa5-1c50-483f-9448-8a2bf46591d8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09ddd54f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:47.977025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1488aa5-1c50-483f-9448-8a2bf46591d8 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:47.977025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1488aa5-1c50-483f-9448-8a2bf46591d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:47.977025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1488aa5-1c50-483f-9448-8a2bf46591d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:47.977362 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1488aa5-1c50-483f-9448-8a2bf46591d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:47.991405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1488aa5-1c50-483f-9448-8a2bf46591d8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:48.051074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ab3f8-7602-42f9-8f67-a6cb55d944fa None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:48.067955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d223b9-6346-40ad-87ec-e3966a453771 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09deb4ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:48.068568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d223b9-6346-40ad-87ec-e3966a453771 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:48.068863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d223b9-6346-40ad-87ec-e3966a453771 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:48.069172 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d223b9-6346-40ad-87ec-e3966a453771 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:48.069818 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d223b9-6346-40ad-87ec-e3966a453771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:48.071768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d223b9-6346-40ad-87ec-e3966a453771 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:48.127018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 829/1649] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:47 2022] POST /identity/v3/projects => generated 379 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:48.131374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1488aa5-1c50-483f-9448-8a2bf46591d8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:48.210723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 821/1650] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:47 2022] POST /identity/v3/projects => generated 367 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:01:48.212009 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d223b9-6346-40ad-87ec-e3966a453771 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:48.358170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1488aa5-1c50-483f-9448-8a2bf46591d8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:48.368301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef39c36-4fe7-4740-9eca-3a1ad1257e5b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09df251c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:48.368301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef39c36-4fe7-4740-9eca-3a1ad1257e5b admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:48.368301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef39c36-4fe7-4740-9eca-3a1ad1257e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:48.368301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef39c36-4fe7-4740-9eca-3a1ad1257e5b admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:48.369924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef39c36-4fe7-4740-9eca-3a1ad1257e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:48.373553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d223b9-6346-40ad-87ec-e3966a453771 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:48.375007 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef39c36-4fe7-4740-9eca-3a1ad1257e5b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:48.386223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710b2d1-1e57-453f-ba6e-2806c3225734 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e47e880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:48.391204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b2d1-1e57-453f-ba6e-2806c3225734 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:48.391204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b2d1-1e57-453f-ba6e-2806c3225734 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:48.404312 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b2d1-1e57-453f-ba6e-2806c3225734 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:48.404539 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710b2d1-1e57-453f-ba6e-2806c3225734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:48.409782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710b2d1-1e57-453f-ba6e-2806c3225734 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:48.475217 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 830/1651] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:48 2022] POST /identity/v3/users => generated 290 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:01:48.483568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef39c36-4fe7-4740-9eca-3a1ad1257e5b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:48.516053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef39c36-4fe7-4740-9eca-3a1ad1257e5b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:48.549737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706ad1-9e01-4968-b61e-013ae47c1846 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09df25df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:48.552542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706ad1-9e01-4968-b61e-013ae47c1846 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:48.553885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706ad1-9e01-4968-b61e-013ae47c1846 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:48.554815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706ad1-9e01-4968-b61e-013ae47c1846 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:48.560120 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f706ad1-9e01-4968-b61e-013ae47c1846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:48.575820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 822/1652] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:48 2022] POST /identity/v3/users => generated 290 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:48.581271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710b2d1-1e57-453f-ba6e-2806c3225734 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:48.582022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f706ad1-9e01-4968-b61e-013ae47c1846 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:48.620806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710b2d1-1e57-453f-ba6e-2806c3225734 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:48.633633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 831/1653] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:48.636039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706ad1-9e01-4968-b61e-013ae47c1846 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:48.645966 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a88e1-7f52-4ab5-8506-ee4ad4c1f923 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e159fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:48.649227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a88e1-7f52-4ab5-8506-ee4ad4c1f923 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:48.649600 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a88e1-7f52-4ab5-8506-ee4ad4c1f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:48.650205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a88e1-7f52-4ab5-8506-ee4ad4c1f923 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:48.655435 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a88e1-7f52-4ab5-8506-ee4ad4c1f923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:48.664753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a88e1-7f52-4ab5-8506-ee4ad4c1f923 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:48.677879 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706ad1-9e01-4968-b61e-013ae47c1846 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:48.702987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad09a99-3426-4184-8377-90a6c704c4c6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09df25310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:48.705576 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad09a99-3426-4184-8377-90a6c704c4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:48.705877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad09a99-3426-4184-8377-90a6c704c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:48.710298 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad09a99-3426-4184-8377-90a6c704c4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:48.713321 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 823/1654] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:48.713625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad09a99-3426-4184-8377-90a6c704c4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:48.718273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad09a99-3426-4184-8377-90a6c704c4c6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:48.719362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a88e1-7f52-4ab5-8506-ee4ad4c1f923 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:48.751591 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a88e1-7f52-4ab5-8506-ee4ad4c1f923 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:48.753895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 832/1655] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:48.762620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad09a99-3426-4184-8377-90a6c704c4c6 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:48.770938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ab556-fad6-4b7f-94c4-9481e18de66b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e17f820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:48.781733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ab556-fad6-4b7f-94c4-9481e18de66b admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:48.781733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ab556-fad6-4b7f-94c4-9481e18de66b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:48.781733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ab556-fad6-4b7f-94c4-9481e18de66b admin admin] PATH_INFO: `/v3/projects/dbba1683377144bba57d57ee99e8ab68/users/c0b8b652e27845f993d103c813e67d09/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:48.795453 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad09a99-3426-4184-8377-90a6c704c4c6 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:48.812769 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a3cb2-93d3-42fc-bab4-2c1149c2f4f6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09defea30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:48.814478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a3cb2-93d3-42fc-bab4-2c1149c2f4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:48.814788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a3cb2-93d3-42fc-bab4-2c1149c2f4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:48.815080 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a3cb2-93d3-42fc-bab4-2c1149c2f4f6 admin admin] PATH_INFO: `/v3/projects/9d296ddc8a024b5f833271248a2125a5/users/3b2ee11a4ba940c88e37cd31262dcf45/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:48.838431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ab556-fad6-4b7f-94c4-9481e18de66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbba1683377144bba57d57ee99e8ab68, user_id=c0b8b652e27845f993d103c813e67d09, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:48.847865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ab556-fad6-4b7f-94c4-9481e18de66b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:48.867579 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a3cb2-93d3-42fc-bab4-2c1149c2f4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d296ddc8a024b5f833271248a2125a5, user_id=3b2ee11a4ba940c88e37cd31262dcf45, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:48.871054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a3cb2-93d3-42fc-bab4-2c1149c2f4f6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:48.945010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 824/1656] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:48 2022] PUT /identity/v3/projects/dbba1683377144bba57d57ee99e8ab68/users/c0b8b652e27845f993d103c813e67d09/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:48.951306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ab556-fad6-4b7f-94c4-9481e18de66b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:48.978936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 833/1657] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:48 2022] PUT /identity/v3/projects/9d296ddc8a024b5f833271248a2125a5/users/3b2ee11a4ba940c88e37cd31262dcf45/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:48.995018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e331a93-4fa0-4ad7-91f2-7ffae044dec2 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:48.995374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e331a93-4fa0-4ad7-91f2-7ffae044dec2 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:48.995784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e331a93-4fa0-4ad7-91f2-7ffae044dec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:49.155521 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4e331a93-4fa0-4ad7-91f2-7ffae044dec2 None None] MFA Rules not processed for user `3b2ee11a4ba940c88e37cd31262dcf45`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:49.159948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4e331a93-4fa0-4ad7-91f2-7ffae044dec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:49.304100 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ab556-fad6-4b7f-94c4-9481e18de66b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:49.417129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 834/1658] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:48 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:49.423504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead232ed-9bf9-4e1f-82aa-26c018ad8284 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:49.423968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead232ed-9bf9-4e1f-82aa-26c018ad8284 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:49.424387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead232ed-9bf9-4e1f-82aa-26c018ad8284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:49.443218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ebeb0-abfa-458d-82fd-5dadf4829dda admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e7951f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:49.443844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ebeb0-abfa-458d-82fd-5dadf4829dda admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:49.444240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ebeb0-abfa-458d-82fd-5dadf4829dda admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:49.444679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ebeb0-abfa-458d-82fd-5dadf4829dda admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:49.445534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ebeb0-abfa-458d-82fd-5dadf4829dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:49.447944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ebeb0-abfa-458d-82fd-5dadf4829dda admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:49.479641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-ead232ed-9bf9-4e1f-82aa-26c018ad8284 None None] MFA Rules not processed for user `65a9c92fb5144e3dacc922eede1131fd`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:49.481078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ead232ed-9bf9-4e1f-82aa-26c018ad8284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:49.492275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 825/1659] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:49.492275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ebeb0-abfa-458d-82fd-5dadf4829dda admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:49.508137 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ebeb0-abfa-458d-82fd-5dadf4829dda admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:49.525969 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e71d9d-adf1-463e-b0fa-f211c539e2a5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09dee16d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:49.526637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71d9d-adf1-463e-b0fa-f211c539e2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:49.526934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71d9d-adf1-463e-b0fa-f211c539e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:49.527478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e71d9d-adf1-463e-b0fa-f211c539e2a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:49.528996 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e71d9d-adf1-463e-b0fa-f211c539e2a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:49.560710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e71d9d-adf1-463e-b0fa-f211c539e2a5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:49.624191 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 835/1660] 10.222.0.61 () {58 vars in 1015 bytes} [Mon Feb 28 19:01:49 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:49.625167 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead232ed-9bf9-4e1f-82aa-26c018ad8284 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:49.648232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead232ed-9bf9-4e1f-82aa-26c018ad8284 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:49.666617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5eca-9374-4d1b-b3bc-9278780e25c0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e540970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:49.666617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5eca-9374-4d1b-b3bc-9278780e25c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:49.666617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5eca-9374-4d1b-b3bc-9278780e25c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:49.666617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5eca-9374-4d1b-b3bc-9278780e25c0 admin admin] PATH_INFO: `/v3/projects/dbba1683377144bba57d57ee99e8ab68/users/c0b8b652e27845f993d103c813e67d09/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:49.671580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f5eca-9374-4d1b-b3bc-9278780e25c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbba1683377144bba57d57ee99e8ab68, user_id=c0b8b652e27845f993d103c813e67d09, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:49.674866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f5eca-9374-4d1b-b3bc-9278780e25c0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:49.703856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 836/1661] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:49 2022] PUT /identity/v3/projects/dbba1683377144bba57d57ee99e8ab68/users/c0b8b652e27845f993d103c813e67d09/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:49.706406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e30e-8de3-4b93-85a0-91ab9fa55074 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:49.706755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e30e-8de3-4b93-85a0-91ab9fa55074 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:49.707182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e30e-8de3-4b93-85a0-91ab9fa55074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:49.728427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 826/1662] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:49 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:49.733179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e71d9d-adf1-463e-b0fa-f211c539e2a5 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:49.832596 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-bac1e30e-8de3-4b93-85a0-91ab9fa55074 None None] MFA Rules not processed for user `c0b8b652e27845f993d103c813e67d09`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:49.833825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-bac1e30e-8de3-4b93-85a0-91ab9fa55074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:49.863298 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e71d9d-adf1-463e-b0fa-f211c539e2a5 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:49.869588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc497d-a559-43b6-a9c5-47c677d45a9a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09e1f30d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:49.870223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc497d-a559-43b6-a9c5-47c677d45a9a admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:49.870520 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc497d-a559-43b6-a9c5-47c677d45a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:49.870972 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc497d-a559-43b6-a9c5-47c677d45a9a admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:49.871865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc497d-a559-43b6-a9c5-47c677d45a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:49.874560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc497d-a559-43b6-a9c5-47c677d45a9a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:49.958929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 827/1663] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:49 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:49.963829 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc497d-a559-43b6-a9c5-47c677d45a9a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:49.997767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc497d-a559-43b6-a9c5-47c677d45a9a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:50.016211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4bf7a-40a4-4cf7-85e7-ae5bb66ad9fd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09dee1040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:50.016833 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4bf7a-40a4-4cf7-85e7-ae5bb66ad9fd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:50.017125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4bf7a-40a4-4cf7-85e7-ae5bb66ad9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:50.021794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4bf7a-40a4-4cf7-85e7-ae5bb66ad9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:50.021794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4bf7a-40a4-4cf7-85e7-ae5bb66ad9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:50.021794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4bf7a-40a4-4cf7-85e7-ae5bb66ad9fd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:50.085050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 828/1664] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:50.086002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4bf7a-40a4-4cf7-85e7-ae5bb66ad9fd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:50.094490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-21b4bf7a-40a4-4cf7-85e7-ae5bb66ad9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:50.118616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 837/1665] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:49 2022] POST /identity/v3/auth/tokens => generated 3741 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:50.119631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1e30e-8de3-4b93-85a0-91ab9fa55074 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:50.146974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1e30e-8de3-4b93-85a0-91ab9fa55074 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:50.159926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d622b1c-c0d0-4bde-aeda-c993f1a430c7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09ddfdc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:50.161625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d622b1c-c0d0-4bde-aeda-c993f1a430c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:50.161947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d622b1c-c0d0-4bde-aeda-c993f1a430c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:50.163651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d622b1c-c0d0-4bde-aeda-c993f1a430c7 admin admin] PATH_INFO: `/v3/projects/d56e0b7868d74cefbed8c8426eb32394/users/9980f507bacf412ca0c8b09d5e57c6db/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:50.242418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d622b1c-c0d0-4bde-aeda-c993f1a430c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56e0b7868d74cefbed8c8426eb32394, user_id=9980f507bacf412ca0c8b09d5e57c6db, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:50.251416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d622b1c-c0d0-4bde-aeda-c993f1a430c7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:50.328757 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4bf7a-40a4-4cf7-85e7-ae5bb66ad9fd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:50.347564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 838/1666] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:50 2022] PUT /identity/v3/projects/d56e0b7868d74cefbed8c8426eb32394/users/9980f507bacf412ca0c8b09d5e57c6db/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:50.348801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d622b1c-c0d0-4bde-aeda-c993f1a430c7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:50.352690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-1d622b1c-c0d0-4bde-aeda-c993f1a430c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:50.354806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2361-f188-4c7d-ad66-2b1fc3a1348e service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e14af10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:50.355478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2361-f188-4c7d-ad66-2b1fc3a1348e service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:50.355812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2361-f188-4c7d-ad66-2b1fc3a1348e service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:50.356118 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2361-f188-4c7d-ad66-2b1fc3a1348e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:50.389068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2361-f188-4c7d-ad66-2b1fc3a1348e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:50.397324 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2361-f188-4c7d-ad66-2b1fc3a1348e service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:50.425232 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 829/1667] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:50 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:50.426278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2361-f188-4c7d-ad66-2b1fc3a1348e service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:50.456569 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2361-f188-4c7d-ad66-2b1fc3a1348e service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:50.476995 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d622b1c-c0d0-4bde-aeda-c993f1a430c7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:50.488633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dc125-aa9c-45e1-90e3-4d1732007090 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09ddd5f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:50.492034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dc125-aa9c-45e1-90e3-4d1732007090 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:50.492359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dc125-aa9c-45e1-90e3-4d1732007090 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:50.492659 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dc125-aa9c-45e1-90e3-4d1732007090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:50.608476 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72033a4-4b69-4445-b6c1-cb409b968233 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09de2d9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:50.609354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72033a4-4b69-4445-b6c1-cb409b968233 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:50.609783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72033a4-4b69-4445-b6c1-cb409b968233 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:50.610203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72033a4-4b69-4445-b6c1-cb409b968233 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:50.611077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72033a4-4b69-4445-b6c1-cb409b968233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:50.612850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72033a4-4b69-4445-b6c1-cb409b968233 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:50.635264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 830/1668] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:50.640274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72033a4-4b69-4445-b6c1-cb409b968233 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:50.659830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72033a4-4b69-4445-b6c1-cb409b968233 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:50.672442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17523434-15f8-4383-bd5f-11c1b4ecd48b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09e3804f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:50.673769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523434-15f8-4383-bd5f-11c1b4ecd48b admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:50.674225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523434-15f8-4383-bd5f-11c1b4ecd48b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:50.674651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523434-15f8-4383-bd5f-11c1b4ecd48b admin admin] PATH_INFO: `/v3/projects/d56e0b7868d74cefbed8c8426eb32394/users/9980f507bacf412ca0c8b09d5e57c6db/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:50.679541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17523434-15f8-4383-bd5f-11c1b4ecd48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56e0b7868d74cefbed8c8426eb32394, user_id=9980f507bacf412ca0c8b09d5e57c6db, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:50.681955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dc125-aa9c-45e1-90e3-4d1732007090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:50.682746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17523434-15f8-4383-bd5f-11c1b4ecd48b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:50.683444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dc125-aa9c-45e1-90e3-4d1732007090 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:50.711136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 831/1669] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:50 2022] PUT /identity/v3/projects/d56e0b7868d74cefbed8c8426eb32394/users/9980f507bacf412ca0c8b09d5e57c6db/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:01:50.720818 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 839/1670] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:50 2022] GET /identity/v3/auth/tokens => generated 3741 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:50.722187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092fbb2-f559-4383-96cf-cbc55c0ee390 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:50.722485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092fbb2-f559-4383-96cf-cbc55c0ee390 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:50.722794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092fbb2-f559-4383-96cf-cbc55c0ee390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:50.801285 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c092fbb2-f559-4383-96cf-cbc55c0ee390 None None] MFA Rules not processed for user `9980f507bacf412ca0c8b09d5e57c6db`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:50.802659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c092fbb2-f559-4383-96cf-cbc55c0ee390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:50.908025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dc125-aa9c-45e1-90e3-4d1732007090 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:50.909660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9d6dc125-aa9c-45e1-90e3-4d1732007090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:50.927788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dc125-aa9c-45e1-90e3-4d1732007090 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:51.006391 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 832/1671] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:50 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:51.017635 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092fbb2-f559-4383-96cf-cbc55c0ee390 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:51.076164 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41ce0c-d817-4bf3-ac72-4e73ab37d8b0 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09def9070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:51.077991 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41ce0c-d817-4bf3-ac72-4e73ab37d8b0 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:51.081113 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41ce0c-d817-4bf3-ac72-4e73ab37d8b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:51.081113 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41ce0c-d817-4bf3-ac72-4e73ab37d8b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:51.193533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092fbb2-f559-4383-96cf-cbc55c0ee390 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:51.204166 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7cec7-b45f-4b0e-adcf-ea8a4101b7fa service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e687fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:51.205070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7cec7-b45f-4b0e-adcf-ea8a4101b7fa service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:51.205070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7cec7-b45f-4b0e-adcf-ea8a4101b7fa service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:51.205407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7cec7-b45f-4b0e-adcf-ea8a4101b7fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:51.232105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7cec7-b45f-4b0e-adcf-ea8a4101b7fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:51.233586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7cec7-b45f-4b0e-adcf-ea8a4101b7fa service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:51.260421 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41ce0c-d817-4bf3-ac72-4e73ab37d8b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:51.260421 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41ce0c-d817-4bf3-ac72-4e73ab37d8b0 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:51.270586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 833/1672] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:51 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:01:51.282023 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 840/1673] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:50 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:01:51.726561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7cec7-b45f-4b0e-adcf-ea8a4101b7fa service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:51.727939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-78d7cec7-b45f-4b0e-adcf-ea8a4101b7fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:51.737902 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41ce0c-d817-4bf3-ac72-4e73ab37d8b0 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:51.751103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41ce0c-d817-4bf3-ac72-4e73ab37d8b0 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:51.765594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb477e9-4ee2-4e2b-a052-9684d63d325e service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09ddd5d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:51.768083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb477e9-4ee2-4e2b-a052-9684d63d325e service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:51.768599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb477e9-4ee2-4e2b-a052-9684d63d325e service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:51.771053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb477e9-4ee2-4e2b-a052-9684d63d325e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:51.986964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb477e9-4ee2-4e2b-a052-9684d63d325e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:51.993901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb477e9-4ee2-4e2b-a052-9684d63d325e service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:52.026944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 841/1674] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:51 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:52.032820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7cec7-b45f-4b0e-adcf-ea8a4101b7fa service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:52.061805 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dkegMpGlQM2uRlIZcEkIwQ, audit_chain_id=['dkegMpGlQM2uRlIZcEkIwQ']) at 0x7fe09e1f30d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:52.062540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:52.063263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:52.063263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] PATH_INFO: `/v3/users/dbceb8637d6b4980bbc5d8011275a587` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:52.082201 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbceb8637d6b4980bbc5d8011275a587)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:52.095569 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:52.472048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbceb8637d6b4980bbc5d8011275a587'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:52.597016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbceb8637d6b4980bbc5d8011275a587'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:52.619290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbceb8637d6b4980bbc5d8011275a587'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:52.622284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbceb8637d6b4980bbc5d8011275a587'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:52.623007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbceb8637d6b4980bbc5d8011275a587'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:52.676402 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 834/1675] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:01:51 2022] DELETE /identity/v3/users/dbceb8637d6b4980bbc5d8011275a587 => generated 0 bytes in 950 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:52.684642 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2574d7-2402-4bc2-bd48-6ade61291582 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:52.684944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2574d7-2402-4bc2-bd48-6ade61291582 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:52.685235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2574d7-2402-4bc2-bd48-6ade61291582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:52.744245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-cd2574d7-2402-4bc2-bd48-6ade61291582 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:52.745692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-cd2574d7-2402-4bc2-bd48-6ade61291582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:52.984289 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 842/1676] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:53.211517 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:53.213749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:53.406135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b869e82-2de0-4d3d-a902-295552e72099 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:53.412104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d11c8c-60a5-4a6e-870e-34c7c0c2f2fa service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e6a7340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:53.412802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11c8c-60a5-4a6e-870e-34c7c0c2f2fa service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:53.413097 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11c8c-60a5-4a6e-870e-34c7c0c2f2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:53.413383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d11c8c-60a5-4a6e-870e-34c7c0c2f2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:53.435146 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d11c8c-60a5-4a6e-870e-34c7c0c2f2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:53.436764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d11c8c-60a5-4a6e-870e-34c7c0c2f2fa service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:53.469087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 835/1677] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:53 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:53.681491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3e7a8-4be4-4d41-ae41-6e573df3622e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:53.682542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3e7a8-4be4-4d41-ae41-6e573df3622e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:53.683241 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3e7a8-4be4-4d41-ae41-6e573df3622e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:53.760376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-85a3e7a8-4be4-4d41-ae41-6e573df3622e None None] MFA Rules not processed for user `b929b39cef7546a59987075cdef32d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:53.763467 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-85a3e7a8-4be4-4d41-ae41-6e573df3622e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:54.067416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 843/1678] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:53 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:54.080503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68a0fd-55ba-4036-9fcb-a4e48130c9ec None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:54.080754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68a0fd-55ba-4036-9fcb-a4e48130c9ec None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:54.081043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68a0fd-55ba-4036-9fcb-a4e48130c9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:54.130326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-fd68a0fd-55ba-4036-9fcb-a4e48130c9ec None None] MFA Rules not processed for user `b929b39cef7546a59987075cdef32d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:54.131576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-fd68a0fd-55ba-4036-9fcb-a4e48130c9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:54.147530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 836/1679] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:54 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:54.167282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3e7a8-4be4-4d41-ae41-6e573df3622e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:54.167282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-85a3e7a8-4be4-4d41-ae41-6e573df3622e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:54.442641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3e7a8-4be4-4d41-ae41-6e573df3622e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:54.452511 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78b75e-0a60-4590-9d52-965fca71ebc0 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=VPv8sXhDS8CbQz_czxciPg, audit_chain_id=['VPv8sXhDS8CbQz_czxciPg']) at 0x7fe09e50e0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:54.453528 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78b75e-0a60-4590-9d52-965fca71ebc0 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:54.454027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78b75e-0a60-4590-9d52-965fca71ebc0 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:54.454511 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78b75e-0a60-4590-9d52-965fca71ebc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:54.477540 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78b75e-0a60-4590-9d52-965fca71ebc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:54.479641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78b75e-0a60-4590-9d52-965fca71ebc0 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:54.508243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 844/1680] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:54 2022] GET /identity/v3/auth/tokens => generated 3700 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:55.402304 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ce93-c42f-4c74-87ed-98e5acfb6e27 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:55.402962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ce93-c42f-4c74-87ed-98e5acfb6e27 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:55.403483 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ce93-c42f-4c74-87ed-98e5acfb6e27 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:55.407104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 837/1681] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 19:01:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:01:55.535361 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf9df4-8a4f-48f7-b429-8c03c7d403c0 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:55.536439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf9df4-8a4f-48f7-b429-8c03c7d403c0 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:55.536739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf9df4-8a4f-48f7-b429-8c03c7d403c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:55.674127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-b4cf9df4-8a4f-48f7-b429-8c03c7d403c0 None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:55.674127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b4cf9df4-8a4f-48f7-b429-8c03c7d403c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:55.678983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355dedf-a79f-47cc-b973-a4a7469a5888 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:55.679306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355dedf-a79f-47cc-b973-a4a7469a5888 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:55.679751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355dedf-a79f-47cc-b973-a4a7469a5888 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:55.682780 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 838/1682] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 19:01:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:01:55.723405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 845/1683] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 19:01:55 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:55.835596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb9c9-7614-4a00-a64e-f1d01ec35a89 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:55.836310 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb9c9-7614-4a00-a64e-f1d01ec35a89 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:55.836770 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb9c9-7614-4a00-a64e-f1d01ec35a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:55.889933 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b6dbb9c9-7614-4a00-a64e-f1d01ec35a89 None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:55.895642 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b6dbb9c9-7614-4a00-a64e-f1d01ec35a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:55.938917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 839/1684] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 19:01:55 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:01:57.527228 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf9df4-8a4f-48f7-b429-8c03c7d403c0 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:57.529258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b4cf9df4-8a4f-48f7-b429-8c03c7d403c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:57.542236 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf9df4-8a4f-48f7-b429-8c03c7d403c0 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:57.548308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dkegMpGlQM2uRlIZcEkIwQ, audit_chain_id=['dkegMpGlQM2uRlIZcEkIwQ']) at 0x7fe09e4ffa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:57.549459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:57.549959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:57.550469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] PATH_INFO: `/v3/projects/1947aa3088ee4fcb8cc3a8ba8f83047f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:57.551893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1947aa3088ee4fcb8cc3a8ba8f83047f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:57.553986 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:57.768714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1947aa3088ee4fcb8cc3a8ba8f83047f', 'request_id': 'req-37464c48-858c-4cd2-9cbe-f46908baf50d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:57.877291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1947aa3088ee4fcb8cc3a8ba8f83047f', 'request_id': 'req-37464c48-858c-4cd2-9cbe-f46908baf50d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:57.912490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1947aa3088ee4fcb8cc3a8ba8f83047f', 'request_id': 'req-37464c48-858c-4cd2-9cbe-f46908baf50d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:57.940983 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] The token cache is being invalidate because project 1947aa3088ee4fcb8cc3a8ba8f83047f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:01:57.941535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:57.944768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-37464c48-858c-4cd2-9cbe-f46908baf50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:01:57.952863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 846/1685] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:01:57 2022] DELETE /identity/v3/projects/1947aa3088ee4fcb8cc3a8ba8f83047f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:01:57.954377 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026bb55-8996-4530-a774-50d905400156 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:57.954908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026bb55-8996-4530-a774-50d905400156 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:57.955210 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026bb55-8996-4530-a774-50d905400156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:58.003504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e026bb55-8996-4530-a774-50d905400156 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:58.003504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e026bb55-8996-4530-a774-50d905400156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:58.205878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724d9fe-5f57-4c31-963a-2a7cead9f090 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:58.206454 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724d9fe-5f57-4c31-963a-2a7cead9f090 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:58.206900 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724d9fe-5f57-4c31-963a-2a7cead9f090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:58.212291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 840/1686] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:58.254722 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-7724d9fe-5f57-4c31-963a-2a7cead9f090 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:58.256683 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7724d9fe-5f57-4c31-963a-2a7cead9f090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:58.265850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 847/1687] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:58.269956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026bb55-8996-4530-a774-50d905400156 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:58.290638 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026bb55-8996-4530-a774-50d905400156 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:58.303561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ba920-ca4d-4f36-8941-39233b1a3a78 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09de52fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:58.312025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ba920-ca4d-4f36-8941-39233b1a3a78 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:58.312025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ba920-ca4d-4f36-8941-39233b1a3a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:58.312025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ba920-ca4d-4f36-8941-39233b1a3a78 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:58.312025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ba920-ca4d-4f36-8941-39233b1a3a78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:01:58.312025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ba920-ca4d-4f36-8941-39233b1a3a78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:58.318346 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ba920-ca4d-4f36-8941-39233b1a3a78 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:58.362851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 841/1688] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:01:58.363881 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724d9fe-5f57-4c31-963a-2a7cead9f090 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:58.393621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724d9fe-5f57-4c31-963a-2a7cead9f090 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:58.410255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792f80e-b883-4471-9e2a-7e81a63edd37 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09e7b7eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:58.410884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792f80e-b883-4471-9e2a-7e81a63edd37 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:58.411257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792f80e-b883-4471-9e2a-7e81a63edd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:58.413909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792f80e-b883-4471-9e2a-7e81a63edd37 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:58.415429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792f80e-b883-4471-9e2a-7e81a63edd37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:58.430044 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792f80e-b883-4471-9e2a-7e81a63edd37 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:58.569420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b5da1-4669-4444-aa21-ecc53e55e3f9 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:58.569740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b5da1-4669-4444-aa21-ecc53e55e3f9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:58.570126 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b5da1-4669-4444-aa21-ecc53e55e3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:58.609997 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 848/1689] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:01:58 2022] POST /identity/v3/projects => generated 403 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:58.610515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792f80e-b883-4471-9e2a-7e81a63edd37 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:58.653633 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-287b5da1-4669-4444-aa21-ecc53e55e3f9 None None] MFA Rules not processed for user `b9371804d1f943a6b6b3b2a9901030c8`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:58.657033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-287b5da1-4669-4444-aa21-ecc53e55e3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:58.809714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792f80e-b883-4471-9e2a-7e81a63edd37 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:58.822949 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dbbdc-67fa-461a-87eb-6deae9416e99 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09e8e06a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:58.823946 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dbbdc-67fa-461a-87eb-6deae9416e99 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:58.824883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dbbdc-67fa-461a-87eb-6deae9416e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:58.825402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dbbdc-67fa-461a-87eb-6deae9416e99 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:58.826361 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dbbdc-67fa-461a-87eb-6deae9416e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:58.828672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dbbdc-67fa-461a-87eb-6deae9416e99 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:58.918354 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 849/1690] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:01:58 2022] POST /identity/v3/users => generated 302 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:01:58.923866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dbbdc-67fa-461a-87eb-6deae9416e99 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:58.926760 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6b0dbbdc-67fa-461a-87eb-6deae9416e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:58.960558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 842/1691] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:58 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:01:58.962694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b5da1-4669-4444-aa21-ecc53e55e3f9 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:59.001661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-287b5da1-4669-4444-aa21-ecc53e55e3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:59.089461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dbbdc-67fa-461a-87eb-6deae9416e99 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:59.116870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906eac-369b-4b08-a1f5-c203d5e82733 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=wTjUJdAdSkmocIsusTZBDA, audit_chain_id=['wTjUJdAdSkmocIsusTZBDA']) at 0x7fe09e78ef10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:59.117463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906eac-369b-4b08-a1f5-c203d5e82733 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:59.117763 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906eac-369b-4b08-a1f5-c203d5e82733 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:59.118097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906eac-369b-4b08-a1f5-c203d5e82733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:59.125425 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3b906eac-369b-4b08-a1f5-c203d5e82733 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:59.182728 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b906eac-369b-4b08-a1f5-c203d5e82733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:59.188035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b906eac-369b-4b08-a1f5-c203d5e82733 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:59.228907 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 850/1692] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:58 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:59.232331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906eac-369b-4b08-a1f5-c203d5e82733 service nova] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:59.245055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906eac-369b-4b08-a1f5-c203d5e82733 service nova] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:59.251093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17373e-8734-4024-a50d-00c8368e3c0d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09de8b8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:59.252008 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17373e-8734-4024-a50d-00c8368e3c0d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:59.252309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17373e-8734-4024-a50d-00c8368e3c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:59.252593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17373e-8734-4024-a50d-00c8368e3c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:59.254039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17373e-8734-4024-a50d-00c8368e3c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:59.255929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17373e-8734-4024-a50d-00c8368e3c0d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:59.265440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b5da1-4669-4444-aa21-ecc53e55e3f9 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:59.286693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 851/1693] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:59.290727 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17373e-8734-4024-a50d-00c8368e3c0d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:59.315324 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82117e6b-ca63-498f-b513-81799a9e12d6 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=VPv8sXhDS8CbQz_czxciPg, audit_chain_id=['VPv8sXhDS8CbQz_czxciPg']) at 0x7fe09de5fb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:59.316201 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82117e6b-ca63-498f-b513-81799a9e12d6 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:59.316636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82117e6b-ca63-498f-b513-81799a9e12d6 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:59.317078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82117e6b-ca63-498f-b513-81799a9e12d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:59.324694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-82117e6b-ca63-498f-b513-81799a9e12d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:59.329974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17373e-8734-4024-a50d-00c8368e3c0d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:59.348955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82117e6b-ca63-498f-b513-81799a9e12d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:59.351304 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57947e1d-4555-4d7b-b8f9-f01a44bdbe04 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09de557f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:59.351430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82117e6b-ca63-498f-b513-81799a9e12d6 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:59.351523 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57947e1d-4555-4d7b-b8f9-f01a44bdbe04 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:59.351523 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57947e1d-4555-4d7b-b8f9-f01a44bdbe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:59.358836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57947e1d-4555-4d7b-b8f9-f01a44bdbe04 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:59.361459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57947e1d-4555-4d7b-b8f9-f01a44bdbe04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:59.366285 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57947e1d-4555-4d7b-b8f9-f01a44bdbe04 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:59.393068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 843/1694] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:58 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:59.399989 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 852/1695] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:01:59.405609 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82117e6b-ca63-498f-b513-81799a9e12d6 service nova] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:59.427350 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82117e6b-ca63-498f-b513-81799a9e12d6 service nova] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:59.434583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5dacf-4d85-4501-b4de-c3a990b9e097 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09de5fe50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:59.435401 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5dacf-4d85-4501-b4de-c3a990b9e097 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:59.435688 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5dacf-4d85-4501-b4de-c3a990b9e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:59.436131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5dacf-4d85-4501-b4de-c3a990b9e097 admin admin] PATH_INFO: `/v3/projects/2f1c32a17b5e4e668ae42add1cdd275c/users/c1393f5167f8479c990784c81884b108/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:59.510378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5dacf-4d85-4501-b4de-c3a990b9e097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1c32a17b5e4e668ae42add1cdd275c, user_id=c1393f5167f8479c990784c81884b108, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:59.517116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5dacf-4d85-4501-b4de-c3a990b9e097 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:01:59.632612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 844/1696] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:01:59 2022] PUT /identity/v3/projects/2f1c32a17b5e4e668ae42add1cdd275c/users/c1393f5167f8479c990784c81884b108/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:01:59.655811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a1376-1c09-41fa-847d-cb5988416dd2 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:59.655811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a1376-1c09-41fa-847d-cb5988416dd2 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:59.655811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a1376-1c09-41fa-847d-cb5988416dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:59.807606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-2b2a1376-1c09-41fa-847d-cb5988416dd2 None None] MFA Rules not processed for user `c1393f5167f8479c990784c81884b108`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:01:59.808848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2b2a1376-1c09-41fa-847d-cb5988416dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:59.948016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3702ed-358f-4ed9-a4d8-f5b9a4943631 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:59.948536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3702ed-358f-4ed9-a4d8-f5b9a4943631 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:59.948962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3702ed-358f-4ed9-a4d8-f5b9a4943631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:00.029112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-3f3702ed-358f-4ed9-a4d8-f5b9a4943631 None None] MFA Rules not processed for user `b929b39cef7546a59987075cdef32d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:00.032290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3f3702ed-358f-4ed9-a4d8-f5b9a4943631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:00.055499 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 853/1697] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:59 2022] POST /identity/v3/auth/tokens => generated 3710 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:00.056386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a1376-1c09-41fa-847d-cb5988416dd2 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:00.284605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 845/1698] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:01:59 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:00.285558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3702ed-358f-4ed9-a4d8-f5b9a4943631 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:00.286371 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a1376-1c09-41fa-847d-cb5988416dd2 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:00.319977 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40d4c-a3d6-4728-aa98-6ba0e6f50f6e service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=VPv8sXhDS8CbQz_czxciPg, audit_chain_id=['VPv8sXhDS8CbQz_czxciPg']) at 0x7fe09e4efd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:00.320689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40d4c-a3d6-4728-aa98-6ba0e6f50f6e service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:00.321215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40d4c-a3d6-4728-aa98-6ba0e6f50f6e service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:00.321498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40d4c-a3d6-4728-aa98-6ba0e6f50f6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:00.516694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40d4c-a3d6-4728-aa98-6ba0e6f50f6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:00.518688 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40d4c-a3d6-4728-aa98-6ba0e6f50f6e service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:00.530844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3702ed-358f-4ed9-a4d8-f5b9a4943631 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:00.535376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 854/1699] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:00 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:00.537575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40d4c-a3d6-4728-aa98-6ba0e6f50f6e service nova] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:00.542135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b2e40d4c-a3d6-4728-aa98-6ba0e6f50f6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:00.569622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753be5f6-c61b-48fa-a940-60ca0696c876 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09e1f3e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:00.570189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40d4c-a3d6-4728-aa98-6ba0e6f50f6e service nova] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:00.570768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753be5f6-c61b-48fa-a940-60ca0696c876 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:00.571281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753be5f6-c61b-48fa-a940-60ca0696c876 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:00.571777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753be5f6-c61b-48fa-a940-60ca0696c876 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:00.576844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753be5f6-c61b-48fa-a940-60ca0696c876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:00.584953 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753be5f6-c61b-48fa-a940-60ca0696c876 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:00.599051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec946a-08f3-49f8-a830-31f5591b2b0e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09e4e0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:00.602422 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec946a-08f3-49f8-a830-31f5591b2b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:00.604491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec946a-08f3-49f8-a830-31f5591b2b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:00.605079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec946a-08f3-49f8-a830-31f5591b2b0e admin admin] PATH_INFO: `/v3/users/1230b33352424e3e9d476a726caac6b5` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:00.610175 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec946a-08f3-49f8-a830-31f5591b2b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1230b33352424e3e9d476a726caac6b5)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:00.619675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec946a-08f3-49f8-a830-31f5591b2b0e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:00.961216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-93ec946a-08f3-49f8-a830-31f5591b2b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1230b33352424e3e9d476a726caac6b5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:01.003593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-93ec946a-08f3-49f8-a830-31f5591b2b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1230b33352424e3e9d476a726caac6b5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:01.005024 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-93ec946a-08f3-49f8-a830-31f5591b2b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1230b33352424e3e9d476a726caac6b5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:01.007663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-93ec946a-08f3-49f8-a830-31f5591b2b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1230b33352424e3e9d476a726caac6b5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:01.122732 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-93ec946a-08f3-49f8-a830-31f5591b2b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1230b33352424e3e9d476a726caac6b5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:01.154873 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 855/1700] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:00 2022] DELETE /identity/v3/users/1230b33352424e3e9d476a726caac6b5 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:01.156341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cee62f-8518-430b-a9dc-71d44dccc2a5 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:01.161307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cee62f-8518-430b-a9dc-71d44dccc2a5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:01.161859 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cee62f-8518-430b-a9dc-71d44dccc2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:01.175435 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 846/1701] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:00 2022] POST /identity/v3/projects => generated 405 bytes in 890 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:01.180274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753be5f6-c61b-48fa-a940-60ca0696c876 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:01.188253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-753be5f6-c61b-48fa-a940-60ca0696c876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:01.260950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-18cee62f-8518-430b-a9dc-71d44dccc2a5 None None] MFA Rules not processed for user `d7a958a47ae44558a637dbe34b5a8f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:01.263489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-18cee62f-8518-430b-a9dc-71d44dccc2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:01.470537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753be5f6-c61b-48fa-a940-60ca0696c876 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:01.481481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 856/1702] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:01 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:01.482805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07fb1-ec1e-4b28-9925-8410ca6b6b7b None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:01.483105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07fb1-ec1e-4b28-9925-8410ca6b6b7b None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:01.483414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07fb1-ec1e-4b28-9925-8410ca6b6b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:01.523689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e3c48e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:01.525018 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:01.530494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:01.530494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] PATH_INFO: `/v3/users/4f2afad1df114c949de85cd0bbab22c4` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:01.530494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2afad1df114c949de85cd0bbab22c4)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:01.530494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:01.536373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a4d07fb1-ec1e-4b28-9925-8410ca6b6b7b None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:01.537618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a4d07fb1-ec1e-4b28-9925-8410ca6b6b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:01.555170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 857/1703] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:01.555807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d07fb1-ec1e-4b28-9925-8410ca6b6b7b None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:01.566681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a4d07fb1-ec1e-4b28-9925-8410ca6b6b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:01.633091 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d07fb1-ec1e-4b28-9925-8410ca6b6b7b None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:01.649142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce8f5f-d3c4-4b8b-90ec-67169c8c9180 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09eae0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:01.649934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce8f5f-d3c4-4b8b-90ec-67169c8c9180 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:01.650262 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce8f5f-d3c4-4b8b-90ec-67169c8c9180 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:01.650562 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce8f5f-d3c4-4b8b-90ec-67169c8c9180 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:01.651235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce8f5f-d3c4-4b8b-90ec-67169c8c9180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:01.661984 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce8f5f-d3c4-4b8b-90ec-67169c8c9180 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:01.817642 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 858/1704] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:01 2022] POST /identity/v3/users => generated 309 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:01.818509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce8f5f-d3c4-4b8b-90ec-67169c8c9180 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:01.821609 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-fcce8f5f-d3c4-4b8b-90ec-67169c8c9180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:01.856129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2afad1df114c949de85cd0bbab22c4'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:01.933336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2afad1df114c949de85cd0bbab22c4'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:01.961359 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2afad1df114c949de85cd0bbab22c4'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:01.963775 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2afad1df114c949de85cd0bbab22c4'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:01.966569 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2afad1df114c949de85cd0bbab22c4'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:02.031670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 847/1705] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:01 2022] DELETE /identity/v3/users/4f2afad1df114c949de85cd0bbab22c4 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:02.031670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:02.035369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:02.071094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce8f5f-d3c4-4b8b-90ec-67169c8c9180 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:02.210733 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a311f-9c83-4369-a8e9-177d057cddaa service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e45d700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:02.211559 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a311f-9c83-4369-a8e9-177d057cddaa service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:02.211971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a311f-9c83-4369-a8e9-177d057cddaa service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:02.212263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a311f-9c83-4369-a8e9-177d057cddaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:02.214188 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-318a311f-9c83-4369-a8e9-177d057cddaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:02.249960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8b2b4-2861-435b-8f12-425d3e9f7c3e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:02.265231 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea7eef-78da-4d22-aa12-032bf626049b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09e8a0880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:02.265965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea7eef-78da-4d22-aa12-032bf626049b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:02.266261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea7eef-78da-4d22-aa12-032bf626049b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:02.266546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea7eef-78da-4d22-aa12-032bf626049b admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:02.267311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea7eef-78da-4d22-aa12-032bf626049b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:02.268956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea7eef-78da-4d22-aa12-032bf626049b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:02.287545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 848/1706] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:02.288674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bbf98-ec5d-436f-8cc2-896261977ba1 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:02.288973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bbf98-ec5d-436f-8cc2-896261977ba1 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:02.289258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bbf98-ec5d-436f-8cc2-896261977ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:02.335148 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a311f-9c83-4369-a8e9-177d057cddaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:02.336729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a311f-9c83-4369-a8e9-177d057cddaa service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:02.348524 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-8b6bbf98-ec5d-436f-8cc2-896261977ba1 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:02.349713 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8b6bbf98-ec5d-436f-8cc2-896261977ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:02.350160 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 859/1707] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:02.351055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a311f-9c83-4369-a8e9-177d057cddaa service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:02.363364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a311f-9c83-4369-a8e9-177d057cddaa service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:02.372505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4b85b-5642-4d16-a4da-977312bde38e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09e55f9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:02.373659 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4b85b-5642-4d16-a4da-977312bde38e admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:02.374061 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4b85b-5642-4d16-a4da-977312bde38e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:02.374483 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4b85b-5642-4d16-a4da-977312bde38e admin admin] PATH_INFO: `/v3/projects/1afc42fd1aac44e281d1c31df5a05e4f/users/52dfcc769cd64c27b4a44763524ec7b4/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:02.379146 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 849/1708] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:02.388458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bbf98-ec5d-436f-8cc2-896261977ba1 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:02.390354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8b6bbf98-ec5d-436f-8cc2-896261977ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:02.423329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bbf98-ec5d-436f-8cc2-896261977ba1 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:02.423329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2935cb6-3d6c-4742-8082-5db24645e9de service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09ea23880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:02.423329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2935cb6-3d6c-4742-8082-5db24645e9de service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:02.423329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2935cb6-3d6c-4742-8082-5db24645e9de service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:02.423905 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2935cb6-3d6c-4742-8082-5db24645e9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:02.432678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4b85b-5642-4d16-a4da-977312bde38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afc42fd1aac44e281d1c31df5a05e4f, user_id=52dfcc769cd64c27b4a44763524ec7b4, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:02.438927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4b85b-5642-4d16-a4da-977312bde38e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:02.442533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2935cb6-3d6c-4742-8082-5db24645e9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:02.444020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2935cb6-3d6c-4742-8082-5db24645e9de service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:02.470264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 850/1709] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:02:02.479035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2935cb6-3d6c-4742-8082-5db24645e9de service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:02.481015 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b2935cb6-3d6c-4742-8082-5db24645e9de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:02.620834 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 860/1710] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:02 2022] PUT /identity/v3/projects/1afc42fd1aac44e281d1c31df5a05e4f/users/52dfcc769cd64c27b4a44763524ec7b4/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:02.624305 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2935cb6-3d6c-4742-8082-5db24645e9de service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:02.625411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4b85b-5642-4d16-a4da-977312bde38e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:02.721962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c8456-b12c-48ae-b2da-cb997d41a41c service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=wTjUJdAdSkmocIsusTZBDA, audit_chain_id=['wTjUJdAdSkmocIsusTZBDA']) at 0x7fe09e20e040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:02.721962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c8456-b12c-48ae-b2da-cb997d41a41c service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:02.721962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c8456-b12c-48ae-b2da-cb997d41a41c service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:02.721962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c8456-b12c-48ae-b2da-cb997d41a41c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:02.722340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8b6c8456-b12c-48ae-b2da-cb997d41a41c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:02.739877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4b85b-5642-4d16-a4da-977312bde38e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:02.746954 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbea872-7e48-49a2-98b7-91d11b50060e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09e4ef040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:02.748519 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbea872-7e48-49a2-98b7-91d11b50060e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:02.748519 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbea872-7e48-49a2-98b7-91d11b50060e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:02.748519 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbea872-7e48-49a2-98b7-91d11b50060e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:02.748968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbea872-7e48-49a2-98b7-91d11b50060e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:02.752118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbea872-7e48-49a2-98b7-91d11b50060e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:02.766096 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 861/1711] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:02.769989 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbea872-7e48-49a2-98b7-91d11b50060e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:02.781307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbea872-7e48-49a2-98b7-91d11b50060e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:02.787631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4e381-7157-4713-b569-173639d8370c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09eae0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:02.788904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4e381-7157-4713-b569-173639d8370c admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:02.788904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4e381-7157-4713-b569-173639d8370c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:02.789268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4e381-7157-4713-b569-173639d8370c admin admin] PATH_INFO: `/v3/projects/1afc42fd1aac44e281d1c31df5a05e4f/users/52dfcc769cd64c27b4a44763524ec7b4/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:02.791816 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4e381-7157-4713-b569-173639d8370c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afc42fd1aac44e281d1c31df5a05e4f, user_id=52dfcc769cd64c27b4a44763524ec7b4, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:02.795466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4e381-7157-4713-b569-173639d8370c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:02.845190 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 862/1712] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:02 2022] PUT /identity/v3/projects/1afc42fd1aac44e281d1c31df5a05e4f/users/52dfcc769cd64c27b4a44763524ec7b4/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:02.846286 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c8456-b12c-48ae-b2da-cb997d41a41c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:02.849866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c8456-b12c-48ae-b2da-cb997d41a41c service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:02.857446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d845c-e6b8-48ad-b2f7-568fd719f0d0 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:02.857747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d845c-e6b8-48ad-b2f7-568fd719f0d0 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:02.858039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d845c-e6b8-48ad-b2f7-568fd719f0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:02.882331 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 851/1713] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:02 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:02:02.985856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-204d845c-e6b8-48ad-b2f7-568fd719f0d0 None None] MFA Rules not processed for user `52dfcc769cd64c27b4a44763524ec7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:02.987283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-204d845c-e6b8-48ad-b2f7-568fd719f0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:03.367323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 863/1714] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:02 2022] POST /identity/v3/auth/tokens => generated 3779 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:03.385622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c8456-b12c-48ae-b2da-cb997d41a41c service nova] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:03.387613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8b6c8456-b12c-48ae-b2da-cb997d41a41c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:03.392049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d845c-e6b8-48ad-b2f7-568fd719f0d0 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:03.398298 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-204d845c-e6b8-48ad-b2f7-568fd719f0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:03.414324 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c8456-b12c-48ae-b2da-cb997d41a41c service nova] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:03.643276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e3fa370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:03.644093 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:03.644916 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:03.645201 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] PATH_INFO: `/v3/projects/b50d0ce5f5d3468aa113a9d096470706` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:03.648788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50d0ce5f5d3468aa113a9d096470706)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:03.650925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:03.697168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d845c-e6b8-48ad-b2f7-568fd719f0d0 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:03.707447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc8cf5-b4d3-45ea-8e5a-98d5a76053d3 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09eacf9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:03.708050 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc8cf5-b4d3-45ea-8e5a-98d5a76053d3 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:03.710095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc8cf5-b4d3-45ea-8e5a-98d5a76053d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:03.710601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc8cf5-b4d3-45ea-8e5a-98d5a76053d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:03.748616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc8cf5-b4d3-45ea-8e5a-98d5a76053d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:03.750105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc8cf5-b4d3-45ea-8e5a-98d5a76053d3 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:03.802168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 864/1715] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:03 2022] GET /identity/v3/auth/tokens => generated 3779 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:03.904577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50d0ce5f5d3468aa113a9d096470706', 'request_id': 'req-77786a1e-db9d-42b3-92d4-601518593415'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:03.941532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50d0ce5f5d3468aa113a9d096470706', 'request_id': 'req-77786a1e-db9d-42b3-92d4-601518593415'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.061149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc8cf5-b4d3-45ea-8e5a-98d5a76053d3 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:04.080610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc8cf5-b4d3-45ea-8e5a-98d5a76053d3 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:04.094229 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50d0ce5f5d3468aa113a9d096470706', 'request_id': 'req-77786a1e-db9d-42b3-92d4-601518593415'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.110163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] The token cache is being invalidate because project b50d0ce5f5d3468aa113a9d096470706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:04.113364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.118056 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.120351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 852/1716] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:03 2022] DELETE /identity/v3/projects/b50d0ce5f5d3468aa113a9d096470706 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:04.126404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:04.129415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:04.291816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786a1e-db9d-42b3-92d4-601518593415 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:04.293131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09e705940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:04.294523 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:04.294927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:04.295246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] PATH_INFO: `/v3/users/c1393f5167f8479c990784c81884b108` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:04.296639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a046e78-05cc-4052-be8c-3501f57ebdd5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e37f6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:04.297769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a046e78-05cc-4052-be8c-3501f57ebdd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:04.298063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a046e78-05cc-4052-be8c-3501f57ebdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:04.298170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1393f5167f8479c990784c81884b108)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:04.298493 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a046e78-05cc-4052-be8c-3501f57ebdd5 admin admin] PATH_INFO: `/v3/users/c0b8b652e27845f993d103c813e67d09` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:04.299770 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a046e78-05cc-4052-be8c-3501f57ebdd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b8b652e27845f993d103c813e67d09)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:04.301834 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a046e78-05cc-4052-be8c-3501f57ebdd5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:04.310501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:04.529372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7a046e78-05cc-4052-be8c-3501f57ebdd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b8b652e27845f993d103c813e67d09'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.592519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7a046e78-05cc-4052-be8c-3501f57ebdd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b8b652e27845f993d103c813e67d09'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.600955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1393f5167f8479c990784c81884b108'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.629258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7a046e78-05cc-4052-be8c-3501f57ebdd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b8b652e27845f993d103c813e67d09'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.631546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7a046e78-05cc-4052-be8c-3501f57ebdd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b8b652e27845f993d103c813e67d09'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.633632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7a046e78-05cc-4052-be8c-3501f57ebdd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b8b652e27845f993d103c813e67d09'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.637575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1393f5167f8479c990784c81884b108'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.638467 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1393f5167f8479c990784c81884b108'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.639294 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1393f5167f8479c990784c81884b108'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.667341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 853/1717] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:04 2022] DELETE /identity/v3/users/c0b8b652e27845f993d103c813e67d09 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:04.756712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1393f5167f8479c990784c81884b108'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:04.779775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 865/1718] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:04 2022] DELETE /identity/v3/users/c1393f5167f8479c990784c81884b108 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:04.792335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d9d0-2e5e-4121-b060-5e6f8b95ea94 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:04.792335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d9d0-2e5e-4121-b060-5e6f8b95ea94 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:04.792335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d9d0-2e5e-4121-b060-5e6f8b95ea94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:04.825878 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b433d9d0-2e5e-4121-b060-5e6f8b95ea94 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:04.829043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b433d9d0-2e5e-4121-b060-5e6f8b95ea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:04.919425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 854/1719] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:04.928762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:04.930586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:05.125693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9e71b-f1fe-448e-a200-a24690aa2d9f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:05.140928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8446b18-5179-4a93-8ba6-6def3ece18d8 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e50e0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:05.141671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8446b18-5179-4a93-8ba6-6def3ece18d8 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:05.142036 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8446b18-5179-4a93-8ba6-6def3ece18d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:05.142396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8446b18-5179-4a93-8ba6-6def3ece18d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:05.172131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8446b18-5179-4a93-8ba6-6def3ece18d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:05.174104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8446b18-5179-4a93-8ba6-6def3ece18d8 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:05.198237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 866/1720] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:05.219623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d9d0-2e5e-4121-b060-5e6f8b95ea94 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:05.221063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b433d9d0-2e5e-4121-b060-5e6f8b95ea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:05.242004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d9d0-2e5e-4121-b060-5e6f8b95ea94 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:05.253854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09eb78070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:05.254784 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:05.254959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:05.255273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] PATH_INFO: `/v3/projects/f9277fbed6f345fbbac0afd19b045aa7` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:05.263101 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9277fbed6f345fbbac0afd19b045aa7)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:05.265175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:05.464163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9277fbed6f345fbbac0afd19b045aa7', 'request_id': 'req-9637cdd8-9567-4ce5-bb9f-54969449865c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:05.533626 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9277fbed6f345fbbac0afd19b045aa7', 'request_id': 'req-9637cdd8-9567-4ce5-bb9f-54969449865c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:05.620580 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9277fbed6f345fbbac0afd19b045aa7', 'request_id': 'req-9637cdd8-9567-4ce5-bb9f-54969449865c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:05.659529 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] The token cache is being invalidate because project f9277fbed6f345fbbac0afd19b045aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:05.660485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:05.662226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:05.670337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 855/1721] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:05 2022] DELETE /identity/v3/projects/f9277fbed6f345fbbac0afd19b045aa7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:05.673163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8446b18-5179-4a93-8ba6-6def3ece18d8 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:05.686935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8446b18-5179-4a93-8ba6-6def3ece18d8 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:05.849062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09e3b5fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:05.867459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:05.868150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:05.869664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] PATH_INFO: `/v3/users/3b2ee11a4ba940c88e37cd31262dcf45` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:05.876969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2ee11a4ba940c88e37cd31262dcf45)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:05.879601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:06.187812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2ee11a4ba940c88e37cd31262dcf45'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:06.246581 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2ee11a4ba940c88e37cd31262dcf45'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:06.248425 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2ee11a4ba940c88e37cd31262dcf45'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:06.250877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2ee11a4ba940c88e37cd31262dcf45'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:06.327803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2ee11a4ba940c88e37cd31262dcf45'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:06.356684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 867/1722] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:05 2022] DELETE /identity/v3/users/3b2ee11a4ba940c88e37cd31262dcf45 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:06.590628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:06.592896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:06.621747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637cdd8-9567-4ce5-bb9f-54969449865c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:06.767560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1sfjaPNqTkKu-NJLk2co_g, audit_chain_id=['1sfjaPNqTkKu-NJLk2co_g']) at 0x7fe09e2727f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:06.768650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:06.769249 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:06.770757 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] PATH_INFO: `/v3/projects/dbba1683377144bba57d57ee99e8ab68` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:06.772781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbba1683377144bba57d57ee99e8ab68)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:06.776537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:06.873210 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:06.874727 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:06.894752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879a1a2-7c1b-4579-806e-267e63c6b2ab admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:06.901691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09e196af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:06.902808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:06.903403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:06.903973 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] PATH_INFO: `/v3/projects/2f1c32a17b5e4e668ae42add1cdd275c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:06.913496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1c32a17b5e4e668ae42add1cdd275c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:06.913496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:07.001846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbba1683377144bba57d57ee99e8ab68', 'request_id': 'req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.029209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbba1683377144bba57d57ee99e8ab68', 'request_id': 'req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.127813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbba1683377144bba57d57ee99e8ab68', 'request_id': 'req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.134335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1c32a17b5e4e668ae42add1cdd275c', 'request_id': 'req-9d514770-32a9-4a31-aca1-ed8d97892412'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.146034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] The token cache is being invalidate because project dbba1683377144bba57d57ee99e8ab68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:07.146323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.147000 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-68d0fae3-4b4a-4ad1-87eb-e698ef80d09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.151746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 856/1723] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:06 2022] DELETE /identity/v3/projects/dbba1683377144bba57d57ee99e8ab68 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:07.153255 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee1ee-57c6-49b9-9462-3d56100103ce None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:07.153548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee1ee-57c6-49b9-9462-3d56100103ce None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:07.155286 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee1ee-57c6-49b9-9462-3d56100103ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:07.193170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-74eee1ee-57c6-49b9-9462-3d56100103ce None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:07.196281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-74eee1ee-57c6-49b9-9462-3d56100103ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:07.232380 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1c32a17b5e4e668ae42add1cdd275c', 'request_id': 'req-9d514770-32a9-4a31-aca1-ed8d97892412'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.252192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1c32a17b5e4e668ae42add1cdd275c', 'request_id': 'req-9d514770-32a9-4a31-aca1-ed8d97892412'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.281846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] The token cache is being invalidate because project 2f1c32a17b5e4e668ae42add1cdd275c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:07.282232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.283487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.287395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 868/1724] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:06 2022] DELETE /identity/v3/projects/2f1c32a17b5e4e668ae42add1cdd275c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:07.291479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:07.296625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:07.358446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 857/1725] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:07.366888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb432-94c4-4182-9e12-c369f9de5e2b None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:07.367334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb432-94c4-4182-9e12-c369f9de5e2b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:07.367625 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fb432-94c4-4182-9e12-c369f9de5e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:07.408902 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e98fb432-94c4-4182-9e12-c369f9de5e2b None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:07.410091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e98fb432-94c4-4182-9e12-c369f9de5e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:07.442308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 858/1726] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:07.446392 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fb432-94c4-4182-9e12-c369f9de5e2b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:07.471362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fb432-94c4-4182-9e12-c369f9de5e2b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:07.497301 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546cd48-1150-428d-acd7-fb353725a089 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09e472550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:07.497924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546cd48-1150-428d-acd7-fb353725a089 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:07.498671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546cd48-1150-428d-acd7-fb353725a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:07.498671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546cd48-1150-428d-acd7-fb353725a089 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:07.499198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546cd48-1150-428d-acd7-fb353725a089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:07.499501 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546cd48-1150-428d-acd7-fb353725a089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:07.503831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546cd48-1150-428d-acd7-fb353725a089 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:07.508284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d514770-32a9-4a31-aca1-ed8d97892412 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:07.530291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09e45d430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:07.531360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:07.531648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:07.531940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] PATH_INFO: `/v3/users/52dfcc769cd64c27b4a44763524ec7b4` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:07.533682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52dfcc769cd64c27b4a44763524ec7b4)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:07.535664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:07.555483 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 859/1727] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:02:07.559953 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546cd48-1150-428d-acd7-fb353725a089 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:07.591698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546cd48-1150-428d-acd7-fb353725a089 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:07.602100 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f4cf7-ae68-4571-97b3-b8e6462ae522 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09e3e76a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:07.602807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4cf7-ae68-4571-97b3-b8e6462ae522 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:07.603320 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4cf7-ae68-4571-97b3-b8e6462ae522 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:07.605818 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f4cf7-ae68-4571-97b3-b8e6462ae522 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:07.605818 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f4cf7-ae68-4571-97b3-b8e6462ae522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:07.607196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f4cf7-ae68-4571-97b3-b8e6462ae522 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:07.714451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 860/1728] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:07 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:07.719488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f4cf7-ae68-4571-97b3-b8e6462ae522 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:07.762023 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52dfcc769cd64c27b4a44763524ec7b4'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.776769 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52dfcc769cd64c27b4a44763524ec7b4'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.778393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52dfcc769cd64c27b4a44763524ec7b4'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.784973 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52dfcc769cd64c27b4a44763524ec7b4'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.867153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f4cf7-ae68-4571-97b3-b8e6462ae522 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:07.875912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c6fbc-b491-4615-9c1f-854939bd64f0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09de104f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:07.876933 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c6fbc-b491-4615-9c1f-854939bd64f0 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:07.877437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c6fbc-b491-4615-9c1f-854939bd64f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:07.878799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c6fbc-b491-4615-9c1f-854939bd64f0 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:07.880111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c6fbc-b491-4615-9c1f-854939bd64f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:07.882899 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c6fbc-b491-4615-9c1f-854939bd64f0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:07.889792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52dfcc769cd64c27b4a44763524ec7b4'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:07.965874 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 869/1729] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:07 2022] DELETE /identity/v3/users/52dfcc769cd64c27b4a44763524ec7b4 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:08.037871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 861/1730] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:07 2022] POST /identity/v3/users => generated 294 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:08.044003 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:08.046399 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:08.229110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76836ad4-217e-4658-9128-6dca1873a888 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:08.237465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c889e6-9fb9-4811-b5d6-5868a470fbc7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09e555910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:08.238658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c889e6-9fb9-4811-b5d6-5868a470fbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:08.238859 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c889e6-9fb9-4811-b5d6-5868a470fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:08.239378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c889e6-9fb9-4811-b5d6-5868a470fbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:08.240429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c889e6-9fb9-4811-b5d6-5868a470fbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:08.242546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c889e6-9fb9-4811-b5d6-5868a470fbc7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:08.258977 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 870/1731] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:08.263519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c6fbc-b491-4615-9c1f-854939bd64f0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:08.279078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c6fbc-b491-4615-9c1f-854939bd64f0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:08.285056 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583dec4-80f5-4b4a-aa74-63119eeb1b6f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09df0b580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:08.286826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583dec4-80f5-4b4a-aa74-63119eeb1b6f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:08.287365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583dec4-80f5-4b4a-aa74-63119eeb1b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:08.288004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583dec4-80f5-4b4a-aa74-63119eeb1b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:08.289490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583dec4-80f5-4b4a-aa74-63119eeb1b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:08.291659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583dec4-80f5-4b4a-aa74-63119eeb1b6f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:08.309578 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 862/1732] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:08.312757 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c889e6-9fb9-4811-b5d6-5868a470fbc7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:08.331281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c889e6-9fb9-4811-b5d6-5868a470fbc7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:08.342694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46458059-6903-4147-bc20-b823417298e9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09de2fb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:08.345672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46458059-6903-4147-bc20-b823417298e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:08.346387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46458059-6903-4147-bc20-b823417298e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:08.346877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46458059-6903-4147-bc20-b823417298e9 admin admin] PATH_INFO: `/v3/projects/3192eeb422084f658a82e673fe2d7b59/users/a56d685c5d9947c8a138d0b20ed60d65/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:08.384710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46458059-6903-4147-bc20-b823417298e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3192eeb422084f658a82e673fe2d7b59, user_id=a56d685c5d9947c8a138d0b20ed60d65, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:08.390369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46458059-6903-4147-bc20-b823417298e9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:08.465106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 871/1733] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:08 2022] PUT /identity/v3/projects/3192eeb422084f658a82e673fe2d7b59/users/a56d685c5d9947c8a138d0b20ed60d65/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:08.475692 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657947fa-9fbc-4ea7-ada6-4ce87c0dbf27 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:08.475981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657947fa-9fbc-4ea7-ada6-4ce87c0dbf27 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:08.476261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657947fa-9fbc-4ea7-ada6-4ce87c0dbf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:08.530542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-657947fa-9fbc-4ea7-ada6-4ce87c0dbf27 None None] MFA Rules not processed for user `a56d685c5d9947c8a138d0b20ed60d65`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:08.544068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-657947fa-9fbc-4ea7-ada6-4ce87c0dbf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:08.564039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46458059-6903-4147-bc20-b823417298e9 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:08.566172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-46458059-6903-4147-bc20-b823417298e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:08.732846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 863/1734] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:08 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:08.734764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657947fa-9fbc-4ea7-ada6-4ce87c0dbf27 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:08.746772 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46458059-6903-4147-bc20-b823417298e9 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:08.752029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657947fa-9fbc-4ea7-ada6-4ce87c0dbf27 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:08.756019 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09e480dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:08.756830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:08.757120 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:08.757400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] PATH_INFO: `/v3/projects/9d296ddc8a024b5f833271248a2125a5` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:08.757506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202edf7-139f-4e8c-b888-52f7fbb303bb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09e3e4190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:08.758296 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202edf7-139f-4e8c-b888-52f7fbb303bb admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:08.758542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d296ddc8a024b5f833271248a2125a5)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:08.758744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202edf7-139f-4e8c-b888-52f7fbb303bb admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:08.759676 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202edf7-139f-4e8c-b888-52f7fbb303bb admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:08.760484 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:08.760597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202edf7-139f-4e8c-b888-52f7fbb303bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:08.762887 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202edf7-139f-4e8c-b888-52f7fbb303bb admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:08.881336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 864/1735] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:08 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:08.882999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202edf7-139f-4e8c-b888-52f7fbb303bb admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:08.915915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d296ddc8a024b5f833271248a2125a5', 'request_id': 'req-fe723ea4-e233-4357-8125-3f2335d84c06'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:09.002542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d296ddc8a024b5f833271248a2125a5', 'request_id': 'req-fe723ea4-e233-4357-8125-3f2335d84c06'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:09.023893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d296ddc8a024b5f833271248a2125a5', 'request_id': 'req-fe723ea4-e233-4357-8125-3f2335d84c06'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:09.033758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202edf7-139f-4e8c-b888-52f7fbb303bb admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:09.038380 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] The token cache is being invalidate because project 9d296ddc8a024b5f833271248a2125a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:09.038673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:09.040168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:09.041908 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 872/1736] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:08 2022] DELETE /identity/v3/projects/9d296ddc8a024b5f833271248a2125a5 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:09.046944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:09.049431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:09.132966 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d2fa-5999-4549-bf58-9849829054db admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09e3de220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:09.133826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d2fa-5999-4549-bf58-9849829054db admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:09.134125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d2fa-5999-4549-bf58-9849829054db admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:09.134413 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d2fa-5999-4549-bf58-9849829054db admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:09.135054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4d2fa-5999-4549-bf58-9849829054db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:09.138765 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4d2fa-5999-4549-bf58-9849829054db admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:09.174189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe723ea4-e233-4357-8125-3f2335d84c06 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:09.188917 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09e978790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:09.189753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:09.190047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:09.190338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] PATH_INFO: `/v3/users/9980f507bacf412ca0c8b09d5e57c6db` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:09.191956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9980f507bacf412ca0c8b09d5e57c6db)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:09.193884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:09.238328 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 865/1737] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:08 2022] POST /identity/v3/users => generated 299 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:09.241294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282e36a-d2c6-47a6-8f3c-40cce6e36b8e None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:09.241819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282e36a-d2c6-47a6-8f3c-40cce6e36b8e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:09.242321 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282e36a-d2c6-47a6-8f3c-40cce6e36b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:09.283892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-4282e36a-d2c6-47a6-8f3c-40cce6e36b8e None None] MFA Rules not processed for user `b9371804d1f943a6b6b3b2a9901030c8`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:09.285804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4282e36a-d2c6-47a6-8f3c-40cce6e36b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:09.432543 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 866/1738] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:09 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:09.442408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282e36a-d2c6-47a6-8f3c-40cce6e36b8e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:09.451937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9980f507bacf412ca0c8b09d5e57c6db'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:09.455321 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4282e36a-d2c6-47a6-8f3c-40cce6e36b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:09.467846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9980f507bacf412ca0c8b09d5e57c6db'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:09.468849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9980f507bacf412ca0c8b09d5e57c6db'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:09.469889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9980f507bacf412ca0c8b09d5e57c6db'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:09.485754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282e36a-d2c6-47a6-8f3c-40cce6e36b8e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:09.500908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5743642-498c-48aa-a05d-2efd8ecb367f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09e90fca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:09.501591 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743642-498c-48aa-a05d-2efd8ecb367f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:09.501886 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743642-498c-48aa-a05d-2efd8ecb367f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:09.502167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743642-498c-48aa-a05d-2efd8ecb367f admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:09.503028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5743642-498c-48aa-a05d-2efd8ecb367f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:09.505359 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5743642-498c-48aa-a05d-2efd8ecb367f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:09.528983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 867/1739] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:09.532894 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5743642-498c-48aa-a05d-2efd8ecb367f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:09.534296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9980f507bacf412ca0c8b09d5e57c6db'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:09.546862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e5743642-498c-48aa-a05d-2efd8ecb367f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:09.567382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5743642-498c-48aa-a05d-2efd8ecb367f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:09.586393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 873/1740] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:09 2022] DELETE /identity/v3/users/9980f507bacf412ca0c8b09d5e57c6db => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:09.588103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c69d-cb84-48cc-b059-b7e6b8b2d55e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09e9775e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:09.589017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c69d-cb84-48cc-b059-b7e6b8b2d55e admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:09.589817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c69d-cb84-48cc-b059-b7e6b8b2d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:09.590355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c69d-cb84-48cc-b059-b7e6b8b2d55e admin admin] PATH_INFO: `/v3/projects/54fc7bd4cd4041a59eef46f6a80fef57/users/63f79e62cbf54c5798619831a60bec86/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:09.626879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40c69d-cb84-48cc-b059-b7e6b8b2d55e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fc7bd4cd4041a59eef46f6a80fef57, user_id=63f79e62cbf54c5798619831a60bec86, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:09.632825 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40c69d-cb84-48cc-b059-b7e6b8b2d55e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:09.720073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 868/1741] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:09 2022] PUT /identity/v3/projects/54fc7bd4cd4041a59eef46f6a80fef57/users/63f79e62cbf54c5798619831a60bec86/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:09.724282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:09.805041 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c69d-cb84-48cc-b059-b7e6b8b2d55e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:09.807710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9f40c69d-cb84-48cc-b059-b7e6b8b2d55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:09.834517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dc3ce-cc24-4ae7-989d-9168cb819f54 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:09.963394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba278b2c-44d4-4cd7-a42b-b3ae4608a90e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09de0c6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:09.965853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba278b2c-44d4-4cd7-a42b-b3ae4608a90e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:09.968231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba278b2c-44d4-4cd7-a42b-b3ae4608a90e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:09.968865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba278b2c-44d4-4cd7-a42b-b3ae4608a90e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:09.971258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba278b2c-44d4-4cd7-a42b-b3ae4608a90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:09.973938 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba278b2c-44d4-4cd7-a42b-b3ae4608a90e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:09.997061 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c69d-cb84-48cc-b059-b7e6b8b2d55e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:10.004529 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 874/1742] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:10.008742 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba278b2c-44d4-4cd7-a42b-b3ae4608a90e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:10.009984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LjBWayUQQfmkG6QOMaEGww, audit_chain_id=['LjBWayUQQfmkG6QOMaEGww']) at 0x7fe09eb66f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:10.014504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.014812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.015105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] PATH_INFO: `/v3/projects/1afc42fd1aac44e281d1c31df5a05e4f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.018775 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1afc42fd1aac44e281d1c31df5a05e4f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:10.022866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:10.044902 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba278b2c-44d4-4cd7-a42b-b3ae4608a90e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:10.059530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38686a37-98d7-41c5-941b-131cde9ea10a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09e269ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:10.061037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38686a37-98d7-41c5-941b-131cde9ea10a admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.061531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38686a37-98d7-41c5-941b-131cde9ea10a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.062434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38686a37-98d7-41c5-941b-131cde9ea10a admin admin] PATH_INFO: `/v3/projects/54fc7bd4cd4041a59eef46f6a80fef57/users/63f79e62cbf54c5798619831a60bec86/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.069669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38686a37-98d7-41c5-941b-131cde9ea10a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fc7bd4cd4041a59eef46f6a80fef57, user_id=63f79e62cbf54c5798619831a60bec86, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:10.072756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38686a37-98d7-41c5-941b-131cde9ea10a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:10.088443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 875/1743] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:10 2022] PUT /identity/v3/projects/54fc7bd4cd4041a59eef46f6a80fef57/users/63f79e62cbf54c5798619831a60bec86/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:10.099399 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24120-4b6e-44a9-b888-b6c7e89160bb None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.100056 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24120-4b6e-44a9-b888-b6c7e89160bb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.100569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc24120-4b6e-44a9-b888-b6c7e89160bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.147038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-bfc24120-4b6e-44a9-b888-b6c7e89160bb None None] MFA Rules not processed for user `63f79e62cbf54c5798619831a60bec86`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:10.148681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-bfc24120-4b6e-44a9-b888-b6c7e89160bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:10.184877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1afc42fd1aac44e281d1c31df5a05e4f', 'request_id': 'req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.214062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1afc42fd1aac44e281d1c31df5a05e4f', 'request_id': 'req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.267588 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 876/1744] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:10 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:10.279236 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc24120-4b6e-44a9-b888-b6c7e89160bb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:10.280935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-bfc24120-4b6e-44a9-b888-b6c7e89160bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:10.305519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1afc42fd1aac44e281d1c31df5a05e4f', 'request_id': 'req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.323384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] The token cache is being invalidate because project 1afc42fd1aac44e281d1c31df5a05e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:10.325858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.327064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0e13b2f4-9ec7-41d3-95a3-252e5b7e64f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.330666 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 869/1745] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:09 2022] DELETE /identity/v3/projects/1afc42fd1aac44e281d1c31df5a05e4f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:10.337667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc34c4-817e-4ed9-a355-15cd3561242f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.337982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc34c4-817e-4ed9-a355-15cd3561242f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.343703 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc34c4-817e-4ed9-a355-15cd3561242f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.371768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-31fc34c4-817e-4ed9-a355-15cd3561242f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:10.372977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-31fc34c4-817e-4ed9-a355-15cd3561242f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:10.381783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc24120-4b6e-44a9-b888-b6c7e89160bb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:10.461014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de063df-1318-4b4a-9847-a44e1cb77d02 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09defe340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:10.461625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de063df-1318-4b4a-9847-a44e1cb77d02 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.461916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de063df-1318-4b4a-9847-a44e1cb77d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.462205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de063df-1318-4b4a-9847-a44e1cb77d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.463972 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4de063df-1318-4b4a-9847-a44e1cb77d02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:10.474598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 870/1746] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:10.476729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeb8bb-747d-4825-8da5-9e91491954e3 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.477240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeb8bb-747d-4825-8da5-9e91491954e3 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.477686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeb8bb-747d-4825-8da5-9e91491954e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.519247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-3afeb8bb-747d-4825-8da5-9e91491954e3 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:10.520731 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3afeb8bb-747d-4825-8da5-9e91491954e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:10.545453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 871/1747] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:10.546900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeb8bb-747d-4825-8da5-9e91491954e3 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:10.559805 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeb8bb-747d-4825-8da5-9e91491954e3 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:10.570557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf5729-c088-40e6-a626-ca40ee21aea1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09e98baf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:10.573181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5729-c088-40e6-a626-ca40ee21aea1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.574362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5729-c088-40e6-a626-ca40ee21aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.575317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5729-c088-40e6-a626-ca40ee21aea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.577169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf5729-c088-40e6-a626-ca40ee21aea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:10.577780 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf5729-c088-40e6-a626-ca40ee21aea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:10.580560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf5729-c088-40e6-a626-ca40ee21aea1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:10.586486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de063df-1318-4b4a-9847-a44e1cb77d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:10.589140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de063df-1318-4b4a-9847-a44e1cb77d02 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:10.604719 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 877/1748] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:10 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:10.605611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 872/1749] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:02:10.613666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de063df-1318-4b4a-9847-a44e1cb77d02 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:10.626187 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de063df-1318-4b4a-9847-a44e1cb77d02 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:10.632266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35284abb-0cb3-4186-8214-e12581396088 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09de55790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:10.633033 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35284abb-0cb3-4186-8214-e12581396088 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.633425 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35284abb-0cb3-4186-8214-e12581396088 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.633960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35284abb-0cb3-4186-8214-e12581396088 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.634701 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35284abb-0cb3-4186-8214-e12581396088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:10.638183 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35284abb-0cb3-4186-8214-e12581396088 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:10.644550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf5729-c088-40e6-a626-ca40ee21aea1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:10.646503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-43cf5729-c088-40e6-a626-ca40ee21aea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:10.661787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf5729-c088-40e6-a626-ca40ee21aea1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:10.669976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721b2cb-79b2-41db-b6dd-768130699fb6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09e687fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:10.671279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b2cb-79b2-41db-b6dd-768130699fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.673179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b2cb-79b2-41db-b6dd-768130699fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.674278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b2cb-79b2-41db-b6dd-768130699fb6 admin admin] PATH_INFO: `/v3/users/a56d685c5d9947c8a138d0b20ed60d65` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.675751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721b2cb-79b2-41db-b6dd-768130699fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a56d685c5d9947c8a138d0b20ed60d65)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:10.678208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721b2cb-79b2-41db-b6dd-768130699fb6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:10.827078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 878/1750] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:10 2022] POST /identity/v3/projects => generated 365 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:10.828342 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35284abb-0cb3-4186-8214-e12581396088 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:10.942866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35284abb-0cb3-4186-8214-e12581396088 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:10.950791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f448dd-cb1f-485a-9e6b-cd6d2e0d7257 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09e183310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:10.951453 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f448dd-cb1f-485a-9e6b-cd6d2e0d7257 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.951752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f448dd-cb1f-485a-9e6b-cd6d2e0d7257 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.953221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f448dd-cb1f-485a-9e6b-cd6d2e0d7257 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.953221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f448dd-cb1f-485a-9e6b-cd6d2e0d7257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:10.954633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f448dd-cb1f-485a-9e6b-cd6d2e0d7257 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:11.002313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4721b2cb-79b2-41db-b6dd-768130699fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a56d685c5d9947c8a138d0b20ed60d65'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.097005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4721b2cb-79b2-41db-b6dd-768130699fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a56d685c5d9947c8a138d0b20ed60d65'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.106521 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 879/1751] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:10 2022] POST /identity/v3/users => generated 283 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:11.111944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f448dd-cb1f-485a-9e6b-cd6d2e0d7257 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:11.138045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4721b2cb-79b2-41db-b6dd-768130699fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a56d685c5d9947c8a138d0b20ed60d65'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.139383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4721b2cb-79b2-41db-b6dd-768130699fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a56d685c5d9947c8a138d0b20ed60d65'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.140615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4721b2cb-79b2-41db-b6dd-768130699fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a56d685c5d9947c8a138d0b20ed60d65'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.145556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f448dd-cb1f-485a-9e6b-cd6d2e0d7257 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:11.159083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db2ad8-2981-4a26-aabe-60659fc1d21d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09de2f040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:11.159744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db2ad8-2981-4a26-aabe-60659fc1d21d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.160036 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db2ad8-2981-4a26-aabe-60659fc1d21d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.160322 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db2ad8-2981-4a26-aabe-60659fc1d21d admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.161072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db2ad8-2981-4a26-aabe-60659fc1d21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:11.162692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db2ad8-2981-4a26-aabe-60659fc1d21d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:11.169936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 873/1752] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:10 2022] DELETE /identity/v3/users/a56d685c5d9947c8a138d0b20ed60d65 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:11.174290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279d83-bd79-4cfe-bbd0-c408a63c7092 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.174596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279d83-bd79-4cfe-bbd0-c408a63c7092 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.174886 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279d83-bd79-4cfe-bbd0-c408a63c7092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.182282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 880/1753] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:11.188892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db2ad8-2981-4a26-aabe-60659fc1d21d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:11.197650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c7db2ad8-2981-4a26-aabe-60659fc1d21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:11.224735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db2ad8-2981-4a26-aabe-60659fc1d21d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:11.229525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f7279d83-bd79-4cfe-bbd0-c408a63c7092 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:11.232009 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f7279d83-bd79-4cfe-bbd0-c408a63c7092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:11.342259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 874/1754] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:11.342259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7279d83-bd79-4cfe-bbd0-c408a63c7092 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:11.346524 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f7279d83-bd79-4cfe-bbd0-c408a63c7092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:11.365462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7279d83-bd79-4cfe-bbd0-c408a63c7092 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:11.365759 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da9bdc-e05f-44a9-babd-f60ae82f509e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09de2f0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:11.366690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9bdc-e05f-44a9-babd-f60ae82f509e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.367438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9bdc-e05f-44a9-babd-f60ae82f509e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.367901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9bdc-e05f-44a9-babd-f60ae82f509e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.369194 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da9bdc-e05f-44a9-babd-f60ae82f509e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:11.370144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oORby3RfQ06RsV_Ygkoxqg, audit_chain_id=['oORby3RfQ06RsV_Ygkoxqg']) at 0x7fe09e20ef70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:11.371394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da9bdc-e05f-44a9-babd-f60ae82f509e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:11.371820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.372270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.372564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] PATH_INFO: `/v3/projects/d56e0b7868d74cefbed8c8426eb32394` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.373722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d56e0b7868d74cefbed8c8426eb32394)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:11.375679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:11.384557 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 881/1755] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:11.389081 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da9bdc-e05f-44a9-babd-f60ae82f509e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:11.400730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da9bdc-e05f-44a9-babd-f60ae82f509e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:11.406996 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c440d24-00c3-4471-9e67-916a53b19fb7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09e978730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:11.408234 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c440d24-00c3-4471-9e67-916a53b19fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.408705 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c440d24-00c3-4471-9e67-916a53b19fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.409293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c440d24-00c3-4471-9e67-916a53b19fb7 admin admin] PATH_INFO: `/v3/projects/2443d1d8403c422fb1f36e7d80482f73/users/c28f076980664d8b9c5d7c91bcada398/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.431858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c440d24-00c3-4471-9e67-916a53b19fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2443d1d8403c422fb1f36e7d80482f73, user_id=c28f076980664d8b9c5d7c91bcada398, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:11.434737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c440d24-00c3-4471-9e67-916a53b19fb7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:11.507873 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 882/1756] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:11 2022] PUT /identity/v3/projects/2443d1d8403c422fb1f36e7d80482f73/users/c28f076980664d8b9c5d7c91bcada398/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:11.508960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c440d24-00c3-4471-9e67-916a53b19fb7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:11.515232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-5c440d24-00c3-4471-9e67-916a53b19fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:11.524695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56e0b7868d74cefbed8c8426eb32394', 'request_id': 'req-4a6fb615-7080-4119-971f-610a0faa1880'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.544127 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56e0b7868d74cefbed8c8426eb32394', 'request_id': 'req-4a6fb615-7080-4119-971f-610a0faa1880'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.602979 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c440d24-00c3-4471-9e67-916a53b19fb7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:11.633108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56e0b7868d74cefbed8c8426eb32394', 'request_id': 'req-4a6fb615-7080-4119-971f-610a0faa1880'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.648351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] The token cache is being invalidate because project d56e0b7868d74cefbed8c8426eb32394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:11.649353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.650211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4a6fb615-7080-4119-971f-610a0faa1880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.652979 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 875/1757] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:11 2022] DELETE /identity/v3/projects/d56e0b7868d74cefbed8c8426eb32394 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:11.654564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa17a4-6663-420e-b147-b32098d06b3b None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.655003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa17a4-6663-420e-b147-b32098d06b3b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.655533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa17a4-6663-420e-b147-b32098d06b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.680754 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992eeac-f1c0-4da5-806c-81deb686ff9d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e8c6250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:11.681543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992eeac-f1c0-4da5-806c-81deb686ff9d service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.682022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992eeac-f1c0-4da5-806c-81deb686ff9d service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.682346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992eeac-f1c0-4da5-806c-81deb686ff9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.685135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2992eeac-f1c0-4da5-806c-81deb686ff9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:11.704348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-5dfa17a4-6663-420e-b147-b32098d06b3b None None] MFA Rules not processed for user `c28f076980664d8b9c5d7c91bcada398`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:11.705753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5dfa17a4-6663-420e-b147-b32098d06b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:11.787037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992eeac-f1c0-4da5-806c-81deb686ff9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:11.788516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992eeac-f1c0-4da5-806c-81deb686ff9d service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:11.799700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 883/1758] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:11.801040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862a579-3fce-436e-9804-eb734e53d907 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.801360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862a579-3fce-436e-9804-eb734e53d907 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.801623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862a579-3fce-436e-9804-eb734e53d907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.825385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 876/1759] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:11 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:11.826861 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-1862a579-3fce-436e-9804-eb734e53d907 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:11.827827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-1862a579-3fce-436e-9804-eb734e53d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:11.828849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa17a4-6663-420e-b147-b32098d06b3b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:11.830208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5dfa17a4-6663-420e-b147-b32098d06b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:11.835651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 884/1760] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:11.846235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1ae4e-3ace-4c30-887d-fb1f28991424 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.846535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1ae4e-3ace-4c30-887d-fb1f28991424 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.846820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1ae4e-3ace-4c30-887d-fb1f28991424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.852008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa17a4-6663-420e-b147-b32098d06b3b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:11.859023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e25299-2e82-4a16-9d99-0b65825a32eb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09e8a0670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:11.860292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e25299-2e82-4a16-9d99-0b65825a32eb admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.861243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e25299-2e82-4a16-9d99-0b65825a32eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.861730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e25299-2e82-4a16-9d99-0b65825a32eb admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.862690 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e25299-2e82-4a16-9d99-0b65825a32eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:11.864889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e25299-2e82-4a16-9d99-0b65825a32eb admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:11.873763 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-74d1ae4e-3ace-4c30-887d-fb1f28991424 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:11.874939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-74d1ae4e-3ace-4c30-887d-fb1f28991424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:11.887260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 885/1761] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:11.889221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1ae4e-3ace-4c30-887d-fb1f28991424 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:11.910976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1ae4e-3ace-4c30-887d-fb1f28991424 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:11.922629 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be97020-d880-4b6e-9901-c2f513432211 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09def9760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:11.923325 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be97020-d880-4b6e-9901-c2f513432211 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.923619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be97020-d880-4b6e-9901-c2f513432211 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.925052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be97020-d880-4b6e-9901-c2f513432211 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.925766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be97020-d880-4b6e-9901-c2f513432211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:11.930445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be97020-d880-4b6e-9901-c2f513432211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:11.944466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be97020-d880-4b6e-9901-c2f513432211 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:11.965362 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 886/1762] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:02:11.967097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921f4aa-40e7-49bf-9d7c-dfe7e4f33248 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.967520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921f4aa-40e7-49bf-9d7c-dfe7e4f33248 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.967903 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921f4aa-40e7-49bf-9d7c-dfe7e4f33248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.991707 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-e921f4aa-40e7-49bf-9d7c-dfe7e4f33248 None None] MFA Rules not processed for user `d7a958a47ae44558a637dbe34b5a8f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:11.992940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e921f4aa-40e7-49bf-9d7c-dfe7e4f33248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:12.069975 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 887/1763] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:11 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:12.070643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921f4aa-40e7-49bf-9d7c-dfe7e4f33248 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:12.082585 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921f4aa-40e7-49bf-9d7c-dfe7e4f33248 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:12.088345 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e4c57-b5c4-45e3-8016-05cd83a7118d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e705250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:12.088799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e4c57-b5c4-45e3-8016-05cd83a7118d admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:12.089049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e4c57-b5c4-45e3-8016-05cd83a7118d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:12.089958 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e4c57-b5c4-45e3-8016-05cd83a7118d admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:12.090669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e4c57-b5c4-45e3-8016-05cd83a7118d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:12.092886 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e4c57-b5c4-45e3-8016-05cd83a7118d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:12.122392 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 877/1764] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:11 2022] POST /identity/v3/projects => generated 365 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:12.126652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e25299-2e82-4a16-9d99-0b65825a32eb admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:12.208389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 888/1765] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:12 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:12.212916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e4c57-b5c4-45e3-8016-05cd83a7118d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:12.235300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e25299-2e82-4a16-9d99-0b65825a32eb admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:12.347203 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e4c57-b5c4-45e3-8016-05cd83a7118d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:12.353432 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991972d-20ef-4327-a2a9-89b6e30942d3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e4f36d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:12.354731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991972d-20ef-4327-a2a9-89b6e30942d3 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:12.355651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991972d-20ef-4327-a2a9-89b6e30942d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:12.355961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991972d-20ef-4327-a2a9-89b6e30942d3 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:12.356670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991972d-20ef-4327-a2a9-89b6e30942d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:12.361989 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991972d-20ef-4327-a2a9-89b6e30942d3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:12.428149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a62ff-2c24-4549-999e-a36862cdeb4f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09de8e430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:12.429099 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a62ff-2c24-4549-999e-a36862cdeb4f admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:12.429396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a62ff-2c24-4549-999e-a36862cdeb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:12.429865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a62ff-2c24-4549-999e-a36862cdeb4f admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:12.430659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a62ff-2c24-4549-999e-a36862cdeb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:12.432761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a62ff-2c24-4549-999e-a36862cdeb4f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:12.466703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 889/1766] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:12 2022] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:12.468088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991972d-20ef-4327-a2a9-89b6e30942d3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:12.482551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991972d-20ef-4327-a2a9-89b6e30942d3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:12.487716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f1fc1-5901-4816-9d3d-4481df813107 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e21bf70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:12.488333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f1fc1-5901-4816-9d3d-4481df813107 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:12.488633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f1fc1-5901-4816-9d3d-4481df813107 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:12.488922 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f1fc1-5901-4816-9d3d-4481df813107 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:12.489675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f1fc1-5901-4816-9d3d-4481df813107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:12.492835 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f1fc1-5901-4816-9d3d-4481df813107 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:12.508086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 890/1767] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:12.519412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f1fc1-5901-4816-9d3d-4481df813107 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:12.535766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f1fc1-5901-4816-9d3d-4481df813107 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:12.547845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 878/1768] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:12 2022] POST /identity/v3/users => generated 289 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:12.551851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a62ff-2c24-4549-999e-a36862cdeb4f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:12.562622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4626-4263-42b0-9c46-8f2fff92b1f3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e123f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:12.563745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4626-4263-42b0-9c46-8f2fff92b1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:12.565104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4626-4263-42b0-9c46-8f2fff92b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:12.565659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a62ff-2c24-4549-999e-a36862cdeb4f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:12.566111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4626-4263-42b0-9c46-8f2fff92b1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:12.567744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd4626-4263-42b0-9c46-8f2fff92b1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:12.570182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd4626-4263-42b0-9c46-8f2fff92b1f3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:12.570961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c8fcc-ff9a-4d11-960d-34d0d1987ed2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09e3e01f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:12.572135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c8fcc-ff9a-4d11-960d-34d0d1987ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:12.572432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c8fcc-ff9a-4d11-960d-34d0d1987ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:12.572722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c8fcc-ff9a-4d11-960d-34d0d1987ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:12.573779 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c8fcc-ff9a-4d11-960d-34d0d1987ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:12.575697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c8fcc-ff9a-4d11-960d-34d0d1987ed2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:12.586526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 891/1769] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:12.591328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4626-4263-42b0-9c46-8f2fff92b1f3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:12.595879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 879/1770] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:12.605929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4626-4263-42b0-9c46-8f2fff92b1f3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:12.611817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c8fcc-ff9a-4d11-960d-34d0d1987ed2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:12.614103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94978b-821c-47dd-bde3-4313e0f5ebc0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e183670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:12.615266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94978b-821c-47dd-bde3-4313e0f5ebc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:12.615643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94978b-821c-47dd-bde3-4313e0f5ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:12.617007 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94978b-821c-47dd-bde3-4313e0f5ebc0 admin admin] PATH_INFO: `/v3/projects/249ab902c57d4d1b91beddbeb18f7f8d/users/602384762b7f49ddafb2a4e5fc964405/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:12.626534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c8fcc-ff9a-4d11-960d-34d0d1987ed2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:12.633823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d506a1-f6b8-41dd-b9e3-2b8bc9112eb5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09e3e0fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:12.642247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94978b-821c-47dd-bde3-4313e0f5ebc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249ab902c57d4d1b91beddbeb18f7f8d, user_id=602384762b7f49ddafb2a4e5fc964405, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:12.645150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94978b-821c-47dd-bde3-4313e0f5ebc0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:12.651599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d506a1-f6b8-41dd-b9e3-2b8bc9112eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:12.653014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d506a1-f6b8-41dd-b9e3-2b8bc9112eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:12.653631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d506a1-f6b8-41dd-b9e3-2b8bc9112eb5 admin admin] PATH_INFO: `/v3/projects/5095c2037dd04c6085453b7075fae077/users/1b9c39e0e02a4c43a01c44d1d9412d68/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:12.680253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d506a1-f6b8-41dd-b9e3-2b8bc9112eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5095c2037dd04c6085453b7075fae077, user_id=1b9c39e0e02a4c43a01c44d1d9412d68, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:12.683104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d506a1-f6b8-41dd-b9e3-2b8bc9112eb5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:12.786612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 892/1771] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:12 2022] PUT /identity/v3/projects/249ab902c57d4d1b91beddbeb18f7f8d/users/602384762b7f49ddafb2a4e5fc964405/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:12.800183 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129be662-a4ec-493b-bb6b-94521970ad18 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:12.800183 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129be662-a4ec-493b-bb6b-94521970ad18 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:12.800450 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129be662-a4ec-493b-bb6b-94521970ad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:12.812659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 880/1772] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:12 2022] PUT /identity/v3/projects/5095c2037dd04c6085453b7075fae077/users/1b9c39e0e02a4c43a01c44d1d9412d68/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:12.814023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d506a1-f6b8-41dd-b9e3-2b8bc9112eb5 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:12.861238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-129be662-a4ec-493b-bb6b-94521970ad18 None None] MFA Rules not processed for user `602384762b7f49ddafb2a4e5fc964405`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:12.863084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-129be662-a4ec-493b-bb6b-94521970ad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:12.901066 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d506a1-f6b8-41dd-b9e3-2b8bc9112eb5 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:12.906979 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827661a-4e02-403b-85e5-89f32b76f360 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09de98ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:12.908142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827661a-4e02-403b-85e5-89f32b76f360 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:12.908642 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827661a-4e02-403b-85e5-89f32b76f360 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:12.909277 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827661a-4e02-403b-85e5-89f32b76f360 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:12.910389 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827661a-4e02-403b-85e5-89f32b76f360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:12.912207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827661a-4e02-403b-85e5-89f32b76f360 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:12.934087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 881/1773] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:12.935281 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827661a-4e02-403b-85e5-89f32b76f360 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:12.951546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827661a-4e02-403b-85e5-89f32b76f360 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:12.963527 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bae6f4-9593-4d32-ac84-600493057a4b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09e15bc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:12.967104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae6f4-9593-4d32-ac84-600493057a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:12.967533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae6f4-9593-4d32-ac84-600493057a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:12.967927 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae6f4-9593-4d32-ac84-600493057a4b admin admin] PATH_INFO: `/v3/projects/5095c2037dd04c6085453b7075fae077/users/1b9c39e0e02a4c43a01c44d1d9412d68/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:12.971938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bae6f4-9593-4d32-ac84-600493057a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5095c2037dd04c6085453b7075fae077, user_id=1b9c39e0e02a4c43a01c44d1d9412d68, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:12.979141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bae6f4-9593-4d32-ac84-600493057a4b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:13.022812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 882/1774] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:12 2022] PUT /identity/v3/projects/5095c2037dd04c6085453b7075fae077/users/1b9c39e0e02a4c43a01c44d1d9412d68/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:13.034871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d78346-a426-47c6-a10a-80425daf866c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:13.035729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d78346-a426-47c6-a10a-80425daf866c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:13.036019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d78346-a426-47c6-a10a-80425daf866c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:13.109107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 893/1775] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:12 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:13.113478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129be662-a4ec-493b-bb6b-94521970ad18 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:13.130688 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129be662-a4ec-493b-bb6b-94521970ad18 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:13.154365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-32d78346-a426-47c6-a10a-80425daf866c None None] MFA Rules not processed for user `1b9c39e0e02a4c43a01c44d1d9412d68`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:13.154365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-32d78346-a426-47c6-a10a-80425daf866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:13.252594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f718c-beb4-4846-bdd0-30c938726ba5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e4442e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:13.253963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f718c-beb4-4846-bdd0-30c938726ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:13.255033 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f718c-beb4-4846-bdd0-30c938726ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:13.255805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f718c-beb4-4846-bdd0-30c938726ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:13.257423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f718c-beb4-4846-bdd0-30c938726ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:13.260694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f718c-beb4-4846-bdd0-30c938726ba5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:13.298220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 883/1776] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:13 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:13.299348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d78346-a426-47c6-a10a-80425daf866c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:13.300704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-32d78346-a426-47c6-a10a-80425daf866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:13.321432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d78346-a426-47c6-a10a-80425daf866c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:13.326917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09e1d7ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:13.327808 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:13.328326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:13.328618 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] PATH_INFO: `/v3/projects/3192eeb422084f658a82e673fe2d7b59` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:13.329983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3192eeb422084f658a82e673fe2d7b59)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:13.332753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:13.382656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 894/1777] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:13 2022] POST /identity/v3/projects => generated 383 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:13.383284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f718c-beb4-4846-bdd0-30c938726ba5 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:13.388645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-fc9f718c-beb4-4846-bdd0-30c938726ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:13.492737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f718c-beb4-4846-bdd0-30c938726ba5 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:13.495091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3192eeb422084f658a82e673fe2d7b59', 'request_id': 'req-e0174ae4-3b87-481a-85e8-125a2b090968'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:13.517442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3192eeb422084f658a82e673fe2d7b59', 'request_id': 'req-e0174ae4-3b87-481a-85e8-125a2b090968'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:13.584156 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8487a8a-31b3-4908-8cf6-dafbabae9050 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e4c8100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:13.585014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8487a8a-31b3-4908-8cf6-dafbabae9050 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:13.585315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8487a8a-31b3-4908-8cf6-dafbabae9050 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:13.585600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8487a8a-31b3-4908-8cf6-dafbabae9050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:13.641950 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3192eeb422084f658a82e673fe2d7b59', 'request_id': 'req-e0174ae4-3b87-481a-85e8-125a2b090968'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:13.658794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] The token cache is being invalidate because project 3192eeb422084f658a82e673fe2d7b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:13.659081 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:13.661212 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:13.665190 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 884/1778] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:13 2022] DELETE /identity/v3/projects/3192eeb422084f658a82e673fe2d7b59 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:13.666257 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:13.672481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:13.700794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8487a8a-31b3-4908-8cf6-dafbabae9050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:13.703052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8487a8a-31b3-4908-8cf6-dafbabae9050 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:13.732729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 895/1779] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:13 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:13.736649 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8487a8a-31b3-4908-8cf6-dafbabae9050 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:13.773008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0174ae4-3b87-481a-85e8-125a2b090968 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:13.779266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b055f5-c736-47b8-9484-10362521ee6b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09de8ef70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:13.780071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b055f5-c736-47b8-9484-10362521ee6b admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:13.780535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b055f5-c736-47b8-9484-10362521ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:13.780819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b055f5-c736-47b8-9484-10362521ee6b admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:13.781462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b055f5-c736-47b8-9484-10362521ee6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:13.783460 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b055f5-c736-47b8-9484-10362521ee6b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:13.827140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8487a8a-31b3-4908-8cf6-dafbabae9050 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:13.832380 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe09e1057c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:13.833369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:13.833828 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:13.834295 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] PATH_INFO: `/v3/users/63f79e62cbf54c5798619831a60bec86` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:13.835680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f79e62cbf54c5798619831a60bec86)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:13.837786 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:13.929007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 885/1780] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:13 2022] POST /identity/v3/users => generated 298 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:13.930433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3825267-2e99-48c1-875f-62d8cfb33e66 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:13.930727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3825267-2e99-48c1-875f-62d8cfb33e66 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:13.931016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3825267-2e99-48c1-875f-62d8cfb33e66 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:13.937046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 886/1781] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 19:02:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:02:13.937931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3825267-2e99-48c1-875f-62d8cfb33e66 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:13.981978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3825267-2e99-48c1-875f-62d8cfb33e66 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:13.993776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63845-87a0-4f96-a07f-77dc11514e70 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09ddd8f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:13.994266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63845-87a0-4f96-a07f-77dc11514e70 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:13.994554 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63845-87a0-4f96-a07f-77dc11514e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:13.994834 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63845-87a0-4f96-a07f-77dc11514e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:13.995767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef63845-87a0-4f96-a07f-77dc11514e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:13.997474 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef63845-87a0-4f96-a07f-77dc11514e70 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:14.023439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 887/1782] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:14.024931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2c583-4f86-4096-a28a-bac8d956c41d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:14.025208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2c583-4f86-4096-a28a-bac8d956c41d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:14.025488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2c583-4f86-4096-a28a-bac8d956c41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:14.072144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d4d2c583-4f86-4096-a28a-bac8d956c41d None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:14.073317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d4d2c583-4f86-4096-a28a-bac8d956c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:14.159956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 888/1783] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 19:02:14 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:14.160713 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2c583-4f86-4096-a28a-bac8d956c41d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:14.173600 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2c583-4f86-4096-a28a-bac8d956c41d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:14.179064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4008098-6494-469e-bb08-11c07747a7a7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e411a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:14.179921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4008098-6494-469e-bb08-11c07747a7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:14.180204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4008098-6494-469e-bb08-11c07747a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:14.180481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4008098-6494-469e-bb08-11c07747a7a7 admin admin] PATH_INFO: `/v3/projects/badb8247563e471ca9e9a6ca269e8d83/users/e85b24f2079b4fecb5c61f6e57a58746/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:14.201924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4008098-6494-469e-bb08-11c07747a7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badb8247563e471ca9e9a6ca269e8d83, user_id=e85b24f2079b4fecb5c61f6e57a58746, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:14.204717 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4008098-6494-469e-bb08-11c07747a7a7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:14.297630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f79e62cbf54c5798619831a60bec86'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:14.327538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f79e62cbf54c5798619831a60bec86'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:14.328297 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f79e62cbf54c5798619831a60bec86'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:14.328913 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f79e62cbf54c5798619831a60bec86'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:14.334263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 889/1784] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:14 2022] PUT /identity/v3/projects/badb8247563e471ca9e9a6ca269e8d83/users/e85b24f2079b4fecb5c61f6e57a58746/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:14.338080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4008098-6494-469e-bb08-11c07747a7a7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:14.341367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d4008098-6494-469e-bb08-11c07747a7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:14.419409 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f79e62cbf54c5798619831a60bec86'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:14.441092 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 896/1785] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:13 2022] DELETE /identity/v3/users/63f79e62cbf54c5798619831a60bec86 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:14.444606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:14.452286 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:14.500287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4008098-6494-469e-bb08-11c07747a7a7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:14.565614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85066769-babe-4995-9249-55581cc9e5e7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:14.572368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae6ed3-0ad7-404e-825f-ff691ebab1e0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e8e0bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:14.573117 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6ed3-0ad7-404e-825f-ff691ebab1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:14.573245 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761126b-e83c-4d9c-8b6b-70489ccd5420 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e8c84f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:14.573561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6ed3-0ad7-404e-825f-ff691ebab1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:14.573960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6ed3-0ad7-404e-825f-ff691ebab1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:14.574225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761126b-e83c-4d9c-8b6b-70489ccd5420 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:14.574317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761126b-e83c-4d9c-8b6b-70489ccd5420 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:14.574594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761126b-e83c-4d9c-8b6b-70489ccd5420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:14.575461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae6ed3-0ad7-404e-825f-ff691ebab1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:14.578389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae6ed3-0ad7-404e-825f-ff691ebab1e0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:14.586937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c761126b-e83c-4d9c-8b6b-70489ccd5420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:14.612730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 897/1786] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:14.612730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae6ed3-0ad7-404e-825f-ff691ebab1e0 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:14.622056 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae6ed3-0ad7-404e-825f-ff691ebab1e0 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:14.634554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d58df-e71d-4178-a2f9-e8c830f8481d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e78ed30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:14.635443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d58df-e71d-4178-a2f9-e8c830f8481d admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:14.635737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d58df-e71d-4178-a2f9-e8c830f8481d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:14.636051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d58df-e71d-4178-a2f9-e8c830f8481d admin admin] PATH_INFO: `/v3/projects/badb8247563e471ca9e9a6ca269e8d83/users/e85b24f2079b4fecb5c61f6e57a58746/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:14.639647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d58df-e71d-4178-a2f9-e8c830f8481d admin admin] RBAC: Authorizing `identity:create_grant(project_id=badb8247563e471ca9e9a6ca269e8d83, user_id=e85b24f2079b4fecb5c61f6e57a58746, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:14.644718 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d58df-e71d-4178-a2f9-e8c830f8481d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:14.687073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 898/1787] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:14 2022] PUT /identity/v3/projects/badb8247563e471ca9e9a6ca269e8d83/users/e85b24f2079b4fecb5c61f6e57a58746/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:14.696905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72448a2b-2e86-40b0-ba84-dad741aa9371 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:14.697204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72448a2b-2e86-40b0-ba84-dad741aa9371 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:14.697499 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72448a2b-2e86-40b0-ba84-dad741aa9371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:14.704843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761126b-e83c-4d9c-8b6b-70489ccd5420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:14.706611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761126b-e83c-4d9c-8b6b-70489ccd5420 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:14.716711 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 890/1788] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:14 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:14.738117 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-72448a2b-2e86-40b0-ba84-dad741aa9371 None None] MFA Rules not processed for user `e85b24f2079b4fecb5c61f6e57a58746`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:14.739610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-72448a2b-2e86-40b0-ba84-dad741aa9371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:14.826792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761126b-e83c-4d9c-8b6b-70489ccd5420 service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:14.828329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c761126b-e83c-4d9c-8b6b-70489ccd5420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:14.861677 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 899/1789] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:14 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:14.878102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72448a2b-2e86-40b0-ba84-dad741aa9371 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:14.879508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-72448a2b-2e86-40b0-ba84-dad741aa9371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:14.976626 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761126b-e83c-4d9c-8b6b-70489ccd5420 service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:14.982514 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72448a2b-2e86-40b0-ba84-dad741aa9371 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:14.988222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072063e-2bf3-4b97-a4ec-bfd23b7137b2 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09ea9a040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:14.989423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072063e-2bf3-4b97-a4ec-bfd23b7137b2 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:14.990106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072063e-2bf3-4b97-a4ec-bfd23b7137b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:14.990725 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072063e-2bf3-4b97-a4ec-bfd23b7137b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:15.005205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072063e-2bf3-4b97-a4ec-bfd23b7137b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:15.007510 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072063e-2bf3-4b97-a4ec-bfd23b7137b2 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:15.036021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 900/1790] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:14 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:02:15.112893 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd3a53-bd9c-4635-bc5a-bef38aa8061e service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=VPv8sXhDS8CbQz_czxciPg, audit_chain_id=['VPv8sXhDS8CbQz_czxciPg']) at 0x7fe09e795ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:15.113874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd3a53-bd9c-4635-bc5a-bef38aa8061e service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:15.114621 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd3a53-bd9c-4635-bc5a-bef38aa8061e service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:15.115500 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd3a53-bd9c-4635-bc5a-bef38aa8061e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:15.119431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-cffd3a53-bd9c-4635-bc5a-bef38aa8061e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:15.133550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd3a53-bd9c-4635-bc5a-bef38aa8061e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:15.135150 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd3a53-bd9c-4635-bc5a-bef38aa8061e service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:15.146373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 891/1791] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:14 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:02:15.227812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072063e-2bf3-4b97-a4ec-bfd23b7137b2 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:15.237374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072063e-2bf3-4b97-a4ec-bfd23b7137b2 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:15.240437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c7f83-20bd-4aec-a140-7b36e62f051d service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e55f820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:15.241012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c7f83-20bd-4aec-a140-7b36e62f051d service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:15.244176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c7f83-20bd-4aec-a140-7b36e62f051d service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:15.244176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c7f83-20bd-4aec-a140-7b36e62f051d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:15.244176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a08c7f83-20bd-4aec-a140-7b36e62f051d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:15.357721 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c7f83-20bd-4aec-a140-7b36e62f051d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:15.359278 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c7f83-20bd-4aec-a140-7b36e62f051d service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:15.369826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 901/1792] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:15 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:15.580893 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd3a53-bd9c-4635-bc5a-bef38aa8061e service nova] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:15.582282 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-cffd3a53-bd9c-4635-bc5a-bef38aa8061e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:15.730501 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd3a53-bd9c-4635-bc5a-bef38aa8061e service nova] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:15.731898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mx-wRu4QASgQXtytgVLxg, audit_chain_id=['6mx-wRu4QASgQXtytgVLxg']) at 0x7fe0a38b1910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:15.732901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:15.733348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:15.733795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] PATH_INFO: `/v3/projects/54fc7bd4cd4041a59eef46f6a80fef57` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:15.735033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fc7bd4cd4041a59eef46f6a80fef57)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:15.737023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:16.504090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fc7bd4cd4041a59eef46f6a80fef57', 'request_id': 'req-49760d42-ad78-484f-a0a9-95e88e1447e3'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:16.520220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fc7bd4cd4041a59eef46f6a80fef57', 'request_id': 'req-49760d42-ad78-484f-a0a9-95e88e1447e3'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:16.672488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fc7bd4cd4041a59eef46f6a80fef57', 'request_id': 'req-49760d42-ad78-484f-a0a9-95e88e1447e3'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:16.684116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] The token cache is being invalidate because project 54fc7bd4cd4041a59eef46f6a80fef57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:16.684404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:16.685048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:16.686605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 892/1793] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:15 2022] DELETE /identity/v3/projects/54fc7bd4cd4041a59eef46f6a80fef57 => generated 0 bytes in 1106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:16.691479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f709e-69e7-40cc-aeb5-5e089afa2643 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:16.692003 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f709e-69e7-40cc-aeb5-5e089afa2643 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:16.692097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f709e-69e7-40cc-aeb5-5e089afa2643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:16.719065 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-d32f709e-69e7-40cc-aeb5-5e089afa2643 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:16.720968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d32f709e-69e7-40cc-aeb5-5e089afa2643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:16.740453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:16.741834 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:16.813126 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 902/1794] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:16.820982 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a26c79-82a6-43ef-a6c0-a6e45e1a430c None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:16.821310 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a26c79-82a6-43ef-a6c0-a6e45e1a430c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:16.821785 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a26c79-82a6-43ef-a6c0-a6e45e1a430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:16.855882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-c1a26c79-82a6-43ef-a6c0-a6e45e1a430c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:16.857370 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c1a26c79-82a6-43ef-a6c0-a6e45e1a430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:16.857761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49760d42-ad78-484f-a0a9-95e88e1447e3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:16.863233 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcfd58-73f9-482b-8995-0802944910e4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e716250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:16.864107 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcfd58-73f9-482b-8995-0802944910e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:16.864391 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcfd58-73f9-482b-8995-0802944910e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:16.864840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcfd58-73f9-482b-8995-0802944910e4 admin admin] PATH_INFO: `/v3/users/602384762b7f49ddafb2a4e5fc964405` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:16.866217 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bcfd58-73f9-482b-8995-0802944910e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=602384762b7f49ddafb2a4e5fc964405)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:16.866792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 903/1795] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:16.868696 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bcfd58-73f9-482b-8995-0802944910e4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:16.871439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a26c79-82a6-43ef-a6c0-a6e45e1a430c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:16.888306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a26c79-82a6-43ef-a6c0-a6e45e1a430c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:16.893389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61b481-5840-4a7a-9104-cfc1a782cdb4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09de565e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:16.894014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61b481-5840-4a7a-9104-cfc1a782cdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:16.894310 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61b481-5840-4a7a-9104-cfc1a782cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:16.894735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61b481-5840-4a7a-9104-cfc1a782cdb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:16.895682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61b481-5840-4a7a-9104-cfc1a782cdb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:16.895804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61b481-5840-4a7a-9104-cfc1a782cdb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:16.897456 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61b481-5840-4a7a-9104-cfc1a782cdb4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:16.913569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 904/1796] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:02:16.919162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61b481-5840-4a7a-9104-cfc1a782cdb4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:16.931535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61b481-5840-4a7a-9104-cfc1a782cdb4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:16.936539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11106f91-3a8d-465e-b480-1cc77d96130d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09e269e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:16.942197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106f91-3a8d-465e-b480-1cc77d96130d admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:16.942197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106f91-3a8d-465e-b480-1cc77d96130d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:16.942197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106f91-3a8d-465e-b480-1cc77d96130d admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:16.942197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11106f91-3a8d-465e-b480-1cc77d96130d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:16.942197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11106f91-3a8d-465e-b480-1cc77d96130d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:17.044359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 905/1797] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:16 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:17.055843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11106f91-3a8d-465e-b480-1cc77d96130d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:17.082325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-09bcfd58-73f9-482b-8995-0802944910e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602384762b7f49ddafb2a4e5fc964405'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:17.158145 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-09bcfd58-73f9-482b-8995-0802944910e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602384762b7f49ddafb2a4e5fc964405'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:17.177959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11106f91-3a8d-465e-b480-1cc77d96130d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:17.178378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-09bcfd58-73f9-482b-8995-0802944910e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602384762b7f49ddafb2a4e5fc964405'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:17.179372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-09bcfd58-73f9-482b-8995-0802944910e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602384762b7f49ddafb2a4e5fc964405'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:17.180382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-09bcfd58-73f9-482b-8995-0802944910e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602384762b7f49ddafb2a4e5fc964405'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:17.184148 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a5928-276d-413f-8656-f0a7e478c726 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09ddfd400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:17.191811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5928-276d-413f-8656-f0a7e478c726 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:17.192469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5928-276d-413f-8656-f0a7e478c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:17.192957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5928-276d-413f-8656-f0a7e478c726 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:17.194191 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a5928-276d-413f-8656-f0a7e478c726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:17.196723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a5928-276d-413f-8656-f0a7e478c726 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:17.200231 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 893/1798] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:16 2022] DELETE /identity/v3/users/602384762b7f49ddafb2a4e5fc964405 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:17.205737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cba50-8848-4813-9531-f17621001e09 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:17.206032 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cba50-8848-4813-9531-f17621001e09 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:17.206320 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cba50-8848-4813-9531-f17621001e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:17.233179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-0a5cba50-8848-4813-9531-f17621001e09 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:17.235499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-0a5cba50-8848-4813-9531-f17621001e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:17.334301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 906/1799] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:17 2022] POST /identity/v3/users => generated 294 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:17.336242 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a5928-276d-413f-8656-f0a7e478c726 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:17.340491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-281a5928-276d-413f-8656-f0a7e478c726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:17.346543 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 894/1800] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:17.358586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cba50-8848-4813-9531-f17621001e09 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:17.365117 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-0a5cba50-8848-4813-9531-f17621001e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:17.391928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a5928-276d-413f-8656-f0a7e478c726 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:17.412189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f5ba-7ac6-4bb0-baf8-1a93000ee407 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09ea9a040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:17.413494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f5ba-7ac6-4bb0-baf8-1a93000ee407 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:17.413790 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f5ba-7ac6-4bb0-baf8-1a93000ee407 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:17.414077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f5ba-7ac6-4bb0-baf8-1a93000ee407 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:17.414792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2f5ba-7ac6-4bb0-baf8-1a93000ee407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:17.425901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2f5ba-7ac6-4bb0-baf8-1a93000ee407 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:17.459928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 907/1801] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:17.465047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f5ba-7ac6-4bb0-baf8-1a93000ee407 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:17.496644 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f5ba-7ac6-4bb0-baf8-1a93000ee407 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:17.519411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd828501-6900-43cc-a5c3-b59e28ad3e0e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09dec14f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:17.520059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd828501-6900-43cc-a5c3-b59e28ad3e0e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:17.520359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd828501-6900-43cc-a5c3-b59e28ad3e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:17.520650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd828501-6900-43cc-a5c3-b59e28ad3e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:17.521372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd828501-6900-43cc-a5c3-b59e28ad3e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:17.523127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd828501-6900-43cc-a5c3-b59e28ad3e0e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:17.560976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cba50-8848-4813-9531-f17621001e09 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:17.561305 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 908/1802] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:17.565424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd828501-6900-43cc-a5c3-b59e28ad3e0e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:17.568914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be539e5-35df-43a0-8f7f-650100d42d48 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e8a0670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:17.570027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be539e5-35df-43a0-8f7f-650100d42d48 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:17.570027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be539e5-35df-43a0-8f7f-650100d42d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:17.570216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be539e5-35df-43a0-8f7f-650100d42d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:17.579443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd828501-6900-43cc-a5c3-b59e28ad3e0e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:17.581206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be539e5-35df-43a0-8f7f-650100d42d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:17.583052 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be539e5-35df-43a0-8f7f-650100d42d48 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:17.585457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caa5b7-e277-4b9b-800a-0a595549617c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09de0c4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:17.587551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caa5b7-e277-4b9b-800a-0a595549617c admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:17.588136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caa5b7-e277-4b9b-800a-0a595549617c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:17.588771 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caa5b7-e277-4b9b-800a-0a595549617c admin admin] PATH_INFO: `/v3/projects/398e5b71c4dd48c08f66291285f2e8d4/users/ee4fa9467a064fca9e3f7339c42a692a/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:17.595693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 895/1803] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:17.653024 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0caa5b7-e277-4b9b-800a-0a595549617c admin admin] RBAC: Authorizing `identity:create_grant(project_id=398e5b71c4dd48c08f66291285f2e8d4, user_id=ee4fa9467a064fca9e3f7339c42a692a, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:17.658388 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0caa5b7-e277-4b9b-800a-0a595549617c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:17.747294 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 909/1804] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:17 2022] PUT /identity/v3/projects/398e5b71c4dd48c08f66291285f2e8d4/users/ee4fa9467a064fca9e3f7339c42a692a/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:17.757343 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c08125-1af3-45c8-9dea-3ada333743ad None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:17.757854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c08125-1af3-45c8-9dea-3ada333743ad None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:17.757955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c08125-1af3-45c8-9dea-3ada333743ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:17.814745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-20c08125-1af3-45c8-9dea-3ada333743ad None None] MFA Rules not processed for user `ee4fa9467a064fca9e3f7339c42a692a`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:17.816221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-20c08125-1af3-45c8-9dea-3ada333743ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:17.984238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 896/1805] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:17 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:17.989002 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caa5b7-e277-4b9b-800a-0a595549617c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:18.132374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caa5b7-e277-4b9b-800a-0a595549617c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:18.137191 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6384183-bb6e-4aae-9542-603cd9ec0e38 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09e4ef0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:18.142961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6384183-bb6e-4aae-9542-603cd9ec0e38 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:18.142961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6384183-bb6e-4aae-9542-603cd9ec0e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:18.142961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6384183-bb6e-4aae-9542-603cd9ec0e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:18.142961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6384183-bb6e-4aae-9542-603cd9ec0e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:18.142961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6384183-bb6e-4aae-9542-603cd9ec0e38 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:18.281616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 910/1806] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:17 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:18.289106 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c08125-1af3-45c8-9dea-3ada333743ad None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:18.303309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c08125-1af3-45c8-9dea-3ada333743ad None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:18.394179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a21f4-6c40-4b58-abe3-e2d88ece8d1c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09e1b0f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:18.394817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a21f4-6c40-4b58-abe3-e2d88ece8d1c admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:18.395129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a21f4-6c40-4b58-abe3-e2d88ece8d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:18.395430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a21f4-6c40-4b58-abe3-e2d88ece8d1c admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:18.396090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a21f4-6c40-4b58-abe3-e2d88ece8d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:18.402709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a21f4-6c40-4b58-abe3-e2d88ece8d1c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:18.533069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 897/1807] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:18 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:18.534345 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6384183-bb6e-4aae-9542-603cd9ec0e38 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:18.544516 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a21f4-6c40-4b58-abe3-e2d88ece8d1c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:18.548622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-325a21f4-6c40-4b58-abe3-e2d88ece8d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:18.560697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a21f4-6c40-4b58-abe3-e2d88ece8d1c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:18.563204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6384183-bb6e-4aae-9542-603cd9ec0e38 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:18.565602 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e3632b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:18.566546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:18.566917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:18.567919 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] PATH_INFO: `/v3/projects/249ab902c57d4d1b91beddbeb18f7f8d` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:18.568867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=249ab902c57d4d1b91beddbeb18f7f8d)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:18.571212 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:18.572739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec962fc-b4d9-4bcb-84da-b1522ff655d1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09e3b5bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:18.573545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec962fc-b4d9-4bcb-84da-b1522ff655d1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:18.573773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec962fc-b4d9-4bcb-84da-b1522ff655d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:18.574496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec962fc-b4d9-4bcb-84da-b1522ff655d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:18.576645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec962fc-b4d9-4bcb-84da-b1522ff655d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:18.582125 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec962fc-b4d9-4bcb-84da-b1522ff655d1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:18.613932 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 911/1808] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:18.618159 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec962fc-b4d9-4bcb-84da-b1522ff655d1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:18.629333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec962fc-b4d9-4bcb-84da-b1522ff655d1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:18.639574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db309b-3b91-48e0-aac3-db000e7d561d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09de9d760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:18.640426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db309b-3b91-48e0-aac3-db000e7d561d admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:18.641103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db309b-3b91-48e0-aac3-db000e7d561d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:18.641390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db309b-3b91-48e0-aac3-db000e7d561d admin admin] PATH_INFO: `/v3/projects/d52b8596e086477494b97e85831b25e1/users/13a0704cbe51474b8e2f9dc7c7debd91/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:18.676094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db309b-3b91-48e0-aac3-db000e7d561d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52b8596e086477494b97e85831b25e1, user_id=13a0704cbe51474b8e2f9dc7c7debd91, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:18.682427 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db309b-3b91-48e0-aac3-db000e7d561d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:18.783857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 912/1809] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:18 2022] PUT /identity/v3/projects/d52b8596e086477494b97e85831b25e1/users/13a0704cbe51474b8e2f9dc7c7debd91/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:18.790233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db309b-3b91-48e0-aac3-db000e7d561d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:18.832044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249ab902c57d4d1b91beddbeb18f7f8d', 'request_id': 'req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:18.854538 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249ab902c57d4d1b91beddbeb18f7f8d', 'request_id': 'req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:18.969415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db309b-3b91-48e0-aac3-db000e7d561d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:19.019220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249ab902c57d4d1b91beddbeb18f7f8d', 'request_id': 'req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:19.035865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] The token cache is being invalidate because project 249ab902c57d4d1b91beddbeb18f7f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:19.036627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:19.038143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:19.040404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 898/1810] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:18 2022] DELETE /identity/v3/projects/249ab902c57d4d1b91beddbeb18f7f8d => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:19.045241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:19.050127 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:19.118552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2eb77-257b-46aa-99e1-24790964d0d3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09e105d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:19.119654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2eb77-257b-46aa-99e1-24790964d0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:19.120112 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2eb77-257b-46aa-99e1-24790964d0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:19.130791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2eb77-257b-46aa-99e1-24790964d0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:19.132956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2eb77-257b-46aa-99e1-24790964d0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:19.136647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2eb77-257b-46aa-99e1-24790964d0d3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:19.153295 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 913/1811] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:19.154684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2eb77-257b-46aa-99e1-24790964d0d3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:19.156585 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3dc2eb77-257b-46aa-99e1-24790964d0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:19.169016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd89cd-6bbc-4a1c-abf2-c1fa0d319a9d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:19.175782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e50f460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:19.176838 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:19.177415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:19.177872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] PATH_INFO: `/v3/users/e85b24f2079b4fecb5c61f6e57a58746` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:19.179864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85b24f2079b4fecb5c61f6e57a58746)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:19.182941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:19.201912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2eb77-257b-46aa-99e1-24790964d0d3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:19.213473 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3cac7-b130-4467-ac25-8cc403d8ad73 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09de2f040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:19.214894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3cac7-b130-4467-ac25-8cc403d8ad73 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:19.215226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3cac7-b130-4467-ac25-8cc403d8ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:19.215647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3cac7-b130-4467-ac25-8cc403d8ad73 admin admin] PATH_INFO: `/v3/projects/d52b8596e086477494b97e85831b25e1/users/13a0704cbe51474b8e2f9dc7c7debd91/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:19.217904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3cac7-b130-4467-ac25-8cc403d8ad73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52b8596e086477494b97e85831b25e1, user_id=13a0704cbe51474b8e2f9dc7c7debd91, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:19.221704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3cac7-b130-4467-ac25-8cc403d8ad73 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:19.253396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 914/1812] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:19 2022] PUT /identity/v3/projects/d52b8596e086477494b97e85831b25e1/users/13a0704cbe51474b8e2f9dc7c7debd91/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:19.255435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15990da-04c7-41f4-96a7-2e8a8ac16a8f None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:19.255743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15990da-04c7-41f4-96a7-2e8a8ac16a8f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:19.256044 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15990da-04c7-41f4-96a7-2e8a8ac16a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:19.328128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f15990da-04c7-41f4-96a7-2e8a8ac16a8f None None] MFA Rules not processed for user `13a0704cbe51474b8e2f9dc7c7debd91`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:19.329361 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f15990da-04c7-41f4-96a7-2e8a8ac16a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:19.414003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85b24f2079b4fecb5c61f6e57a58746'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:19.526156 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 915/1813] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:19 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:19.527730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15990da-04c7-41f4-96a7-2e8a8ac16a8f None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:19.529494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f15990da-04c7-41f4-96a7-2e8a8ac16a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:19.534449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85b24f2079b4fecb5c61f6e57a58746'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:19.554172 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85b24f2079b4fecb5c61f6e57a58746'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:19.556024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85b24f2079b4fecb5c61f6e57a58746'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:19.560084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85b24f2079b4fecb5c61f6e57a58746'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:19.618837 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 899/1814] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:19 2022] DELETE /identity/v3/users/e85b24f2079b4fecb5c61f6e57a58746 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:19.679213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15990da-04c7-41f4-96a7-2e8a8ac16a8f None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:19.786832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49afd5-c551-4709-9fd9-a2911aa20fff service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09de8abb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:19.787538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49afd5-c551-4709-9fd9-a2911aa20fff service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:19.788326 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49afd5-c551-4709-9fd9-a2911aa20fff service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:19.788326 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49afd5-c551-4709-9fd9-a2911aa20fff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:19.790937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8f49afd5-c551-4709-9fd9-a2911aa20fff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:19.904509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49afd5-c551-4709-9fd9-a2911aa20fff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:19.906273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49afd5-c551-4709-9fd9-a2911aa20fff service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:19.982355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 916/1815] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:19 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:02:20.036896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:20.038449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:20.192998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc92e2-fc5a-4778-8686-776788f6f8eb admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:20.198209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09e37fac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:20.199234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:20.199592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:20.199941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] PATH_INFO: `/v3/users/ee4fa9467a064fca9e3f7339c42a692a` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:20.201360 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4fa9467a064fca9e3f7339c42a692a)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:20.203603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:20.399012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4fa9467a064fca9e3f7339c42a692a'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:20.461165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4fa9467a064fca9e3f7339c42a692a'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:20.479351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4fa9467a064fca9e3f7339c42a692a'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:20.480794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4fa9467a064fca9e3f7339c42a692a'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:20.481592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4fa9467a064fca9e3f7339c42a692a'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:20.504756 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 900/1816] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:20 2022] DELETE /identity/v3/users/ee4fa9467a064fca9e3f7339c42a692a => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:20.509232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47919f-e02d-4f61-97d9-070f0192b031 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:20.509532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47919f-e02d-4f61-97d9-070f0192b031 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:20.509819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47919f-e02d-4f61-97d9-070f0192b031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:20.536394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-7b47919f-e02d-4f61-97d9-070f0192b031 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:20.537962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7b47919f-e02d-4f61-97d9-070f0192b031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:20.617961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 917/1817] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:20.665584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:20.667647 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:20.762431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519693-9da6-4ed5-8124-fab631a0c9f0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:20.766410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda056dc-e6b9-40d3-86c3-3e92efd1064d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e472550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:20.767081 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda056dc-e6b9-40d3-86c3-3e92efd1064d service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:20.767715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda056dc-e6b9-40d3-86c3-3e92efd1064d service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:20.768066 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda056dc-e6b9-40d3-86c3-3e92efd1064d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:20.779875 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda056dc-e6b9-40d3-86c3-3e92efd1064d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:20.781460 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda056dc-e6b9-40d3-86c3-3e92efd1064d service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:20.794318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 901/1818] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:21.240129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47919f-e02d-4f61-97d9-070f0192b031 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:21.241778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7b47919f-e02d-4f61-97d9-070f0192b031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:21.257247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47919f-e02d-4f61-97d9-070f0192b031 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:21.273193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=G6lFIySvQaqyh4q4xJr1ow, audit_chain_id=['G6lFIySvQaqyh4q4xJr1ow']) at 0x7fe09e25bd90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:21.274101 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:21.274393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:21.274678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] PATH_INFO: `/v3/projects/badb8247563e471ca9e9a6ca269e8d83` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:21.276179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=badb8247563e471ca9e9a6ca269e8d83)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:21.281017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:21.381760 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badb8247563e471ca9e9a6ca269e8d83', 'request_id': 'req-1f0a7c42-6832-47ac-a58c-74be4315bef5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:21.461296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badb8247563e471ca9e9a6ca269e8d83', 'request_id': 'req-1f0a7c42-6832-47ac-a58c-74be4315bef5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:21.475451 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badb8247563e471ca9e9a6ca269e8d83', 'request_id': 'req-1f0a7c42-6832-47ac-a58c-74be4315bef5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:21.488784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] The token cache is being invalidate because project badb8247563e471ca9e9a6ca269e8d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:21.489115 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:21.489800 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1f0a7c42-6832-47ac-a58c-74be4315bef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:21.498813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da775a-c1f9-42be-baa8-65e893158c11 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:21.498813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da775a-c1f9-42be-baa8-65e893158c11 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:21.499300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da775a-c1f9-42be-baa8-65e893158c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:21.500695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 918/1819] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:21 2022] DELETE /identity/v3/projects/badb8247563e471ca9e9a6ca269e8d83 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:21.549311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c6da775a-c1f9-42be-baa8-65e893158c11 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:21.550869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c6da775a-c1f9-42be-baa8-65e893158c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:21.646417 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 902/1820] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:21.660139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a2271-851c-4143-a8a8-a179257c8c86 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:21.660718 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a2271-851c-4143-a8a8-a179257c8c86 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:21.661109 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a2271-851c-4143-a8a8-a179257c8c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:21.690800 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-887a2271-851c-4143-a8a8-a179257c8c86 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:21.692026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-887a2271-851c-4143-a8a8-a179257c8c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:21.701105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 919/1821] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:21.705507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da775a-c1f9-42be-baa8-65e893158c11 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:21.715689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da775a-c1f9-42be-baa8-65e893158c11 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:21.720585 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b488b6-75db-465d-8c22-ec8ee70ee44c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e3bf820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:21.721187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b488b6-75db-465d-8c22-ec8ee70ee44c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:21.721474 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b488b6-75db-465d-8c22-ec8ee70ee44c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:21.721760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b488b6-75db-465d-8c22-ec8ee70ee44c admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:21.722449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b488b6-75db-465d-8c22-ec8ee70ee44c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:21.722745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b488b6-75db-465d-8c22-ec8ee70ee44c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:21.724372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b488b6-75db-465d-8c22-ec8ee70ee44c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:21.742716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a2271-851c-4143-a8a8-a179257c8c86 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:21.749632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 903/1822] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:02:21.752965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a2271-851c-4143-a8a8-a179257c8c86 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:21.758220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e9406-ddca-430e-8ae7-b2de388b4773 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e212790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:21.759077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9406-ddca-430e-8ae7-b2de388b4773 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:21.759455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9406-ddca-430e-8ae7-b2de388b4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:21.759754 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9406-ddca-430e-8ae7-b2de388b4773 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:21.760406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e9406-ddca-430e-8ae7-b2de388b4773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:21.762966 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e9406-ddca-430e-8ae7-b2de388b4773 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:21.844758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b488b6-75db-465d-8c22-ec8ee70ee44c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:21.846641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-48b488b6-75db-465d-8c22-ec8ee70ee44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:21.858751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b488b6-75db-465d-8c22-ec8ee70ee44c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:21.863141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09e3bf8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:21.863909 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:21.864198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:21.864476 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] PATH_INFO: `/v3/projects/398e5b71c4dd48c08f66291285f2e8d4` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:21.865590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] RBAC: Authorizing `identity:delete_project(project_id=398e5b71c4dd48c08f66291285f2e8d4)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:21.867547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:21.901292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 920/1823] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:21 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:21.905681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e9406-ddca-430e-8ae7-b2de388b4773 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:21.974022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e9406-ddca-430e-8ae7-b2de388b4773 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:21.978552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6f058-b653-46f7-b447-6af7d702bd3f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09de9d910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:21.979172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6f058-b653-46f7-b447-6af7d702bd3f admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:21.980021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6f058-b653-46f7-b447-6af7d702bd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:21.980553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6f058-b653-46f7-b447-6af7d702bd3f admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:21.981284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6f058-b653-46f7-b447-6af7d702bd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:21.983312 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6f058-b653-46f7-b447-6af7d702bd3f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:22.004979 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398e5b71c4dd48c08f66291285f2e8d4', 'request_id': 'req-dd18a1e8-fbee-45f1-bc20-0821acab197b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:22.019161 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398e5b71c4dd48c08f66291285f2e8d4', 'request_id': 'req-dd18a1e8-fbee-45f1-bc20-0821acab197b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:22.138977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398e5b71c4dd48c08f66291285f2e8d4', 'request_id': 'req-dd18a1e8-fbee-45f1-bc20-0821acab197b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:22.147919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 921/1824] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:21 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:22.149117 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6f058-b653-46f7-b447-6af7d702bd3f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:22.150349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] The token cache is being invalidate because project 398e5b71c4dd48c08f66291285f2e8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:22.150691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:22.151392 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:22.155863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 904/1825] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:21 2022] DELETE /identity/v3/projects/398e5b71c4dd48c08f66291285f2e8d4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:22.156868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:22.158219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:22.159502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6f058-b653-46f7-b447-6af7d702bd3f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:22.254821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a57dc0-7242-49d8-8914-dc81011f9242 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09de9d130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:22.256501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a57dc0-7242-49d8-8914-dc81011f9242 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:22.257005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a57dc0-7242-49d8-8914-dc81011f9242 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:22.257486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a57dc0-7242-49d8-8914-dc81011f9242 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:22.261973 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a57dc0-7242-49d8-8914-dc81011f9242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:22.264096 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a57dc0-7242-49d8-8914-dc81011f9242 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:22.270549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18a1e8-fbee-45f1-bc20-0821acab197b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:22.290084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 922/1826] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:22.290951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09e37f6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:22.291817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:22.294386 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:22.294386 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] PATH_INFO: `/v3/users/13a0704cbe51474b8e2f9dc7c7debd91` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:22.294386 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a0704cbe51474b8e2f9dc7c7debd91)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:22.298070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a57dc0-7242-49d8-8914-dc81011f9242 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:22.298612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e9a57dc0-7242-49d8-8914-dc81011f9242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:22.303609 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:22.314108 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a57dc0-7242-49d8-8914-dc81011f9242 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:22.318850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204af5a8-65f3-4bf8-9a9c-4db9c09d79e3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e269910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:22.319516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204af5a8-65f3-4bf8-9a9c-4db9c09d79e3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:22.319806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204af5a8-65f3-4bf8-9a9c-4db9c09d79e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:22.320086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204af5a8-65f3-4bf8-9a9c-4db9c09d79e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:22.320953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204af5a8-65f3-4bf8-9a9c-4db9c09d79e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:22.322594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204af5a8-65f3-4bf8-9a9c-4db9c09d79e3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:22.335369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 923/1827] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:22.338073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204af5a8-65f3-4bf8-9a9c-4db9c09d79e3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:22.349261 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204af5a8-65f3-4bf8-9a9c-4db9c09d79e3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:22.355781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0c1fa-d815-46e5-a065-c66a8f2292a0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e55f820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:22.356963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0c1fa-d815-46e5-a065-c66a8f2292a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:22.357258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0c1fa-d815-46e5-a065-c66a8f2292a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:22.357543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0c1fa-d815-46e5-a065-c66a8f2292a0 admin admin] PATH_INFO: `/v3/projects/97ba918f80ee4a9db77d523cdc9a90da/users/6de6f32e63ed4f798f4b897ac3bdd9d0/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:22.390652 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0c1fa-d815-46e5-a065-c66a8f2292a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ba918f80ee4a9db77d523cdc9a90da, user_id=6de6f32e63ed4f798f4b897ac3bdd9d0, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:22.393813 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0c1fa-d815-46e5-a065-c66a8f2292a0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:22.473998 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 924/1828] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:22 2022] PUT /identity/v3/projects/97ba918f80ee4a9db77d523cdc9a90da/users/6de6f32e63ed4f798f4b897ac3bdd9d0/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:22.476129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa48814-5d4f-41fd-bede-1d480e011e23 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:22.477016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa48814-5d4f-41fd-bede-1d480e011e23 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:22.477016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa48814-5d4f-41fd-bede-1d480e011e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:22.486882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a0704cbe51474b8e2f9dc7c7debd91'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:22.504016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-caa48814-5d4f-41fd-bede-1d480e011e23 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:22.505218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-caa48814-5d4f-41fd-bede-1d480e011e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:22.566863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a0704cbe51474b8e2f9dc7c7debd91'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:22.587257 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a0704cbe51474b8e2f9dc7c7debd91'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:22.588112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a0704cbe51474b8e2f9dc7c7debd91'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:22.589767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a0704cbe51474b8e2f9dc7c7debd91'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:22.592332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 925/1829] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:22.605543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa48814-5d4f-41fd-bede-1d480e011e23 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:22.606536 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-caa48814-5d4f-41fd-bede-1d480e011e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:22.625856 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 905/1830] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:22 2022] DELETE /identity/v3/users/13a0704cbe51474b8e2f9dc7c7debd91 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:22.688465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa48814-5d4f-41fd-bede-1d480e011e23 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:22.754742 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb2217-ebd2-4484-8f61-54341b05fe60 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e4ef340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:22.755605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb2217-ebd2-4484-8f61-54341b05fe60 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:22.755722 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb2217-ebd2-4484-8f61-54341b05fe60 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:22.755963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb2217-ebd2-4484-8f61-54341b05fe60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:22.757752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6deb2217-ebd2-4484-8f61-54341b05fe60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:22.864168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb2217-ebd2-4484-8f61-54341b05fe60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:22.865525 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb2217-ebd2-4484-8f61-54341b05fe60 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:22.876078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 926/1831] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:22 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:23.295544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:23.297199 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:23.311520 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08579-cd2c-42c2-b281-b85cd551534c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:23.316332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=d81vmeHwSWuPypIe-c9iUQ, audit_chain_id=['d81vmeHwSWuPypIe-c9iUQ']) at 0x7fe09e630f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:23.317157 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:23.317498 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:23.317723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] PATH_INFO: `/v3/projects/d52b8596e086477494b97e85831b25e1` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:23.319065 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52b8596e086477494b97e85831b25e1)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:23.321226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:23.453888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52b8596e086477494b97e85831b25e1', 'request_id': 'req-12849871-29e3-4899-b323-74156d5a65e1'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:23.470458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52b8596e086477494b97e85831b25e1', 'request_id': 'req-12849871-29e3-4899-b323-74156d5a65e1'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:23.538393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52b8596e086477494b97e85831b25e1', 'request_id': 'req-12849871-29e3-4899-b323-74156d5a65e1'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:23.565719 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] The token cache is being invalidate because project d52b8596e086477494b97e85831b25e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:23.566020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:23.569992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-12849871-29e3-4899-b323-74156d5a65e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:23.571361 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 906/1832] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:23 2022] DELETE /identity/v3/projects/d52b8596e086477494b97e85831b25e1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:23.576316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e8897-9c4e-49ad-b3d1-ec11c0d8c985 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:23.576799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e8897-9c4e-49ad-b3d1-ec11c0d8c985 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:23.576886 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e8897-9c4e-49ad-b3d1-ec11c0d8c985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:23.603313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-e91e8897-9c4e-49ad-b3d1-ec11c0d8c985 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:23.605769 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e91e8897-9c4e-49ad-b3d1-ec11c0d8c985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:23.701432 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 927/1833] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:23.704022 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43dde4-0818-4723-a41e-55b4a934db5c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:23.704515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43dde4-0818-4723-a41e-55b4a934db5c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:23.704935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43dde4-0818-4723-a41e-55b4a934db5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:23.760596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-9e43dde4-0818-4723-a41e-55b4a934db5c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:23.763542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9e43dde4-0818-4723-a41e-55b4a934db5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:23.789667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 907/1834] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:23.790446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e8897-9c4e-49ad-b3d1-ec11c0d8c985 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:23.805986 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e8897-9c4e-49ad-b3d1-ec11c0d8c985 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:23.818084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fdbcb-cad6-4924-8f05-70a897afcd0b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e55f820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:23.818775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fdbcb-cad6-4924-8f05-70a897afcd0b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:23.819151 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fdbcb-cad6-4924-8f05-70a897afcd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:23.819507 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fdbcb-cad6-4924-8f05-70a897afcd0b admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:23.820521 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fdbcb-cad6-4924-8f05-70a897afcd0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:23.820898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fdbcb-cad6-4924-8f05-70a897afcd0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:23.825815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fdbcb-cad6-4924-8f05-70a897afcd0b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:23.847714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 928/1835] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:02:23.849206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43dde4-0818-4723-a41e-55b4a934db5c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:23.859181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43dde4-0818-4723-a41e-55b4a934db5c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:23.864760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179feae-1789-4700-af1d-43b2b8bb594e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09f4807c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:23.865361 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179feae-1789-4700-af1d-43b2b8bb594e admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:23.865648 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179feae-1789-4700-af1d-43b2b8bb594e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:23.865929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179feae-1789-4700-af1d-43b2b8bb594e admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:23.866594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179feae-1789-4700-af1d-43b2b8bb594e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:23.871024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179feae-1789-4700-af1d-43b2b8bb594e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:23.994602 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 908/1836] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:23 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:23.996579 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fdbcb-cad6-4924-8f05-70a897afcd0b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:24.013106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fdbcb-cad6-4924-8f05-70a897afcd0b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:24.149845 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe37c94-5cb3-4d51-be6c-20ce3ba9e3f3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e1a12e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:24.150718 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37c94-5cb3-4d51-be6c-20ce3ba9e3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:24.151135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37c94-5cb3-4d51-be6c-20ce3ba9e3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:24.152110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37c94-5cb3-4d51-be6c-20ce3ba9e3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:24.152853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe37c94-5cb3-4d51-be6c-20ce3ba9e3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:24.154864 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe37c94-5cb3-4d51-be6c-20ce3ba9e3f3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:24.283240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 929/1837] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:23 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:24.283914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179feae-1789-4700-af1d-43b2b8bb594e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:24.295274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179feae-1789-4700-af1d-43b2b8bb594e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:24.300704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9de81-67a9-4515-b051-dbb4f08bdb21 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e8faa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:24.301489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9de81-67a9-4515-b051-dbb4f08bdb21 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:24.301608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9de81-67a9-4515-b051-dbb4f08bdb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:24.301878 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9de81-67a9-4515-b051-dbb4f08bdb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:24.302740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9de81-67a9-4515-b051-dbb4f08bdb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:24.304966 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9de81-67a9-4515-b051-dbb4f08bdb21 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:24.321284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 909/1838] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:24.322524 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe37c94-5cb3-4d51-be6c-20ce3ba9e3f3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:24.333511 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe37c94-5cb3-4d51-be6c-20ce3ba9e3f3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:24.338109 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355a265-2806-4575-b8ab-90d016ae2d60 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e21e370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:24.338746 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355a265-2806-4575-b8ab-90d016ae2d60 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:24.339599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355a265-2806-4575-b8ab-90d016ae2d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:24.344360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355a265-2806-4575-b8ab-90d016ae2d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:24.344360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355a265-2806-4575-b8ab-90d016ae2d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:24.344360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355a265-2806-4575-b8ab-90d016ae2d60 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:24.358515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 930/1839] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:24.360104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9de81-67a9-4515-b051-dbb4f08bdb21 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:24.370536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9de81-67a9-4515-b051-dbb4f08bdb21 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:24.375153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5ae02-06d8-477c-8e79-1b328f426e14 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e3bfd30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:24.375976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ae02-06d8-477c-8e79-1b328f426e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:24.376259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ae02-06d8-477c-8e79-1b328f426e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:24.376538 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ae02-06d8-477c-8e79-1b328f426e14 admin admin] PATH_INFO: `/v3/projects/753e196122e5489bac1451213e46c323/users/c7bf0893b580490496cd759cd5318810/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:24.396791 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5ae02-06d8-477c-8e79-1b328f426e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=753e196122e5489bac1451213e46c323, user_id=c7bf0893b580490496cd759cd5318810, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:24.402171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5ae02-06d8-477c-8e79-1b328f426e14 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:24.488714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 910/1840] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:24 2022] PUT /identity/v3/projects/753e196122e5489bac1451213e46c323/users/c7bf0893b580490496cd759cd5318810/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:24.500181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96b0fe-9213-4974-85b1-f210b704ada6 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:24.500413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96b0fe-9213-4974-85b1-f210b704ada6 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:24.500704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96b0fe-9213-4974-85b1-f210b704ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:24.546009 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-fa96b0fe-9213-4974-85b1-f210b704ada6 None None] MFA Rules not processed for user `c7bf0893b580490496cd759cd5318810`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:24.547498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-fa96b0fe-9213-4974-85b1-f210b704ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:24.624645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 931/1841] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:24 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:24.629108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5ae02-06d8-477c-8e79-1b328f426e14 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:24.711826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5ae02-06d8-477c-8e79-1b328f426e14 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:24.718055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456b2b-ec9e-48bb-8f01-dd2a5a73763f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e8fa070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:24.718671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456b2b-ec9e-48bb-8f01-dd2a5a73763f admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:24.719016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456b2b-ec9e-48bb-8f01-dd2a5a73763f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:24.719336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456b2b-ec9e-48bb-8f01-dd2a5a73763f admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:24.719988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd456b2b-ec9e-48bb-8f01-dd2a5a73763f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:24.722050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd456b2b-ec9e-48bb-8f01-dd2a5a73763f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:24.847696 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 911/1842] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:24 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:24.852587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96b0fe-9213-4974-85b1-f210b704ada6 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:24.871343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96b0fe-9213-4974-85b1-f210b704ada6 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:24.898226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928a18-6feb-4a73-8311-74b201a79bb6 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:24.898734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928a18-6feb-4a73-8311-74b201a79bb6 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:24.899285 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928a18-6feb-4a73-8311-74b201a79bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:24.962883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f088b-470b-42cf-af83-d958b2d9670f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e14e8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:24.963700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f088b-470b-42cf-af83-d958b2d9670f admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:24.964357 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f088b-470b-42cf-af83-d958b2d9670f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:24.964850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f088b-470b-42cf-af83-d958b2d9670f admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:24.965629 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f088b-470b-42cf-af83-d958b2d9670f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:24.967859 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f088b-470b-42cf-af83-d958b2d9670f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:25.015732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-7a928a18-6feb-4a73-8311-74b201a79bb6 None None] MFA Rules not processed for user `6de6f32e63ed4f798f4b897ac3bdd9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:25.017077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7a928a18-6feb-4a73-8311-74b201a79bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:25.099069 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 932/1843] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:24 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:25.100075 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f088b-470b-42cf-af83-d958b2d9670f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.111531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f088b-470b-42cf-af83-d958b2d9670f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:25.116505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9317-357d-4ce0-99d1-e6ba4d76fe5c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e105fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:25.117115 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9317-357d-4ce0-99d1-e6ba4d76fe5c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:25.117409 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9317-357d-4ce0-99d1-e6ba4d76fe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:25.117691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9317-357d-4ce0-99d1-e6ba4d76fe5c admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:25.118475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b9317-357d-4ce0-99d1-e6ba4d76fe5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:25.120691 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b9317-357d-4ce0-99d1-e6ba4d76fe5c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:25.137420 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 933/1844] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:25.139017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9317-357d-4ce0-99d1-e6ba4d76fe5c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.151184 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 912/1845] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:24 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:25.159485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a928a18-6feb-4a73-8311-74b201a79bb6 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.161042 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7a928a18-6feb-4a73-8311-74b201a79bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:25.164403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9317-357d-4ce0-99d1-e6ba4d76fe5c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:25.169623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77ec1a-c882-4b56-9275-3bdf68c0a45f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09defe820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:25.170486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77ec1a-c882-4b56-9275-3bdf68c0a45f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:25.170924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77ec1a-c882-4b56-9275-3bdf68c0a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:25.171399 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77ec1a-c882-4b56-9275-3bdf68c0a45f admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:25.172505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77ec1a-c882-4b56-9275-3bdf68c0a45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:25.174254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77ec1a-c882-4b56-9275-3bdf68c0a45f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:25.184653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a928a18-6feb-4a73-8311-74b201a79bb6 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:25.189359 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3d7e4-e77e-4a9b-a20f-4991bfcdc695 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e887070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:25.190270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d7e4-e77e-4a9b-a20f-4991bfcdc695 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:25.190777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d7e4-e77e-4a9b-a20f-4991bfcdc695 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:25.191307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d7e4-e77e-4a9b-a20f-4991bfcdc695 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:25.191426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 934/1846] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:25.193297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3d7e4-e77e-4a9b-a20f-4991bfcdc695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:25.195585 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3d7e4-e77e-4a9b-a20f-4991bfcdc695 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:25.211363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77ec1a-c882-4b56-9275-3bdf68c0a45f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.228476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77ec1a-c882-4b56-9275-3bdf68c0a45f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:25.234768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04b950-d204-4af7-8568-2a9f4fc3820b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09dec1d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:25.236447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04b950-d204-4af7-8568-2a9f4fc3820b admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:25.236832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04b950-d204-4af7-8568-2a9f4fc3820b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:25.237224 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04b950-d204-4af7-8568-2a9f4fc3820b admin admin] PATH_INFO: `/v3/projects/ed74b107dda14babb37bbe98969ff85a/users/f15e6121920c4c5b86dfdbfc973b538e/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:25.264943 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04b950-d204-4af7-8568-2a9f4fc3820b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed74b107dda14babb37bbe98969ff85a, user_id=f15e6121920c4c5b86dfdbfc973b538e, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:25.267008 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04b950-d204-4af7-8568-2a9f4fc3820b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:25.316026 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 913/1847] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:25 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:25.321390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3d7e4-e77e-4a9b-a20f-4991bfcdc695 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.354846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 935/1848] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:25 2022] PUT /identity/v3/projects/ed74b107dda14babb37bbe98969ff85a/users/f15e6121920c4c5b86dfdbfc973b538e/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:25.367403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210de1bc-8596-46bb-a86b-d8c8b05b28b9 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:25.368368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210de1bc-8596-46bb-a86b-d8c8b05b28b9 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:25.368775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210de1bc-8596-46bb-a86b-d8c8b05b28b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:25.424849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-210de1bc-8596-46bb-a86b-d8c8b05b28b9 None None] MFA Rules not processed for user `f15e6121920c4c5b86dfdbfc973b538e`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:25.426136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-210de1bc-8596-46bb-a86b-d8c8b05b28b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:25.427888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3d7e4-e77e-4a9b-a20f-4991bfcdc695 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:25.513785 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a9e52-5de8-41f8-afc6-c974a9d3de2f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e3d5820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:25.514700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a9e52-5de8-41f8-afc6-c974a9d3de2f admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:25.515216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a9e52-5de8-41f8-afc6-c974a9d3de2f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:25.515683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a9e52-5de8-41f8-afc6-c974a9d3de2f admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:25.516750 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a9e52-5de8-41f8-afc6-c974a9d3de2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:25.519040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a9e52-5de8-41f8-afc6-c974a9d3de2f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:25.528815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 936/1849] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:25 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:25.530382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210de1bc-8596-46bb-a86b-d8c8b05b28b9 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.544171 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210de1bc-8596-46bb-a86b-d8c8b05b28b9 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:25.549565 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568acbdc-d95e-4efa-a6d9-441abe35197b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e21e370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:25.550620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acbdc-d95e-4efa-a6d9-441abe35197b admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:25.550620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acbdc-d95e-4efa-a6d9-441abe35197b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:25.550920 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acbdc-d95e-4efa-a6d9-441abe35197b admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:25.551643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568acbdc-d95e-4efa-a6d9-441abe35197b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:25.553602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568acbdc-d95e-4efa-a6d9-441abe35197b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:25.631087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 914/1850] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:25 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:25.634759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a9e52-5de8-41f8-afc6-c974a9d3de2f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.646694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 937/1851] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:25 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:25.650979 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568acbdc-d95e-4efa-a6d9-441abe35197b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.659284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a9e52-5de8-41f8-afc6-c974a9d3de2f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:25.775331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568acbdc-d95e-4efa-a6d9-441abe35197b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:25.780708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737017a-3754-42c2-a3c7-9b927b6476e3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e90fd00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:25.780964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5403ca-4b7e-472d-8fb5-1d8fe6e60a30 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09df25850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:25.781380 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737017a-3754-42c2-a3c7-9b927b6476e3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:25.781577 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5403ca-4b7e-472d-8fb5-1d8fe6e60a30 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:25.781763 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737017a-3754-42c2-a3c7-9b927b6476e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:25.781871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5403ca-4b7e-472d-8fb5-1d8fe6e60a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:25.782050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737017a-3754-42c2-a3c7-9b927b6476e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:25.782150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5403ca-4b7e-472d-8fb5-1d8fe6e60a30 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:25.782949 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5403ca-4b7e-472d-8fb5-1d8fe6e60a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:25.783060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737017a-3754-42c2-a3c7-9b927b6476e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:25.784662 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737017a-3754-42c2-a3c7-9b927b6476e3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:25.784928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5403ca-4b7e-472d-8fb5-1d8fe6e60a30 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:25.797985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 915/1852] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:25.802389 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737017a-3754-42c2-a3c7-9b927b6476e3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.821759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737017a-3754-42c2-a3c7-9b927b6476e3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:25.821759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268182ab-ef8b-4eb6-bee8-51964cbc795e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e3ad730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:25.821759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268182ab-ef8b-4eb6-bee8-51964cbc795e admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:25.821759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268182ab-ef8b-4eb6-bee8-51964cbc795e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:25.822110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268182ab-ef8b-4eb6-bee8-51964cbc795e admin admin] PATH_INFO: `/v3/projects/ec54d6ff24f84281b85f72f20db5347d/users/7727ae17f1f94129802c6f20d1989992/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:25.850828 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268182ab-ef8b-4eb6-bee8-51964cbc795e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec54d6ff24f84281b85f72f20db5347d, user_id=7727ae17f1f94129802c6f20d1989992, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:25.853663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268182ab-ef8b-4eb6-bee8-51964cbc795e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:25.895002 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 938/1853] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:25 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:25.898983 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5403ca-4b7e-472d-8fb5-1d8fe6e60a30 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.909464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5403ca-4b7e-472d-8fb5-1d8fe6e60a30 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:25.915318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb529c-91d7-4c73-9356-e114e8f95380 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e1a1040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:25.916806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb529c-91d7-4c73-9356-e114e8f95380 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:25.916806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb529c-91d7-4c73-9356-e114e8f95380 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:25.916806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb529c-91d7-4c73-9356-e114e8f95380 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:25.917611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb529c-91d7-4c73-9356-e114e8f95380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:25.919538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb529c-91d7-4c73-9356-e114e8f95380 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:25.936364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 916/1854] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:25 2022] PUT /identity/v3/projects/ec54d6ff24f84281b85f72f20db5347d/users/7727ae17f1f94129802c6f20d1989992/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:25.939929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268182ab-ef8b-4eb6-bee8-51964cbc795e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.940067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 939/1855] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:25.941173 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb529c-91d7-4c73-9356-e114e8f95380 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:25.955297 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb529c-91d7-4c73-9356-e114e8f95380 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:26.024763 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0792e-9d1b-4bb0-9342-b5431198d7b4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e1a1a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:26.025885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0792e-9d1b-4bb0-9342-b5431198d7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:26.026997 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0792e-9d1b-4bb0-9342-b5431198d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:26.027682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0792e-9d1b-4bb0-9342-b5431198d7b4 admin admin] PATH_INFO: `/v3/projects/87d85fed56d44a3998753857e36b0673/users/90d00e715ab64a158864c5b78f382d74/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:26.027881 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268182ab-ef8b-4eb6-bee8-51964cbc795e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:26.032072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269e6e7-05c2-44cf-87f3-0e7458f99f61 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e1b0f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:26.032679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269e6e7-05c2-44cf-87f3-0e7458f99f61 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:26.032969 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269e6e7-05c2-44cf-87f3-0e7458f99f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:26.033331 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269e6e7-05c2-44cf-87f3-0e7458f99f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:26.034174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269e6e7-05c2-44cf-87f3-0e7458f99f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:26.035809 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269e6e7-05c2-44cf-87f3-0e7458f99f61 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:26.050730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 917/1856] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:26.051622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0792e-9d1b-4bb0-9342-b5431198d7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d85fed56d44a3998753857e36b0673, user_id=90d00e715ab64a158864c5b78f382d74, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:26.052099 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269e6e7-05c2-44cf-87f3-0e7458f99f61 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:26.054280 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0792e-9d1b-4bb0-9342-b5431198d7b4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:26.062180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269e6e7-05c2-44cf-87f3-0e7458f99f61 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:26.066683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc4139-aa64-42e0-92ac-d96954b4092d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e3632b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:26.074758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc4139-aa64-42e0-92ac-d96954b4092d admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:26.074758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc4139-aa64-42e0-92ac-d96954b4092d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:26.074758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc4139-aa64-42e0-92ac-d96954b4092d admin admin] PATH_INFO: `/v3/projects/ec54d6ff24f84281b85f72f20db5347d/users/7727ae17f1f94129802c6f20d1989992/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:26.074758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc4139-aa64-42e0-92ac-d96954b4092d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec54d6ff24f84281b85f72f20db5347d, user_id=7727ae17f1f94129802c6f20d1989992, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:26.074758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc4139-aa64-42e0-92ac-d96954b4092d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:26.083732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 918/1857] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:26 2022] PUT /identity/v3/projects/ec54d6ff24f84281b85f72f20db5347d/users/7727ae17f1f94129802c6f20d1989992/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:26.174039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 940/1858] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:25 2022] PUT /identity/v3/projects/87d85fed56d44a3998753857e36b0673/users/90d00e715ab64a158864c5b78f382d74/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:26.178033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc4139-aa64-42e0-92ac-d96954b4092d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:26.248761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc4139-aa64-42e0-92ac-d96954b4092d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:26.311318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665708c-d244-4eda-8c03-46c6df806869 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e198f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:26.311929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665708c-d244-4eda-8c03-46c6df806869 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:26.312216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665708c-d244-4eda-8c03-46c6df806869 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:26.312496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665708c-d244-4eda-8c03-46c6df806869 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:26.313189 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665708c-d244-4eda-8c03-46c6df806869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:26.314779 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665708c-d244-4eda-8c03-46c6df806869 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:26.325614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 919/1859] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:26.329855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0792e-9d1b-4bb0-9342-b5431198d7b4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:26.339975 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0792e-9d1b-4bb0-9342-b5431198d7b4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:26.344501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d19219-2782-41e8-b2c1-e67987247333 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e705940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:26.345311 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d19219-2782-41e8-b2c1-e67987247333 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:26.345598 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d19219-2782-41e8-b2c1-e67987247333 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:26.357173 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d19219-2782-41e8-b2c1-e67987247333 admin admin] PATH_INFO: `/v3/projects/87d85fed56d44a3998753857e36b0673/users/90d00e715ab64a158864c5b78f382d74/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:26.357173 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d19219-2782-41e8-b2c1-e67987247333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d85fed56d44a3998753857e36b0673, user_id=90d00e715ab64a158864c5b78f382d74, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:26.357173 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d19219-2782-41e8-b2c1-e67987247333 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:26.360597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 941/1860] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:26 2022] PUT /identity/v3/projects/87d85fed56d44a3998753857e36b0673/users/90d00e715ab64a158864c5b78f382d74/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:26.371180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696e082-9495-402a-aebe-8cafacaa82b8 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:26.371452 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696e082-9495-402a-aebe-8cafacaa82b8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:26.371733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696e082-9495-402a-aebe-8cafacaa82b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:26.408723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a696e082-9495-402a-aebe-8cafacaa82b8 None None] MFA Rules not processed for user `90d00e715ab64a158864c5b78f382d74`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:26.410118 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a696e082-9495-402a-aebe-8cafacaa82b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:26.521297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 920/1861] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:26 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:26.530674 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d19219-2782-41e8-b2c1-e67987247333 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:26.532338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-02d19219-2782-41e8-b2c1-e67987247333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:26.603779 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d19219-2782-41e8-b2c1-e67987247333 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:26.608352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dae436-5d7e-459f-a226-d71be7630884 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09de36670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:26.609584 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dae436-5d7e-459f-a226-d71be7630884 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:26.609890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dae436-5d7e-459f-a226-d71be7630884 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:26.610155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dae436-5d7e-459f-a226-d71be7630884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:26.622943 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dae436-5d7e-459f-a226-d71be7630884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:26.624453 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dae436-5d7e-459f-a226-d71be7630884 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:26.639369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 942/1862] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:26 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:28.043589 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93757ca-2cae-4da7-8b63-062036b6eb9d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:28.044213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93757ca-2cae-4da7-8b63-062036b6eb9d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:28.044213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93757ca-2cae-4da7-8b63-062036b6eb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:28.092824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f93757ca-2cae-4da7-8b63-062036b6eb9d None None] MFA Rules not processed for user `7727ae17f1f94129802c6f20d1989992`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:28.093998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f93757ca-2cae-4da7-8b63-062036b6eb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:28.223988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 921/1863] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:28 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:28.436056 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dae436-5d7e-459f-a226-d71be7630884 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:28.438174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-20dae436-5d7e-459f-a226-d71be7630884 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:28.451171 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dae436-5d7e-459f-a226-d71be7630884 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:28.457000 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af206e8b-82f3-4857-ac8e-78db179c0a6c service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e8e0bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:28.460451 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af206e8b-82f3-4857-ac8e-78db179c0a6c service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:28.460952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af206e8b-82f3-4857-ac8e-78db179c0a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:28.461417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af206e8b-82f3-4857-ac8e-78db179c0a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:28.540883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af206e8b-82f3-4857-ac8e-78db179c0a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:28.542955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af206e8b-82f3-4857-ac8e-78db179c0a6c service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:28.566316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 943/1864] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:28 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:28.846987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93757ca-2cae-4da7-8b63-062036b6eb9d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:28.857183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93757ca-2cae-4da7-8b63-062036b6eb9d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:28.860862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eddebd-f6dd-4e5c-a406-2adc373ebc46 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e3e9b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:28.861446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eddebd-f6dd-4e5c-a406-2adc373ebc46 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:28.862308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eddebd-f6dd-4e5c-a406-2adc373ebc46 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:28.862308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eddebd-f6dd-4e5c-a406-2adc373ebc46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:28.928023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eddebd-f6dd-4e5c-a406-2adc373ebc46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:28.929601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eddebd-f6dd-4e5c-a406-2adc373ebc46 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:28.939989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 922/1865] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:28 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:31.598659 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af206e8b-82f3-4857-ac8e-78db179c0a6c service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:31.610437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af206e8b-82f3-4857-ac8e-78db179c0a6c service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:31.611917 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065beb52-dc9b-4334-acba-435f5d42add4 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e1ddb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:31.612479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065beb52-dc9b-4334-acba-435f5d42add4 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:31.612779 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065beb52-dc9b-4334-acba-435f5d42add4 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:31.613085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065beb52-dc9b-4334-acba-435f5d42add4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:31.623776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065beb52-dc9b-4334-acba-435f5d42add4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:31.625212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065beb52-dc9b-4334-acba-435f5d42add4 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:31.647463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 944/1866] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:31 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:34.614821 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eddebd-f6dd-4e5c-a406-2adc373ebc46 service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:34.616306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-35eddebd-f6dd-4e5c-a406-2adc373ebc46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:34.700156 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eddebd-f6dd-4e5c-a406-2adc373ebc46 service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:34.704590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09e4084f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:34.705390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:34.705676 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:34.705957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] PATH_INFO: `/v3/users/c28f076980664d8b9c5d7c91bcada398` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:34.707078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28f076980664d8b9c5d7c91bcada398)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:34.709004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:34.981566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28f076980664d8b9c5d7c91bcada398'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:35.059354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28f076980664d8b9c5d7c91bcada398'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:35.071636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28f076980664d8b9c5d7c91bcada398'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:35.072272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28f076980664d8b9c5d7c91bcada398'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:35.073448 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28f076980664d8b9c5d7c91bcada398'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:35.086219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 923/1867] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:34 2022] DELETE /identity/v3/users/c28f076980664d8b9c5d7c91bcada398 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:35.091415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26f813-b885-4e0d-9f37-1de89c098b97 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:35.091910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26f813-b885-4e0d-9f37-1de89c098b97 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:35.092003 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26f813-b885-4e0d-9f37-1de89c098b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:35.114318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-7e26f813-b885-4e0d-9f37-1de89c098b97 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:35.115499 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7e26f813-b885-4e0d-9f37-1de89c098b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:35.179035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 945/1868] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:35.190108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:35.191574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:35.259846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a6735-f7d2-4ae4-a740-88ec2a49477e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:35.260602 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05e194-274b-496f-b9f9-5c01f9f879b1 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e472550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:35.260923 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05e194-274b-496f-b9f9-5c01f9f879b1 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:35.261223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05e194-274b-496f-b9f9-5c01f9f879b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:35.261502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05e194-274b-496f-b9f9-5c01f9f879b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:35.270888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05e194-274b-496f-b9f9-5c01f9f879b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:35.272645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05e194-274b-496f-b9f9-5c01f9f879b1 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:35.285299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 924/1869] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:36.055871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26f813-b885-4e0d-9f37-1de89c098b97 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:36.060392 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7e26f813-b885-4e0d-9f37-1de89c098b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:36.078322 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26f813-b885-4e0d-9f37-1de89c098b97 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:36.083895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09de56a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:36.085060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:36.085365 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:36.085654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] PATH_INFO: `/v3/projects/2443d1d8403c422fb1f36e7d80482f73` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:36.086954 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2443d1d8403c422fb1f36e7d80482f73)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:36.090044 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:36.215947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2443d1d8403c422fb1f36e7d80482f73', 'request_id': 'req-5774e547-4bf8-46f8-82b4-a4b9e961ee86'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:36.320170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2443d1d8403c422fb1f36e7d80482f73', 'request_id': 'req-5774e547-4bf8-46f8-82b4-a4b9e961ee86'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:36.332971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2443d1d8403c422fb1f36e7d80482f73', 'request_id': 'req-5774e547-4bf8-46f8-82b4-a4b9e961ee86'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:36.355880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] The token cache is being invalidate because project 2443d1d8403c422fb1f36e7d80482f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:36.356166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:36.357354 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:36.358553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 946/1870] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:36 2022] DELETE /identity/v3/projects/2443d1d8403c422fb1f36e7d80482f73 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:36.362507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05e194-274b-496f-b9f9-5c01f9f879b1 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:36.372842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05e194-274b-496f-b9f9-5c01f9f879b1 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:36.442487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09e3d1f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:36.442487 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:36.442693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:36.442836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] PATH_INFO: `/v3/users/1b9c39e0e02a4c43a01c44d1d9412d68` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:36.444072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9c39e0e02a4c43a01c44d1d9412d68)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:36.446067 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:36.609382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9c39e0e02a4c43a01c44d1d9412d68'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:36.704493 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9c39e0e02a4c43a01c44d1d9412d68'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:36.716704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9c39e0e02a4c43a01c44d1d9412d68'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:36.717384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9c39e0e02a4c43a01c44d1d9412d68'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:36.717985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9c39e0e02a4c43a01c44d1d9412d68'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:36.730741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 925/1871] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:36 2022] DELETE /identity/v3/users/1b9c39e0e02a4c43a01c44d1d9412d68 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:36.974913 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:36.976551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:37.060606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774e547-4bf8-46f8-82b4-a4b9e961ee86 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:37.132090 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375278b-e027-4856-b7ee-4a5f110b2f61 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09de55d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:37.133424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375278b-e027-4856-b7ee-4a5f110b2f61 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:37.134068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375278b-e027-4856-b7ee-4a5f110b2f61 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:37.134545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375278b-e027-4856-b7ee-4a5f110b2f61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:37.138324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b375278b-e027-4856-b7ee-4a5f110b2f61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:37.210262 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375278b-e027-4856-b7ee-4a5f110b2f61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:37.211784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375278b-e027-4856-b7ee-4a5f110b2f61 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:37.221698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 947/1872] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:36 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:37.298594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:37.300234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:37.409772 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14d115-9c7b-4d18-a36f-10081d21d8a9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:37.415610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9OKCAKOOQranE1RPnEuEGw, audit_chain_id=['9OKCAKOOQranE1RPnEuEGw']) at 0x7fe09e1d7490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:37.417059 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:37.417834 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:37.418345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] PATH_INFO: `/v3/projects/5095c2037dd04c6085453b7075fae077` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:37.419767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5095c2037dd04c6085453b7075fae077)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:37.422174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:37.574760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5095c2037dd04c6085453b7075fae077', 'request_id': 'req-afe78aac-b4d2-4a56-8817-294e319f5f00'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:37.586195 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5095c2037dd04c6085453b7075fae077', 'request_id': 'req-afe78aac-b4d2-4a56-8817-294e319f5f00'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:37.675912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5095c2037dd04c6085453b7075fae077', 'request_id': 'req-afe78aac-b4d2-4a56-8817-294e319f5f00'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:37.692385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] The token cache is being invalidate because project 5095c2037dd04c6085453b7075fae077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:37.692951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:37.693654 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-afe78aac-b4d2-4a56-8817-294e319f5f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:37.695186 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 926/1873] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:37 2022] DELETE /identity/v3/projects/5095c2037dd04c6085453b7075fae077 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:37.701869 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353cd6-5ac4-432f-bd6d-f1727f4b3225 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:37.702195 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353cd6-5ac4-432f-bd6d-f1727f4b3225 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:37.702477 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353cd6-5ac4-432f-bd6d-f1727f4b3225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:37.724554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-dd353cd6-5ac4-432f-bd6d-f1727f4b3225 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:37.725721 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-dd353cd6-5ac4-432f-bd6d-f1727f4b3225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:37.819147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 948/1874] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:37.821468 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200a356-6678-4922-b9cb-484b68981018 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:37.821769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200a356-6678-4922-b9cb-484b68981018 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:37.823825 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200a356-6678-4922-b9cb-484b68981018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:37.856403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-9200a356-6678-4922-b9cb-484b68981018 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:37.860156 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9200a356-6678-4922-b9cb-484b68981018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:37.865607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 927/1875] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:37.870120 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd353cd6-5ac4-432f-bd6d-f1727f4b3225 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:37.880186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd353cd6-5ac4-432f-bd6d-f1727f4b3225 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:37.884714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86474c9-5bc9-415b-a2f5-4e649f3974e1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09dec1af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:37.886306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86474c9-5bc9-415b-a2f5-4e649f3974e1 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:37.886660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86474c9-5bc9-415b-a2f5-4e649f3974e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:37.886943 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86474c9-5bc9-415b-a2f5-4e649f3974e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:37.887793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86474c9-5bc9-415b-a2f5-4e649f3974e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:37.888091 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86474c9-5bc9-415b-a2f5-4e649f3974e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:37.889853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86474c9-5bc9-415b-a2f5-4e649f3974e1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:37.906220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 949/1876] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:02:37.910702 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200a356-6678-4922-b9cb-484b68981018 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:37.922299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200a356-6678-4922-b9cb-484b68981018 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:37.928128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53febc56-a70f-4148-8d24-7b2fed0861c1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09e3f66a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:37.929631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53febc56-a70f-4148-8d24-7b2fed0861c1 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:37.929631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53febc56-a70f-4148-8d24-7b2fed0861c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:37.930086 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53febc56-a70f-4148-8d24-7b2fed0861c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:37.930373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53febc56-a70f-4148-8d24-7b2fed0861c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:37.933381 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53febc56-a70f-4148-8d24-7b2fed0861c1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:38.027210 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 928/1877] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:37 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:38.041019 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86474c9-5bc9-415b-a2f5-4e649f3974e1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:38.073650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86474c9-5bc9-415b-a2f5-4e649f3974e1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:38.161237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b37471-6566-4e79-8385-bd5b7813daaa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09e212310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:38.162198 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b37471-6566-4e79-8385-bd5b7813daaa admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:38.162686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b37471-6566-4e79-8385-bd5b7813daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:38.163883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b37471-6566-4e79-8385-bd5b7813daaa admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:38.164738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b37471-6566-4e79-8385-bd5b7813daaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:38.169346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b37471-6566-4e79-8385-bd5b7813daaa admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:38.258841 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 950/1878] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:38 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:38.263437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53febc56-a70f-4148-8d24-7b2fed0861c1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:38.273783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53febc56-a70f-4148-8d24-7b2fed0861c1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:38.280988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889cd26-a2d8-4236-8d53-b6ae15b290d2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09eb66490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:38.280988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889cd26-a2d8-4236-8d53-b6ae15b290d2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:38.280988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889cd26-a2d8-4236-8d53-b6ae15b290d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:38.280988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889cd26-a2d8-4236-8d53-b6ae15b290d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:38.283422 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889cd26-a2d8-4236-8d53-b6ae15b290d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:38.285024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889cd26-a2d8-4236-8d53-b6ae15b290d2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:38.296543 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 929/1879] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:38.300353 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b37471-6566-4e79-8385-bd5b7813daaa admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:38.311155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b37471-6566-4e79-8385-bd5b7813daaa admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:38.315706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636324c-12ce-4e63-8448-e85b06d5933c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09e15ea90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:38.316312 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636324c-12ce-4e63-8448-e85b06d5933c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:38.316604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636324c-12ce-4e63-8448-e85b06d5933c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:38.316917 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636324c-12ce-4e63-8448-e85b06d5933c admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:38.317610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636324c-12ce-4e63-8448-e85b06d5933c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:38.319347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636324c-12ce-4e63-8448-e85b06d5933c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:38.329793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 951/1880] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:38.334156 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889cd26-a2d8-4236-8d53-b6ae15b290d2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:38.346145 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889cd26-a2d8-4236-8d53-b6ae15b290d2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:38.350672 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7740-1807-4579-a33a-4e579aca2e87 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09e37f6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:38.351646 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7740-1807-4579-a33a-4e579aca2e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:38.352006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7740-1807-4579-a33a-4e579aca2e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:38.352354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7740-1807-4579-a33a-4e579aca2e87 admin admin] PATH_INFO: `/v3/projects/f747fe65129f4a6d931435997c190652/users/9189a64304a54d258a4fb3794d7e1da9/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:38.374237 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a7740-1807-4579-a33a-4e579aca2e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f747fe65129f4a6d931435997c190652, user_id=9189a64304a54d258a4fb3794d7e1da9, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:38.377117 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a7740-1807-4579-a33a-4e579aca2e87 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:38.459541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 930/1881] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:38 2022] PUT /identity/v3/projects/f747fe65129f4a6d931435997c190652/users/9189a64304a54d258a4fb3794d7e1da9/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:38.471374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e4b8-8f7d-416f-bb6e-8e0bcd025631 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:38.471674 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e4b8-8f7d-416f-bb6e-8e0bcd025631 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:38.472103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e4b8-8f7d-416f-bb6e-8e0bcd025631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:38.508511 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-45f7e4b8-8f7d-416f-bb6e-8e0bcd025631 None None] MFA Rules not processed for user `9189a64304a54d258a4fb3794d7e1da9`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:38.509681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-45f7e4b8-8f7d-416f-bb6e-8e0bcd025631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:38.596189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 952/1882] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:38 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:38.600636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7740-1807-4579-a33a-4e579aca2e87 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:38.694241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7740-1807-4579-a33a-4e579aca2e87 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:38.699848 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef76dd-e49e-4bd1-a79d-94aa7778f5a8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09e3e41f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:38.700451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef76dd-e49e-4bd1-a79d-94aa7778f5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:38.700740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef76dd-e49e-4bd1-a79d-94aa7778f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:38.701195 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef76dd-e49e-4bd1-a79d-94aa7778f5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:38.702043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef76dd-e49e-4bd1-a79d-94aa7778f5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:38.704935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef76dd-e49e-4bd1-a79d-94aa7778f5a8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:38.824700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 931/1883] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:38 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:38.824808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e4b8-8f7d-416f-bb6e-8e0bcd025631 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:38.831480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e4b8-8f7d-416f-bb6e-8e0bcd025631 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:38.907037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064d36-1442-458e-beaf-9c76e241afc1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09dec3df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:38.907693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064d36-1442-458e-beaf-9c76e241afc1 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:38.908184 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064d36-1442-458e-beaf-9c76e241afc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:38.908477 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064d36-1442-458e-beaf-9c76e241afc1 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:38.909285 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66064d36-1442-458e-beaf-9c76e241afc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:38.911402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66064d36-1442-458e-beaf-9c76e241afc1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:39.023181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 953/1884] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:38 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:39.025403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef76dd-e49e-4bd1-a79d-94aa7778f5a8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:39.038489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef76dd-e49e-4bd1-a79d-94aa7778f5a8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:39.044560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fc198-7b3c-456e-bdc2-d34d11891ff0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09e162520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:39.045640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc198-7b3c-456e-bdc2-d34d11891ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:39.045946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc198-7b3c-456e-bdc2-d34d11891ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:39.046737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc198-7b3c-456e-bdc2-d34d11891ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:39.047300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fc198-7b3c-456e-bdc2-d34d11891ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:39.054394 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fc198-7b3c-456e-bdc2-d34d11891ff0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:39.061171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 932/1885] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:39.065781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064d36-1442-458e-beaf-9c76e241afc1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:39.081224 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064d36-1442-458e-beaf-9c76e241afc1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:39.091827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517a3d7-3dde-4e17-b30b-212ddb3d4fd1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09eae0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:39.092965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517a3d7-3dde-4e17-b30b-212ddb3d4fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:39.093468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517a3d7-3dde-4e17-b30b-212ddb3d4fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:39.094039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517a3d7-3dde-4e17-b30b-212ddb3d4fd1 admin admin] PATH_INFO: `/v3/projects/5e7dbd06d106440092b4a208999b4752/users/8c2fccbd894f409f974b0f243febe685/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:39.118799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517a3d7-3dde-4e17-b30b-212ddb3d4fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7dbd06d106440092b4a208999b4752, user_id=8c2fccbd894f409f974b0f243febe685, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:39.122548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517a3d7-3dde-4e17-b30b-212ddb3d4fd1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:39.207414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 954/1886] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:39 2022] PUT /identity/v3/projects/5e7dbd06d106440092b4a208999b4752/users/8c2fccbd894f409f974b0f243febe685/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:39.211348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fc198-7b3c-456e-bdc2-d34d11891ff0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:39.226077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fc198-7b3c-456e-bdc2-d34d11891ff0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:39.324028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef4685-3de7-48a7-b8a1-d7298758a1ed admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09ded0790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:39.324667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef4685-3de7-48a7-b8a1-d7298758a1ed admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:39.324976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef4685-3de7-48a7-b8a1-d7298758a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:39.325246 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef4685-3de7-48a7-b8a1-d7298758a1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:39.326153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef4685-3de7-48a7-b8a1-d7298758a1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:39.328122 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef4685-3de7-48a7-b8a1-d7298758a1ed admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:39.340959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 933/1887] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:39.345376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517a3d7-3dde-4e17-b30b-212ddb3d4fd1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:39.356830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517a3d7-3dde-4e17-b30b-212ddb3d4fd1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:39.365757 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed58012-a2b7-4f0c-b8eb-56183a7fda9e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09e480dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:39.366806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed58012-a2b7-4f0c-b8eb-56183a7fda9e admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:39.367251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed58012-a2b7-4f0c-b8eb-56183a7fda9e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:39.367608 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed58012-a2b7-4f0c-b8eb-56183a7fda9e admin admin] PATH_INFO: `/v3/projects/5e7dbd06d106440092b4a208999b4752/users/8c2fccbd894f409f974b0f243febe685/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:39.370183 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed58012-a2b7-4f0c-b8eb-56183a7fda9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7dbd06d106440092b4a208999b4752, user_id=8c2fccbd894f409f974b0f243febe685, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:39.375314 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed58012-a2b7-4f0c-b8eb-56183a7fda9e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:39.391563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 955/1888] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:39 2022] PUT /identity/v3/projects/5e7dbd06d106440092b4a208999b4752/users/8c2fccbd894f409f974b0f243febe685/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:39.401946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af333ef4-5d73-4fbb-9114-05c31e3f206c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:39.402384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af333ef4-5d73-4fbb-9114-05c31e3f206c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:39.402724 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af333ef4-5d73-4fbb-9114-05c31e3f206c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:39.444322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-af333ef4-5d73-4fbb-9114-05c31e3f206c None None] MFA Rules not processed for user `8c2fccbd894f409f974b0f243febe685`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:39.445659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-af333ef4-5d73-4fbb-9114-05c31e3f206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:39.530912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 934/1889] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:39 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:39.540745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed58012-a2b7-4f0c-b8eb-56183a7fda9e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:39.544932 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7ed58012-a2b7-4f0c-b8eb-56183a7fda9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:39.614013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed58012-a2b7-4f0c-b8eb-56183a7fda9e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:39.618791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8eefd-5811-4403-a010-db97e1492cc7 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09de55fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:39.619733 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8eefd-5811-4403-a010-db97e1492cc7 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:39.620209 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8eefd-5811-4403-a010-db97e1492cc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:39.620580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8eefd-5811-4403-a010-db97e1492cc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:39.631678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8eefd-5811-4403-a010-db97e1492cc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:39.633372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8eefd-5811-4403-a010-db97e1492cc7 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:39.644070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 956/1890] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:39 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:02:39.751622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af333ef4-5d73-4fbb-9114-05c31e3f206c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:39.753108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-af333ef4-5d73-4fbb-9114-05c31e3f206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:39.769308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af333ef4-5d73-4fbb-9114-05c31e3f206c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:39.773155 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589df5f-03be-4481-91c2-f1656a4b88f8 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09eb66490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:39.774011 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589df5f-03be-4481-91c2-f1656a4b88f8 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:39.774303 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589df5f-03be-4481-91c2-f1656a4b88f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:39.774584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589df5f-03be-4481-91c2-f1656a4b88f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:39.861475 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589df5f-03be-4481-91c2-f1656a4b88f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:39.863331 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589df5f-03be-4481-91c2-f1656a4b88f8 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:39.874966 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 935/1891] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:39 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:43.259371 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8eefd-5811-4403-a010-db97e1492cc7 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:43.262196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-03a8eefd-5811-4403-a010-db97e1492cc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:43.424905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8eefd-5811-4403-a010-db97e1492cc7 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:43.431590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049f9d7-29be-46a4-a6a4-69f5a0ea9b0f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09de98910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:43.437139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049f9d7-29be-46a4-a6a4-69f5a0ea9b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:43.437139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049f9d7-29be-46a4-a6a4-69f5a0ea9b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:43.437139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049f9d7-29be-46a4-a6a4-69f5a0ea9b0f admin admin] PATH_INFO: `/v3/users/c7bf0893b580490496cd759cd5318810` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:43.437139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049f9d7-29be-46a4-a6a4-69f5a0ea9b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7bf0893b580490496cd759cd5318810)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:43.439956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049f9d7-29be-46a4-a6a4-69f5a0ea9b0f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:43.665206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0049f9d7-29be-46a4-a6a4-69f5a0ea9b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7bf0893b580490496cd759cd5318810'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:43.684434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0049f9d7-29be-46a4-a6a4-69f5a0ea9b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7bf0893b580490496cd759cd5318810'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:43.685168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0049f9d7-29be-46a4-a6a4-69f5a0ea9b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7bf0893b580490496cd759cd5318810'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:43.685774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0049f9d7-29be-46a4-a6a4-69f5a0ea9b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7bf0893b580490496cd759cd5318810'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:43.780326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589df5f-03be-4481-91c2-f1656a4b88f8 service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:43.786765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0049f9d7-29be-46a4-a6a4-69f5a0ea9b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7bf0893b580490496cd759cd5318810'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:43.793445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589df5f-03be-4481-91c2-f1656a4b88f8 service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:43.798438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09e1622b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:43.801215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:43.801607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:43.801989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] PATH_INFO: `/v3/users/9189a64304a54d258a4fb3794d7e1da9` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:43.804039 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9189a64304a54d258a4fb3794d7e1da9)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:43.805973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:43.812259 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 957/1892] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:43 2022] DELETE /identity/v3/users/c7bf0893b580490496cd759cd5318810 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:43.816998 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529b843-2697-477d-9630-441f9530524f None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:43.817631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529b843-2697-477d-9630-441f9530524f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:43.818764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529b843-2697-477d-9630-441f9530524f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:43.844973 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-2529b843-2697-477d-9630-441f9530524f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:43.846832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2529b843-2697-477d-9630-441f9530524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:43.931147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 958/1893] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:43.942516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529b843-2697-477d-9630-441f9530524f None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:43.946191 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2529b843-2697-477d-9630-441f9530524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:44.024645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529b843-2697-477d-9630-441f9530524f None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:44.029571 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb69d9d-4352-486c-a3c6-8d042d824b85 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e4f36d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:44.030453 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb69d9d-4352-486c-a3c6-8d042d824b85 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:44.030747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb69d9d-4352-486c-a3c6-8d042d824b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:44.031032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb69d9d-4352-486c-a3c6-8d042d824b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:44.038600 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9189a64304a54d258a4fb3794d7e1da9'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:44.043150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb69d9d-4352-486c-a3c6-8d042d824b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:44.048080 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb69d9d-4352-486c-a3c6-8d042d824b85 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:44.055503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 959/1894] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:43 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:44.138651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9189a64304a54d258a4fb3794d7e1da9'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:44.155958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9189a64304a54d258a4fb3794d7e1da9'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:44.158642 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9189a64304a54d258a4fb3794d7e1da9'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:44.161763 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9189a64304a54d258a4fb3794d7e1da9'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:44.196138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 936/1895] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:43 2022] DELETE /identity/v3/users/9189a64304a54d258a4fb3794d7e1da9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:44.201252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815887b-eeef-442b-ad4a-48e02957f0aa None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:44.201905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815887b-eeef-442b-ad4a-48e02957f0aa None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:44.202490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815887b-eeef-442b-ad4a-48e02957f0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:44.264555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a815887b-eeef-442b-ad4a-48e02957f0aa None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:44.266344 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a815887b-eeef-442b-ad4a-48e02957f0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:44.395299 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 960/1896] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:44.404625 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:44.425374 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:44.482656 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13279c6d-3a8d-45c8-88a8-a06f8f4a19c2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:44.486646 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f828a-1a77-4c80-8646-09f6a3c62db7 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09eb453d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:44.487283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f828a-1a77-4c80-8646-09f6a3c62db7 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:44.487787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f828a-1a77-4c80-8646-09f6a3c62db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:44.488256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f828a-1a77-4c80-8646-09f6a3c62db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:44.500160 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f828a-1a77-4c80-8646-09f6a3c62db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:44.500160 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f828a-1a77-4c80-8646-09f6a3c62db7 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:44.515289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 937/1897] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:44.872540 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815887b-eeef-442b-ad4a-48e02957f0aa None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:44.874014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a815887b-eeef-442b-ad4a-48e02957f0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:44.890261 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815887b-eeef-442b-ad4a-48e02957f0aa None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:44.906924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e123ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:44.907854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:44.908594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:44.908594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] PATH_INFO: `/v3/projects/753e196122e5489bac1451213e46c323` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:44.909646 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=753e196122e5489bac1451213e46c323)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:44.913689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:45.053980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '753e196122e5489bac1451213e46c323', 'request_id': 'req-7364538f-a133-4574-ab29-2d855b7d9ba7'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.122010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '753e196122e5489bac1451213e46c323', 'request_id': 'req-7364538f-a133-4574-ab29-2d855b7d9ba7'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.139327 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f828a-1a77-4c80-8646-09f6a3c62db7 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:45.143441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a84f828a-1a77-4c80-8646-09f6a3c62db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:45.144181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '753e196122e5489bac1451213e46c323', 'request_id': 'req-7364538f-a133-4574-ab29-2d855b7d9ba7'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.157643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f828a-1a77-4c80-8646-09f6a3c62db7 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:45.167780 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] The token cache is being invalidate because project 753e196122e5489bac1451213e46c323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:45.168393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.169271 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.171004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 961/1898] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:44 2022] DELETE /identity/v3/projects/753e196122e5489bac1451213e46c323 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:45.175281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:45.176464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:45.247058 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09e20ef70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:45.247981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:45.248370 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:45.248987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] PATH_INFO: `/v3/projects/f747fe65129f4a6d931435997c190652` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:45.251014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f747fe65129f4a6d931435997c190652)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:45.254270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:45.264062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364538f-a133-4574-ab29-2d855b7d9ba7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:45.276744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09eae0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:45.277702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:45.278055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:45.278447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] PATH_INFO: `/v3/users/f15e6121920c4c5b86dfdbfc973b538e` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:45.279891 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15e6121920c4c5b86dfdbfc973b538e)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:45.281963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:45.396375 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f747fe65129f4a6d931435997c190652', 'request_id': 'req-74e17a7b-18f7-4527-8fbd-17a9561e1fba'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.416723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f747fe65129f4a6d931435997c190652', 'request_id': 'req-74e17a7b-18f7-4527-8fbd-17a9561e1fba'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.498910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f747fe65129f4a6d931435997c190652', 'request_id': 'req-74e17a7b-18f7-4527-8fbd-17a9561e1fba'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.513192 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] The token cache is being invalidate because project f747fe65129f4a6d931435997c190652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:45.513771 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.514666 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.516435 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 938/1899] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:45 2022] DELETE /identity/v3/projects/f747fe65129f4a6d931435997c190652 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:45.520267 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:45.521541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:45.535944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15e6121920c4c5b86dfdbfc973b538e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.549783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15e6121920c4c5b86dfdbfc973b538e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.550921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15e6121920c4c5b86dfdbfc973b538e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.551795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15e6121920c4c5b86dfdbfc973b538e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.601627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15e6121920c4c5b86dfdbfc973b538e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:45.621668 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 962/1900] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:45 2022] DELETE /identity/v3/users/f15e6121920c4c5b86dfdbfc973b538e => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:45.639102 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e17a7b-18f7-4527-8fbd-17a9561e1fba admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:45.748448 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09eb78070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:45.750728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:45.751259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:45.751780 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] PATH_INFO: `/v3/users/8c2fccbd894f409f974b0f243febe685` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:45.753219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2fccbd894f409f974b0f243febe685)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:45.756355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:46.033290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2fccbd894f409f974b0f243febe685'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:46.102889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2fccbd894f409f974b0f243febe685'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:46.120815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2fccbd894f409f974b0f243febe685'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:46.121844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2fccbd894f409f974b0f243febe685'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:46.122365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2fccbd894f409f974b0f243febe685'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:46.136339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 939/1901] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:45 2022] DELETE /identity/v3/users/8c2fccbd894f409f974b0f243febe685 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:46.224493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:46.229803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:46.252017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210fd0-6c7e-4928-995e-319e304ca791 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:46.320769 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09ddd5310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:46.321544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:46.321837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:46.322120 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] PATH_INFO: `/v3/projects/ed74b107dda14babb37bbe98969ff85a` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:46.323998 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed74b107dda14babb37bbe98969ff85a)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:46.326040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:46.469545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed74b107dda14babb37bbe98969ff85a', 'request_id': 'req-40f75667-2a2b-477b-b151-4f0bdf7ed139'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:46.548799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed74b107dda14babb37bbe98969ff85a', 'request_id': 'req-40f75667-2a2b-477b-b151-4f0bdf7ed139'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:46.562687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed74b107dda14babb37bbe98969ff85a', 'request_id': 'req-40f75667-2a2b-477b-b151-4f0bdf7ed139'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:46.575064 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] The token cache is being invalidate because project ed74b107dda14babb37bbe98969ff85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:46.575400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:46.576053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:46.578154 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 963/1902] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:46 2022] DELETE /identity/v3/projects/ed74b107dda14babb37bbe98969ff85a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:46.582951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:46.589829 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:46.597799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3128-4f83-4b79-a86a-ff34ac77e7d2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:46.668344 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156030a-46bc-483a-976a-0c9e7b7b6ca3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e424400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:46.669195 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156030a-46bc-483a-976a-0c9e7b7b6ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:46.669483 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156030a-46bc-483a-976a-0c9e7b7b6ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:46.669769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156030a-46bc-483a-976a-0c9e7b7b6ca3 admin admin] PATH_INFO: `/v3/users/90d00e715ab64a158864c5b78f382d74` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:46.670900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156030a-46bc-483a-976a-0c9e7b7b6ca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d00e715ab64a158864c5b78f382d74)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:46.673218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156030a-46bc-483a-976a-0c9e7b7b6ca3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:46.777623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:46.783680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:46.797340 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f75667-2a2b-477b-b151-4f0bdf7ed139 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:46.804142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8ziqSbsMQFuAEyljNyXujA, audit_chain_id=['8ziqSbsMQFuAEyljNyXujA']) at 0x7fe09e25bd00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:46.804930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:46.805218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:46.805497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] PATH_INFO: `/v3/projects/5e7dbd06d106440092b4a208999b4752` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:46.806717 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e7dbd06d106440092b4a208999b4752)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:46.809221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:47.009075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b156030a-46bc-483a-976a-0c9e7b7b6ca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d00e715ab64a158864c5b78f382d74'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:47.010697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e7dbd06d106440092b4a208999b4752', 'request_id': 'req-785c59da-715c-4b92-838a-875915c86d64'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:47.138773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b156030a-46bc-483a-976a-0c9e7b7b6ca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d00e715ab64a158864c5b78f382d74'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:47.152426 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b156030a-46bc-483a-976a-0c9e7b7b6ca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d00e715ab64a158864c5b78f382d74'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:47.153175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b156030a-46bc-483a-976a-0c9e7b7b6ca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d00e715ab64a158864c5b78f382d74'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:47.153825 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b156030a-46bc-483a-976a-0c9e7b7b6ca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d00e715ab64a158864c5b78f382d74'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:47.168125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 940/1903] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:46 2022] DELETE /identity/v3/users/90d00e715ab64a158864c5b78f382d74 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:47.194654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e7dbd06d106440092b4a208999b4752', 'request_id': 'req-785c59da-715c-4b92-838a-875915c86d64'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:47.207838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e7dbd06d106440092b4a208999b4752', 'request_id': 'req-785c59da-715c-4b92-838a-875915c86d64'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:47.219474 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] The token cache is being invalidate because project 5e7dbd06d106440092b4a208999b4752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:47.219826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:47.220542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-785c59da-715c-4b92-838a-875915c86d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:47.222321 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 964/1904] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:46 2022] DELETE /identity/v3/projects/5e7dbd06d106440092b4a208999b4752 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:47.226974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633a1f-b0fe-40b5-b538-8961931195da None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:47.227636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633a1f-b0fe-40b5-b538-8961931195da None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:47.227636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633a1f-b0fe-40b5-b538-8961931195da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:47.255028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-14633a1f-b0fe-40b5-b538-8961931195da None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:47.256447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-14633a1f-b0fe-40b5-b538-8961931195da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:47.344450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 941/1905] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:47.346436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5878-ab14-4daf-b7af-2f3982f617d5 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:47.347209 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5878-ab14-4daf-b7af-2f3982f617d5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:47.347494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5878-ab14-4daf-b7af-2f3982f617d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:47.371437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-955a5878-ab14-4daf-b7af-2f3982f617d5 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:47.372755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-955a5878-ab14-4daf-b7af-2f3982f617d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:47.380884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 965/1906] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:47.386148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633a1f-b0fe-40b5-b538-8961931195da None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:47.395548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633a1f-b0fe-40b5-b538-8961931195da None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:47.399975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387226a-3c8a-4017-9a5c-0738f9ff261c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09eabbeb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:47.400714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387226a-3c8a-4017-9a5c-0738f9ff261c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:47.401014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387226a-3c8a-4017-9a5c-0738f9ff261c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:47.401347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387226a-3c8a-4017-9a5c-0738f9ff261c admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:47.401992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387226a-3c8a-4017-9a5c-0738f9ff261c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:47.402292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387226a-3c8a-4017-9a5c-0738f9ff261c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:47.404082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387226a-3c8a-4017-9a5c-0738f9ff261c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:47.420443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 942/1907] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:02:47.424869 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a5878-ab14-4daf-b7af-2f3982f617d5 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:47.436480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a5878-ab14-4daf-b7af-2f3982f617d5 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:47.440999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc4bce-fcb0-434e-96f5-95037b64769f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e8e0b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:47.441805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc4bce-fcb0-434e-96f5-95037b64769f admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:47.442110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc4bce-fcb0-434e-96f5-95037b64769f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:47.442396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc4bce-fcb0-434e-96f5-95037b64769f admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:47.443259 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc4bce-fcb0-434e-96f5-95037b64769f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:47.445334 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc4bce-fcb0-434e-96f5-95037b64769f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:47.604843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 966/1908] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:47 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:47.610561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387226a-3c8a-4017-9a5c-0738f9ff261c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:47.622003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387226a-3c8a-4017-9a5c-0738f9ff261c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:47.705526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e732-135e-4322-becd-1f199007b5e9 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:47.705830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e732-135e-4322-becd-1f199007b5e9 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:47.706113 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e732-135e-4322-becd-1f199007b5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:47.725421 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c260ee5-9167-440b-aa06-4985e25dbe4e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e159b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:47.731955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260ee5-9167-440b-aa06-4985e25dbe4e admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:47.731955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260ee5-9167-440b-aa06-4985e25dbe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:47.731955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260ee5-9167-440b-aa06-4985e25dbe4e admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:47.731955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c260ee5-9167-440b-aa06-4985e25dbe4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:47.731955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c260ee5-9167-440b-aa06-4985e25dbe4e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:47.745403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-9b17e732-135e-4322-becd-1f199007b5e9 None None] MFA Rules not processed for user `46e767d2e3624a3fa799c8c1b20b0516`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:47.747042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9b17e732-135e-4322-becd-1f199007b5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:47.816499 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 967/1909] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:47 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:47.817531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e732-135e-4322-becd-1f199007b5e9 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:47.818792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9b17e732-135e-4322-becd-1f199007b5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:47.826074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 943/1910] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:47 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:47.832705 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e732-135e-4322-becd-1f199007b5e9 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:47.835332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c260ee5-9167-440b-aa06-4985e25dbe4e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:47.837452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ZC3d7M8Rf6gGWYnrYaClQ, audit_chain_id=['5ZC3d7M8Rf6gGWYnrYaClQ']) at 0x7fe09e3b5a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:47.839018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:47.839599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:47.840735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] PATH_INFO: `/v3/projects/87d85fed56d44a3998753857e36b0673` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:47.842162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d85fed56d44a3998753857e36b0673)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:47.844303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:47.847390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c260ee5-9167-440b-aa06-4985e25dbe4e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:47.852262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9130030-5a4c-4e5c-a2f6-1852271273ee admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e159670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:47.852864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9130030-5a4c-4e5c-a2f6-1852271273ee admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:47.853155 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9130030-5a4c-4e5c-a2f6-1852271273ee admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:47.853437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9130030-5a4c-4e5c-a2f6-1852271273ee admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:47.854859 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9130030-5a4c-4e5c-a2f6-1852271273ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:47.856659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9130030-5a4c-4e5c-a2f6-1852271273ee admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:47.885561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 944/1911] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:47.892069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9130030-5a4c-4e5c-a2f6-1852271273ee admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:47.904908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9130030-5a4c-4e5c-a2f6-1852271273ee admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:47.911222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4c06a-4d40-4a35-a824-e4041640e9e6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e14afd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:47.912027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c06a-4d40-4a35-a824-e4041640e9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:47.912327 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c06a-4d40-4a35-a824-e4041640e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:47.912613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c06a-4d40-4a35-a824-e4041640e9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:47.913923 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4c06a-4d40-4a35-a824-e4041640e9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:47.919244 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4c06a-4d40-4a35-a824-e4041640e9e6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:47.947237 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 945/1912] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:47.949466 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4c06a-4d40-4a35-a824-e4041640e9e6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:47.959378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4c06a-4d40-4a35-a824-e4041640e9e6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:47.964906 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cf7de-d2d9-499e-9766-8b2b74a594b0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e1d7ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:47.965826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf7de-d2d9-499e-9766-8b2b74a594b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:47.966183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf7de-d2d9-499e-9766-8b2b74a594b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:47.966559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf7de-d2d9-499e-9766-8b2b74a594b0 admin admin] PATH_INFO: `/v3/projects/9f14ff7f1a044695b3b9344615b942d9/users/e1e96c5ef176473ca3f030597a424e62/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:47.991352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cf7de-d2d9-499e-9766-8b2b74a594b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f14ff7f1a044695b3b9344615b942d9, user_id=e1e96c5ef176473ca3f030597a424e62, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:47.995475 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cf7de-d2d9-499e-9766-8b2b74a594b0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:48.087459 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 946/1913] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:47 2022] PUT /identity/v3/projects/9f14ff7f1a044695b3b9344615b942d9/users/e1e96c5ef176473ca3f030597a424e62/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:48.098455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d85fed56d44a3998753857e36b0673', 'request_id': 'req-6c0c2ec4-8e53-4454-9e36-be45794ea77b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:48.100209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859cc2-e6d1-4024-aa75-f2e3368ed268 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.100677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859cc2-e6d1-4024-aa75-f2e3368ed268 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.100977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859cc2-e6d1-4024-aa75-f2e3368ed268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.151002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-46859cc2-e6d1-4024-aa75-f2e3368ed268 None None] MFA Rules not processed for user `e1e96c5ef176473ca3f030597a424e62`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:48.152365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-46859cc2-e6d1-4024-aa75-f2e3368ed268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:48.183327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d85fed56d44a3998753857e36b0673', 'request_id': 'req-6c0c2ec4-8e53-4454-9e36-be45794ea77b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:48.199178 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d85fed56d44a3998753857e36b0673', 'request_id': 'req-6c0c2ec4-8e53-4454-9e36-be45794ea77b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:48.210088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] The token cache is being invalidate because project 87d85fed56d44a3998753857e36b0673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:48.210512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:48.211429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6c0c2ec4-8e53-4454-9e36-be45794ea77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:48.213636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 968/1914] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:47 2022] DELETE /identity/v3/projects/87d85fed56d44a3998753857e36b0673 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:48.219368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909b7ad-4f6a-48ee-b5be-aae56f5a9149 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.222082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909b7ad-4f6a-48ee-b5be-aae56f5a9149 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.222082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909b7ad-4f6a-48ee-b5be-aae56f5a9149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.243542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4909b7ad-4f6a-48ee-b5be-aae56f5a9149 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:48.245861 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4909b7ad-4f6a-48ee-b5be-aae56f5a9149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:48.256008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 947/1915] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:48 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:48.264129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46859cc2-e6d1-4024-aa75-f2e3368ed268 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:48.265584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-46859cc2-e6d1-4024-aa75-f2e3368ed268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:48.318219 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 969/1916] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:48.327518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86215519-222e-42ba-b1e9-9061cc0e80a6 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.327955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86215519-222e-42ba-b1e9-9061cc0e80a6 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.328339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86215519-222e-42ba-b1e9-9061cc0e80a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.352155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-86215519-222e-42ba-b1e9-9061cc0e80a6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:48.353371 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-86215519-222e-42ba-b1e9-9061cc0e80a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:48.356507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46859cc2-e6d1-4024-aa75-f2e3368ed268 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:48.362416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 970/1917] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:48.365797 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd147d41-80f7-4ee4-b9c8-97eaa9b1fbc4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e1df130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:48.366280 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86215519-222e-42ba-b1e9-9061cc0e80a6 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:48.366394 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd147d41-80f7-4ee4-b9c8-97eaa9b1fbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.366685 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd147d41-80f7-4ee4-b9c8-97eaa9b1fbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.366968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd147d41-80f7-4ee4-b9c8-97eaa9b1fbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.367651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd147d41-80f7-4ee4-b9c8-97eaa9b1fbc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:48.369946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd147d41-80f7-4ee4-b9c8-97eaa9b1fbc4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:48.375670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86215519-222e-42ba-b1e9-9061cc0e80a6 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:48.382251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12098310-d825-42a2-91ec-948b67b97298 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09e150e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:48.382859 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12098310-d825-42a2-91ec-948b67b97298 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.383181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12098310-d825-42a2-91ec-948b67b97298 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.383469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12098310-d825-42a2-91ec-948b67b97298 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.384328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12098310-d825-42a2-91ec-948b67b97298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:48.384636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12098310-d825-42a2-91ec-948b67b97298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:48.387027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12098310-d825-42a2-91ec-948b67b97298 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:48.400063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 971/1918] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:02:48.405292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12098310-d825-42a2-91ec-948b67b97298 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:48.415218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12098310-d825-42a2-91ec-948b67b97298 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:48.420001 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d66294-d641-49f2-a247-17ea5e0c3770 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09de0f4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:48.420618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66294-d641-49f2-a247-17ea5e0c3770 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.420911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66294-d641-49f2-a247-17ea5e0c3770 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.421452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66294-d641-49f2-a247-17ea5e0c3770 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.422102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d66294-d641-49f2-a247-17ea5e0c3770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:48.424116 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d66294-d641-49f2-a247-17ea5e0c3770 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:48.475288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 948/1919] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:48 2022] POST /identity/v3/projects => generated 389 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:48.476310 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd147d41-80f7-4ee4-b9c8-97eaa9b1fbc4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:48.547600 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd147d41-80f7-4ee4-b9c8-97eaa9b1fbc4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:48.552084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1be719-d6c7-402d-995e-cd1a323fb460 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e363f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:48.552713 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1be719-d6c7-402d-995e-cd1a323fb460 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.552982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1be719-d6c7-402d-995e-cd1a323fb460 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.553267 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1be719-d6c7-402d-995e-cd1a323fb460 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.553922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1be719-d6c7-402d-995e-cd1a323fb460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:48.555873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1be719-d6c7-402d-995e-cd1a323fb460 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:48.574573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 972/1920] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:48 2022] POST /identity/v3/projects => generated 407 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:48.578810 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d66294-d641-49f2-a247-17ea5e0c3770 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:48.632757 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 949/1921] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:48 2022] POST /identity/v3/users => generated 301 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:48.634414 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1be719-d6c7-402d-995e-cd1a323fb460 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:48.645962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1be719-d6c7-402d-995e-cd1a323fb460 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:48.662910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d66294-d641-49f2-a247-17ea5e0c3770 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:48.667884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c8f5-e986-4c08-acfd-f2cbf8e74ccb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09e55f9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:48.668493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c8f5-e986-4c08-acfd-f2cbf8e74ccb admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.668781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c8f5-e986-4c08-acfd-f2cbf8e74ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.669062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c8f5-e986-4c08-acfd-f2cbf8e74ccb admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.669698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6c8f5-e986-4c08-acfd-f2cbf8e74ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:48.671887 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6c8f5-e986-4c08-acfd-f2cbf8e74ccb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:48.715140 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e2192-6b37-4161-8565-c4569763fbac admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e424ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:48.715773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e2192-6b37-4161-8565-c4569763fbac admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.716062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e2192-6b37-4161-8565-c4569763fbac admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.716347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e2192-6b37-4161-8565-c4569763fbac admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.717059 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e2192-6b37-4161-8565-c4569763fbac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:48.718658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e2192-6b37-4161-8565-c4569763fbac admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:48.729272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 950/1922] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:48.733109 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e2192-6b37-4161-8565-c4569763fbac admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:48.742452 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e2192-6b37-4161-8565-c4569763fbac admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:48.748497 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979d26d-3484-4276-a475-9eb704c8d26d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e8fa070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:48.749313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d26d-3484-4276-a475-9eb704c8d26d admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.749599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d26d-3484-4276-a475-9eb704c8d26d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.749888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d26d-3484-4276-a475-9eb704c8d26d admin admin] PATH_INFO: `/v3/projects/e6111c28dce544299dfa2d274ac5b845/users/35fae204bb4b4a10b7ddd6e96479e0a1/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.769817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979d26d-3484-4276-a475-9eb704c8d26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6111c28dce544299dfa2d274ac5b845, user_id=35fae204bb4b4a10b7ddd6e96479e0a1, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:48.772492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979d26d-3484-4276-a475-9eb704c8d26d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:48.801575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 973/1923] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:48 2022] POST /identity/v3/users => generated 304 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:48.805631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c8f5-e986-4c08-acfd-f2cbf8e74ccb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:48.815386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c8f5-e986-4c08-acfd-f2cbf8e74ccb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:48.819749 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71eda-b694-4a8a-8a6f-0252f434af93 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09defec10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:48.820324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71eda-b694-4a8a-8a6f-0252f434af93 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.820612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71eda-b694-4a8a-8a6f-0252f434af93 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.820894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71eda-b694-4a8a-8a6f-0252f434af93 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.821581 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb71eda-b694-4a8a-8a6f-0252f434af93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:48.823908 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb71eda-b694-4a8a-8a6f-0252f434af93 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:48.833701 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 974/1924] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:48.837192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71eda-b694-4a8a-8a6f-0252f434af93 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:48.846405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71eda-b694-4a8a-8a6f-0252f434af93 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:48.850889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031acc5-e722-4ae4-8ddd-623bed70fe7a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09de9daf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:48.851508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031acc5-e722-4ae4-8ddd-623bed70fe7a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.851803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031acc5-e722-4ae4-8ddd-623bed70fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.852086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031acc5-e722-4ae4-8ddd-623bed70fe7a admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.852762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031acc5-e722-4ae4-8ddd-623bed70fe7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:48.854366 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031acc5-e722-4ae4-8ddd-623bed70fe7a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:48.865674 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 975/1925] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:48.870726 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031acc5-e722-4ae4-8ddd-623bed70fe7a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:48.879935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031acc5-e722-4ae4-8ddd-623bed70fe7a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:48.884296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c9573-ca23-49a3-bb8c-e31d5d52fcbb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09de0c130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:48.885333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c9573-ca23-49a3-bb8c-e31d5d52fcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:48.885622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c9573-ca23-49a3-bb8c-e31d5d52fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:48.885907 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c9573-ca23-49a3-bb8c-e31d5d52fcbb admin admin] PATH_INFO: `/v3/projects/c450a7a45bee48e392468053c4a63c90/users/bf0c91f716bf4580a545fa3ec959028b/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:48.905183 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c9573-ca23-49a3-bb8c-e31d5d52fcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c450a7a45bee48e392468053c4a63c90, user_id=bf0c91f716bf4580a545fa3ec959028b, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:48.907836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c9573-ca23-49a3-bb8c-e31d5d52fcbb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:48.939285 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 951/1926] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:48 2022] PUT /identity/v3/projects/e6111c28dce544299dfa2d274ac5b845/users/35fae204bb4b4a10b7ddd6e96479e0a1/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:48.943208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979d26d-3484-4276-a475-9eb704c8d26d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:49.030601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979d26d-3484-4276-a475-9eb704c8d26d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:49.034216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 976/1927] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:48 2022] PUT /identity/v3/projects/c450a7a45bee48e392468053c4a63c90/users/bf0c91f716bf4580a545fa3ec959028b/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:49.045738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba55a2-3dfc-4771-af91-4ab513921cda None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:49.046496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba55a2-3dfc-4771-af91-4ab513921cda None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:49.046858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba55a2-3dfc-4771-af91-4ab513921cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:49.130413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-81ba55a2-3dfc-4771-af91-4ab513921cda None None] MFA Rules not processed for user `bf0c91f716bf4580a545fa3ec959028b`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:49.131764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-81ba55a2-3dfc-4771-af91-4ab513921cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:49.137753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a1612-f070-4d87-8402-6177f79f5051 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e3e75e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:49.138375 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a1612-f070-4d87-8402-6177f79f5051 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:49.138663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a1612-f070-4d87-8402-6177f79f5051 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:49.138985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a1612-f070-4d87-8402-6177f79f5051 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:49.139982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a1612-f070-4d87-8402-6177f79f5051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:49.141635 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a1612-f070-4d87-8402-6177f79f5051 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:49.154657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 952/1928] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:49.162637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a1612-f070-4d87-8402-6177f79f5051 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:49.174791 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a1612-f070-4d87-8402-6177f79f5051 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:49.196324 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c5a27-9e4c-4d26-8667-b5d730fb819d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e3f0a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:49.198021 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c5a27-9e4c-4d26-8667-b5d730fb819d admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:49.198547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c5a27-9e4c-4d26-8667-b5d730fb819d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:49.198917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c5a27-9e4c-4d26-8667-b5d730fb819d admin admin] PATH_INFO: `/v3/projects/e6111c28dce544299dfa2d274ac5b845/users/35fae204bb4b4a10b7ddd6e96479e0a1/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:49.202111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c5a27-9e4c-4d26-8667-b5d730fb819d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6111c28dce544299dfa2d274ac5b845, user_id=35fae204bb4b4a10b7ddd6e96479e0a1, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:49.206139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c5a27-9e4c-4d26-8667-b5d730fb819d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:49.218857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 953/1929] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:49 2022] PUT /identity/v3/projects/e6111c28dce544299dfa2d274ac5b845/users/35fae204bb4b4a10b7ddd6e96479e0a1/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:49.229741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 977/1930] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:49 2022] POST /identity/v3/auth/tokens => generated 3714 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:49.234743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c5a27-9e4c-4d26-8667-b5d730fb819d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:49.238430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b011ff-a721-4c4e-ac21-c1501a012b5a None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:49.239024 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b011ff-a721-4c4e-ac21-c1501a012b5a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:49.239515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b011ff-a721-4c4e-ac21-c1501a012b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:49.282045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-c0b011ff-a721-4c4e-ac21-c1501a012b5a None None] MFA Rules not processed for user `35fae204bb4b4a10b7ddd6e96479e0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:49.283338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c0b011ff-a721-4c4e-ac21-c1501a012b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:49.322917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c5a27-9e4c-4d26-8667-b5d730fb819d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:49.328014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fada73-4fdf-4baa-9334-15018d6ad32a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09e159eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:49.328617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fada73-4fdf-4baa-9334-15018d6ad32a admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:49.328909 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fada73-4fdf-4baa-9334-15018d6ad32a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:49.329197 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fada73-4fdf-4baa-9334-15018d6ad32a admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:49.329865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fada73-4fdf-4baa-9334-15018d6ad32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:49.332234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fada73-4fdf-4baa-9334-15018d6ad32a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:49.373435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 978/1931] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:49 2022] POST /identity/v3/auth/tokens => generated 3763 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:49.386488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b011ff-a721-4c4e-ac21-c1501a012b5a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:49.387876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c0b011ff-a721-4c4e-ac21-c1501a012b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:49.431867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 954/1932] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:49 2022] POST /identity/v3/projects => generated 407 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:49.436598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fada73-4fdf-4baa-9334-15018d6ad32a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:49.467346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b011ff-a721-4c4e-ac21-c1501a012b5a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:49.523408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fada73-4fdf-4baa-9334-15018d6ad32a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:49.529397 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8104fb3-76b5-4273-b0a3-93dae39e14c3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09e15bb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:49.530028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8104fb3-76b5-4273-b0a3-93dae39e14c3 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:49.530317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8104fb3-76b5-4273-b0a3-93dae39e14c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:49.530598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8104fb3-76b5-4273-b0a3-93dae39e14c3 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:49.531287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8104fb3-76b5-4273-b0a3-93dae39e14c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:49.533374 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8104fb3-76b5-4273-b0a3-93dae39e14c3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:49.547741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066b8c9-c83e-413d-82b1-0fc8ab1e58b8 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e3b5ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:49.548429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b8c9-c83e-413d-82b1-0fc8ab1e58b8 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:49.555904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b8c9-c83e-413d-82b1-0fc8ab1e58b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:49.555904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b8c9-c83e-413d-82b1-0fc8ab1e58b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:49.620396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066b8c9-c83e-413d-82b1-0fc8ab1e58b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:49.622118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066b8c9-c83e-413d-82b1-0fc8ab1e58b8 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:49.632823 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 979/1933] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:49 2022] GET /identity/v3/auth/tokens => generated 3763 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:02:49.715547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 955/1934] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:49 2022] POST /identity/v3/users => generated 310 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:49.719151 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066b8c9-c83e-413d-82b1-0fc8ab1e58b8 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:49.729401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066b8c9-c83e-413d-82b1-0fc8ab1e58b8 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:49.734405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232e9f6-91b9-4eac-bf49-71fb8faadecd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09de9b970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:49.735083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232e9f6-91b9-4eac-bf49-71fb8faadecd admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:49.735316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232e9f6-91b9-4eac-bf49-71fb8faadecd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:49.735599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232e9f6-91b9-4eac-bf49-71fb8faadecd admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:49.736289 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232e9f6-91b9-4eac-bf49-71fb8faadecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:49.737890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232e9f6-91b9-4eac-bf49-71fb8faadecd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:49.749363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 980/1935] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:49.753749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8104fb3-76b5-4273-b0a3-93dae39e14c3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:49.765470 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8104fb3-76b5-4273-b0a3-93dae39e14c3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:49.770020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9052c1-355d-4a9f-af73-5bde063355c4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09ddd8f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:49.770875 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9052c1-355d-4a9f-af73-5bde063355c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:49.771200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9052c1-355d-4a9f-af73-5bde063355c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:49.771491 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9052c1-355d-4a9f-af73-5bde063355c4 admin admin] PATH_INFO: `/v3/projects/b1c3173c73974ad1a179bb747db2f61d/users/288b1b8eaf53425e9cdaadc3b93fffde/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:49.794353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9052c1-355d-4a9f-af73-5bde063355c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c3173c73974ad1a179bb747db2f61d, user_id=288b1b8eaf53425e9cdaadc3b93fffde, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:49.797295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9052c1-355d-4a9f-af73-5bde063355c4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:49.811657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232e9f6-91b9-4eac-bf49-71fb8faadecd admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:49.821619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232e9f6-91b9-4eac-bf49-71fb8faadecd admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:49.827427 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd5538-54d7-4dca-92d4-99b996ecb4b5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e55f820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:49.828232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd5538-54d7-4dca-92d4-99b996ecb4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:49.828523 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd5538-54d7-4dca-92d4-99b996ecb4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:49.828810 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd5538-54d7-4dca-92d4-99b996ecb4b5 admin admin] PATH_INFO: `/v3/users/e1e96c5ef176473ca3f030597a424e62` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:49.829957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd5538-54d7-4dca-92d4-99b996ecb4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e96c5ef176473ca3f030597a424e62)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:49.831927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd5538-54d7-4dca-92d4-99b996ecb4b5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:49.925901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 956/1936] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:49 2022] PUT /identity/v3/projects/b1c3173c73974ad1a179bb747db2f61d/users/288b1b8eaf53425e9cdaadc3b93fffde/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:49.929729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9052c1-355d-4a9f-af73-5bde063355c4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:50.002705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9052c1-355d-4a9f-af73-5bde063355c4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:50.007454 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f20ca6-d8fe-46af-8b0e-e0874aefb06a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09e424400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:50.010342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20ca6-d8fe-46af-8b0e-e0874aefb06a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:50.010342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20ca6-d8fe-46af-8b0e-e0874aefb06a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:50.010342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20ca6-d8fe-46af-8b0e-e0874aefb06a admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:50.010342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f20ca6-d8fe-46af-8b0e-e0874aefb06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:50.011530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f20ca6-d8fe-46af-8b0e-e0874aefb06a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:50.021769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 957/1937] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:50.026143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f20ca6-d8fe-46af-8b0e-e0874aefb06a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:50.035408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f20ca6-d8fe-46af-8b0e-e0874aefb06a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:50.039824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a405817-e499-4111-9658-a38abd97127b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09e3ad490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:50.040658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a405817-e499-4111-9658-a38abd97127b admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:50.041499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a405817-e499-4111-9658-a38abd97127b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:50.041888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a405817-e499-4111-9658-a38abd97127b admin admin] PATH_INFO: `/v3/projects/b1c3173c73974ad1a179bb747db2f61d/users/288b1b8eaf53425e9cdaadc3b93fffde/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:50.043812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a405817-e499-4111-9658-a38abd97127b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c3173c73974ad1a179bb747db2f61d, user_id=288b1b8eaf53425e9cdaadc3b93fffde, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:50.044403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-dbbd5538-54d7-4dca-92d4-99b996ecb4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e96c5ef176473ca3f030597a424e62'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:50.046711 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a405817-e499-4111-9658-a38abd97127b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:50.057363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-dbbd5538-54d7-4dca-92d4-99b996ecb4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e96c5ef176473ca3f030597a424e62'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:50.058088 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 958/1938] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:50 2022] PUT /identity/v3/projects/b1c3173c73974ad1a179bb747db2f61d/users/288b1b8eaf53425e9cdaadc3b93fffde/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:50.058324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-dbbd5538-54d7-4dca-92d4-99b996ecb4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e96c5ef176473ca3f030597a424e62'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:50.059015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-dbbd5538-54d7-4dca-92d4-99b996ecb4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e96c5ef176473ca3f030597a424e62'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:50.068548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcfffc-6c13-48e5-8344-fa6678ba7db1 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:50.068926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcfffc-6c13-48e5-8344-fa6678ba7db1 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:50.069216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcfffc-6c13-48e5-8344-fa6678ba7db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:50.106529 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-04fcfffc-6c13-48e5-8344-fa6678ba7db1 None None] MFA Rules not processed for user `288b1b8eaf53425e9cdaadc3b93fffde`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:50.107741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-04fcfffc-6c13-48e5-8344-fa6678ba7db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:50.138399 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-dbbd5538-54d7-4dca-92d4-99b996ecb4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e96c5ef176473ca3f030597a424e62'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:50.162332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 981/1939] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:49 2022] DELETE /identity/v3/users/e1e96c5ef176473ca3f030597a424e62 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:50.167249 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ed17b-3ead-4f0e-ac43-bcff130e7c8d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:50.167541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ed17b-3ead-4f0e-ac43-bcff130e7c8d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:50.167831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ed17b-3ead-4f0e-ac43-bcff130e7c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:50.196192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a64ed17b-3ead-4f0e-ac43-bcff130e7c8d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:50.197710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a64ed17b-3ead-4f0e-ac43-bcff130e7c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:50.203225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 959/1940] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:50 2022] POST /identity/v3/auth/tokens => generated 3781 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:50.214464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcfffc-6c13-48e5-8344-fa6678ba7db1 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:50.216098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-04fcfffc-6c13-48e5-8344-fa6678ba7db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:50.291470 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcfffc-6c13-48e5-8344-fa6678ba7db1 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:50.313115 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 982/1941] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:50.324166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ed17b-3ead-4f0e-ac43-bcff130e7c8d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:50.325570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a64ed17b-3ead-4f0e-ac43-bcff130e7c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:50.360425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930f0d5-bab0-4527-8b4d-bd287fefa953 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09ddd8f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:50.361177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930f0d5-bab0-4527-8b4d-bd287fefa953 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:50.361807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930f0d5-bab0-4527-8b4d-bd287fefa953 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:50.362102 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930f0d5-bab0-4527-8b4d-bd287fefa953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:50.398925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ed17b-3ead-4f0e-ac43-bcff130e7c8d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:50.403142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010cd91-d76c-4943-91f4-5d039a593de8 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e555c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:50.403910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010cd91-d76c-4943-91f4-5d039a593de8 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:50.404204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010cd91-d76c-4943-91f4-5d039a593de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:50.404491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010cd91-d76c-4943-91f4-5d039a593de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:50.414115 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010cd91-d76c-4943-91f4-5d039a593de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:50.415569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010cd91-d76c-4943-91f4-5d039a593de8 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:50.425938 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 983/1942] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:02:50.436250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930f0d5-bab0-4527-8b4d-bd287fefa953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:50.437687 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930f0d5-bab0-4527-8b4d-bd287fefa953 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:50.446973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 960/1943] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:50 2022] GET /identity/v3/auth/tokens => generated 3781 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:02:50.883769 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010cd91-d76c-4943-91f4-5d039a593de8 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:50.902998 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010cd91-d76c-4943-91f4-5d039a593de8 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:50.906623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded6909-0841-4ccb-b12d-daa795ffd357 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e118c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:50.907148 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded6909-0841-4ccb-b12d-daa795ffd357 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:50.907454 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded6909-0841-4ccb-b12d-daa795ffd357 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:50.907744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded6909-0841-4ccb-b12d-daa795ffd357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:50.909447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-aded6909-0841-4ccb-b12d-daa795ffd357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:50.988925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded6909-0841-4ccb-b12d-daa795ffd357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:50.990533 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded6909-0841-4ccb-b12d-daa795ffd357 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:51.001247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 984/1944] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:50 2022] GET /identity/v3/auth/tokens => generated 3714 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:51.077999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930f0d5-bab0-4527-8b4d-bd287fefa953 service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:51.079270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9930f0d5-bab0-4527-8b4d-bd287fefa953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:51.093372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930f0d5-bab0-4527-8b4d-bd287fefa953 service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:51.098061 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09debc730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:51.098853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:51.099295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:51.099499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] PATH_INFO: `/v3/projects/9f14ff7f1a044695b3b9344615b942d9` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:51.100582 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f14ff7f1a044695b3b9344615b942d9)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:51.102509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:51.243459 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f14ff7f1a044695b3b9344615b942d9', 'request_id': 'req-b66f9322-a76f-4895-8e4b-4d052b2d1570'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:51.256002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f14ff7f1a044695b3b9344615b942d9', 'request_id': 'req-b66f9322-a76f-4895-8e4b-4d052b2d1570'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:51.327274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f14ff7f1a044695b3b9344615b942d9', 'request_id': 'req-b66f9322-a76f-4895-8e4b-4d052b2d1570'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:51.345215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] The token cache is being invalidate because project 9f14ff7f1a044695b3b9344615b942d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:51.345570 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:51.346671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:51.348720 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 961/1945] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:51 2022] DELETE /identity/v3/projects/9f14ff7f1a044695b3b9344615b942d9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:51.352413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded6909-0841-4ccb-b12d-daa795ffd357 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:51.363517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded6909-0841-4ccb-b12d-daa795ffd357 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:51.440371 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e78eb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:51.441349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:51.441849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:51.442207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] PATH_INFO: `/v3/users/35fae204bb4b4a10b7ddd6e96479e0a1` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:51.443655 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=35fae204bb4b4a10b7ddd6e96479e0a1)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:51.449564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:51.670428 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35fae204bb4b4a10b7ddd6e96479e0a1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:51.705042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35fae204bb4b4a10b7ddd6e96479e0a1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:51.705042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35fae204bb4b4a10b7ddd6e96479e0a1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:51.705543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35fae204bb4b4a10b7ddd6e96479e0a1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:51.807867 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35fae204bb4b4a10b7ddd6e96479e0a1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:51.825651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 985/1946] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:51 2022] DELETE /identity/v3/users/35fae204bb4b4a10b7ddd6e96479e0a1 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:52.821341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:52.822874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:52.840022 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f9322-a76f-4895-8e4b-4d052b2d1570 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:52.902307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19bbc8-dfd8-4cb0-b904-2834b31f71c7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PQsHLq5kQBacvE0ZAbog-w, audit_chain_id=['PQsHLq5kQBacvE0ZAbog-w']) at 0x7fe09df0b310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:52.903141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19bbc8-dfd8-4cb0-b904-2834b31f71c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:52.903433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19bbc8-dfd8-4cb0-b904-2834b31f71c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:52.903713 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19bbc8-dfd8-4cb0-b904-2834b31f71c7 admin admin] PATH_INFO: `/v3/users/46e4e775395f4f01b37ae1e6efe87898` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:52.904908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19bbc8-dfd8-4cb0-b904-2834b31f71c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e4e775395f4f01b37ae1e6efe87898)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:52.906836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19bbc8-dfd8-4cb0-b904-2834b31f71c7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:53.153416 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:53.155533 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:53.173013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277513f-2bfd-47ca-be3f-35e7e8c8cf4e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:53.185830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=N-52JeSbSw-h5RB_Gq3m7Q, audit_chain_id=['N-52JeSbSw-h5RB_Gq3m7Q']) at 0x7fe09e78ec40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:53.185830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:53.185830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:53.185830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] PATH_INFO: `/v3/projects/e6111c28dce544299dfa2d274ac5b845` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:53.186250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6111c28dce544299dfa2d274ac5b845)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:53.186250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:53.196122 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-9c19bbc8-dfd8-4cb0-b904-2834b31f71c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e4e775395f4f01b37ae1e6efe87898'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:53.268515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-9c19bbc8-dfd8-4cb0-b904-2834b31f71c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e4e775395f4f01b37ae1e6efe87898'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:53.282728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-9c19bbc8-dfd8-4cb0-b904-2834b31f71c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e4e775395f4f01b37ae1e6efe87898'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:53.283932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-9c19bbc8-dfd8-4cb0-b904-2834b31f71c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e4e775395f4f01b37ae1e6efe87898'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:53.284747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-9c19bbc8-dfd8-4cb0-b904-2834b31f71c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e4e775395f4f01b37ae1e6efe87898'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:53.300129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 962/1947] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:52 2022] DELETE /identity/v3/users/46e4e775395f4f01b37ae1e6efe87898 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:53.329927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6111c28dce544299dfa2d274ac5b845', 'request_id': 'req-50ac62b8-6172-4544-9999-38109fbd38f1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:53.405376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6111c28dce544299dfa2d274ac5b845', 'request_id': 'req-50ac62b8-6172-4544-9999-38109fbd38f1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:53.423641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6111c28dce544299dfa2d274ac5b845', 'request_id': 'req-50ac62b8-6172-4544-9999-38109fbd38f1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:53.437640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] The token cache is being invalidate because project e6111c28dce544299dfa2d274ac5b845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:53.438379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:53.439700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-50ac62b8-6172-4544-9999-38109fbd38f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:53.444817 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 986/1948] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:53 2022] DELETE /identity/v3/projects/e6111c28dce544299dfa2d274ac5b845 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:53.446674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff06a48-d2e5-4a94-bbfb-9142d978459f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:53.447560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff06a48-d2e5-4a94-bbfb-9142d978459f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:53.448306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff06a48-d2e5-4a94-bbfb-9142d978459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:53.475491 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-9ff06a48-d2e5-4a94-bbfb-9142d978459f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:53.476686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9ff06a48-d2e5-4a94-bbfb-9142d978459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:53.548074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 963/1949] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:53.557134 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822085e2-9fd2-47fb-a11e-ae4d4cfa62d9 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:53.557412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822085e2-9fd2-47fb-a11e-ae4d4cfa62d9 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:53.557630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822085e2-9fd2-47fb-a11e-ae4d4cfa62d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:53.584160 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-822085e2-9fd2-47fb-a11e-ae4d4cfa62d9 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:53.585585 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-822085e2-9fd2-47fb-a11e-ae4d4cfa62d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:53.595064 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 987/1950] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:53.599313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff06a48-d2e5-4a94-bbfb-9142d978459f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:53.608840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff06a48-d2e5-4a94-bbfb-9142d978459f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:53.613343 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c83d9f-29ed-47ab-b0d7-9e458475d905 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09e1985e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:53.613939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c83d9f-29ed-47ab-b0d7-9e458475d905 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:53.614235 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c83d9f-29ed-47ab-b0d7-9e458475d905 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:53.614514 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c83d9f-29ed-47ab-b0d7-9e458475d905 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:53.615247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c83d9f-29ed-47ab-b0d7-9e458475d905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:53.615547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c83d9f-29ed-47ab-b0d7-9e458475d905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:53.617141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c83d9f-29ed-47ab-b0d7-9e458475d905 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:53.630405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 964/1951] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:02:53.635943 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822085e2-9fd2-47fb-a11e-ae4d4cfa62d9 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:53.645730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822085e2-9fd2-47fb-a11e-ae4d4cfa62d9 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:53.651050 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1608e-904b-421a-ba43-12f438f041eb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09e4e0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:53.651756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1608e-904b-421a-ba43-12f438f041eb admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:53.652070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1608e-904b-421a-ba43-12f438f041eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:53.652330 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1608e-904b-421a-ba43-12f438f041eb admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:53.652982 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1608e-904b-421a-ba43-12f438f041eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:53.655010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1608e-904b-421a-ba43-12f438f041eb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:53.747483 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 988/1952] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:53 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:53.751617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c83d9f-29ed-47ab-b0d7-9e458475d905 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:53.764213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c83d9f-29ed-47ab-b0d7-9e458475d905 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:53.843548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c7fb-6ded-4cfc-96fd-c53f827cf9f6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09e50f460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:53.846446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c7fb-6ded-4cfc-96fd-c53f827cf9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:53.846446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c7fb-6ded-4cfc-96fd-c53f827cf9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:53.846446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c7fb-6ded-4cfc-96fd-c53f827cf9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:53.846446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06c7fb-6ded-4cfc-96fd-c53f827cf9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:53.847391 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06c7fb-6ded-4cfc-96fd-c53f827cf9f6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:53.887206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1608e-904b-421a-ba43-12f438f041eb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:53.889040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-98b1608e-904b-421a-ba43-12f438f041eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:53.901920 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1608e-904b-421a-ba43-12f438f041eb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:53.906482 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PQsHLq5kQBacvE0ZAbog-w, audit_chain_id=['PQsHLq5kQBacvE0ZAbog-w']) at 0x7fe09e106f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:53.907392 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:53.907744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:53.908093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] PATH_INFO: `/v3/projects/2234b3391e204ea49d8e31d3731b822c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:53.909276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2234b3391e204ea49d8e31d3731b822c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:53.912174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:53.996144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 965/1953] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:53 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:53.997761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c7fb-6ded-4cfc-96fd-c53f827cf9f6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:54.019410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c7fb-6ded-4cfc-96fd-c53f827cf9f6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:54.032331 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb592e0f-b1a8-4ca7-b774-b08d844617e6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09df0b040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:54.033704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb592e0f-b1a8-4ca7-b774-b08d844617e6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:54.034284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb592e0f-b1a8-4ca7-b774-b08d844617e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:54.035050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb592e0f-b1a8-4ca7-b774-b08d844617e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:54.042345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb592e0f-b1a8-4ca7-b774-b08d844617e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:54.042345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb592e0f-b1a8-4ca7-b774-b08d844617e6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:54.055185 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 966/1954] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:54.059352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb592e0f-b1a8-4ca7-b774-b08d844617e6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:54.065664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2234b3391e204ea49d8e31d3731b822c', 'request_id': 'req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:54.076029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb592e0f-b1a8-4ca7-b774-b08d844617e6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:54.166319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014298f-ae0a-415f-823f-ad5d70d52a04 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09e3d1f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:54.167948 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014298f-ae0a-415f-823f-ad5d70d52a04 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:54.168453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014298f-ae0a-415f-823f-ad5d70d52a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:54.169899 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014298f-ae0a-415f-823f-ad5d70d52a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:54.171333 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014298f-ae0a-415f-823f-ad5d70d52a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:54.173175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014298f-ae0a-415f-823f-ad5d70d52a04 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:54.187302 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 967/1955] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:54.191339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014298f-ae0a-415f-823f-ad5d70d52a04 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:54.203451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014298f-ae0a-415f-823f-ad5d70d52a04 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:54.208664 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03b1c2-c2d6-4a42-9d90-9eaa0c1a7705 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09e16ed30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:54.210440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03b1c2-c2d6-4a42-9d90-9eaa0c1a7705 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:54.210734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03b1c2-c2d6-4a42-9d90-9eaa0c1a7705 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:54.211020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03b1c2-c2d6-4a42-9d90-9eaa0c1a7705 admin admin] PATH_INFO: `/v3/projects/28e23b27615743a2bb67513d3de568c8/users/f9c27629111f492aba6ce885a5ece91d/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:54.213000 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2234b3391e204ea49d8e31d3731b822c', 'request_id': 'req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:54.231783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2234b3391e204ea49d8e31d3731b822c', 'request_id': 'req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:54.236140 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03b1c2-c2d6-4a42-9d90-9eaa0c1a7705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e23b27615743a2bb67513d3de568c8, user_id=f9c27629111f492aba6ce885a5ece91d, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:54.240008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03b1c2-c2d6-4a42-9d90-9eaa0c1a7705 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:54.257185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] The token cache is being invalidate because project 2234b3391e204ea49d8e31d3731b822c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:54.258863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:54.258863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ce8aefb7-6baf-4f75-bd76-ec99ed56e47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:54.260146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 989/1956] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:53 2022] DELETE /identity/v3/projects/2234b3391e204ea49d8e31d3731b822c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:54.271976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025c67-048c-473d-85d0-48e15a661352 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:54.272253 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025c67-048c-473d-85d0-48e15a661352 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:54.272549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025c67-048c-473d-85d0-48e15a661352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:54.299646 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-40025c67-048c-473d-85d0-48e15a661352 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:54.301225 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-40025c67-048c-473d-85d0-48e15a661352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:54.317897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 990/1957] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:54.320462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5d10f-ca6e-4e42-a326-4537fd80bbeb None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:54.320936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5d10f-ca6e-4e42-a326-4537fd80bbeb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:54.321375 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5d10f-ca6e-4e42-a326-4537fd80bbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:54.343410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 968/1958] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:54 2022] PUT /identity/v3/projects/28e23b27615743a2bb67513d3de568c8/users/f9c27629111f492aba6ce885a5ece91d/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:54.350490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97995-8cf3-482c-b65b-be2a1bc403f1 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:54.350848 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97995-8cf3-482c-b65b-be2a1bc403f1 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:54.351346 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d97995-8cf3-482c-b65b-be2a1bc403f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:54.361369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a2c5d10f-ca6e-4e42-a326-4537fd80bbeb None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:54.362757 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a2c5d10f-ca6e-4e42-a326-4537fd80bbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:54.394308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c1d97995-8cf3-482c-b65b-be2a1bc403f1 None None] MFA Rules not processed for user `f9c27629111f492aba6ce885a5ece91d`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:54.396069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c1d97995-8cf3-482c-b65b-be2a1bc403f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:54.470228 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 991/1959] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:54.481823 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5d10f-ca6e-4e42-a326-4537fd80bbeb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:54.485530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5d10f-ca6e-4e42-a326-4537fd80bbeb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:54.512965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 969/1960] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:54 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:54.514698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97995-8cf3-482c-b65b-be2a1bc403f1 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:54.515871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82aae8-2bc9-4f19-b068-c37bf66911d8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e4442b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:54.524419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c1d97995-8cf3-482c-b65b-be2a1bc403f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:54.524546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82aae8-2bc9-4f19-b068-c37bf66911d8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:54.524546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82aae8-2bc9-4f19-b068-c37bf66911d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:54.524546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82aae8-2bc9-4f19-b068-c37bf66911d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:54.524546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82aae8-2bc9-4f19-b068-c37bf66911d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:54.524546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82aae8-2bc9-4f19-b068-c37bf66911d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:54.524546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82aae8-2bc9-4f19-b068-c37bf66911d8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:54.534947 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d97995-8cf3-482c-b65b-be2a1bc403f1 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:54.540417 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b0c65-2c76-4be8-9522-1ea2ed1b9c3b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09e3d1f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:54.542483 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b0c65-2c76-4be8-9522-1ea2ed1b9c3b admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:54.542853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b0c65-2c76-4be8-9522-1ea2ed1b9c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:54.543244 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b0c65-2c76-4be8-9522-1ea2ed1b9c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:54.544107 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b0c65-2c76-4be8-9522-1ea2ed1b9c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:54.546867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b0c65-2c76-4be8-9522-1ea2ed1b9c3b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:54.560383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 992/1961] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:02:54.561618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82aae8-2bc9-4f19-b068-c37bf66911d8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:54.574098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82aae8-2bc9-4f19-b068-c37bf66911d8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:54.578822 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb5e97-9dc9-4078-96d3-299748755e5e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09ded1640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:54.579462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb5e97-9dc9-4078-96d3-299748755e5e admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:54.579825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb5e97-9dc9-4078-96d3-299748755e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:54.580111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb5e97-9dc9-4078-96d3-299748755e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:54.580751 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb5e97-9dc9-4078-96d3-299748755e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:54.582680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb5e97-9dc9-4078-96d3-299748755e5e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:54.707649 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 970/1962] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:54 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:54.711870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b0c65-2c76-4be8-9522-1ea2ed1b9c3b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:54.719983 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 993/1963] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:54 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:54.720740 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb5e97-9dc9-4078-96d3-299748755e5e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:54.805175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b0c65-2c76-4be8-9522-1ea2ed1b9c3b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:54.824462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb5e97-9dc9-4078-96d3-299748755e5e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:54.830747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2590fde-334e-4650-b393-7cdb9b03770e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e1558e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:54.831256 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590fde-334e-4650-b393-7cdb9b03770e admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:54.831619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590fde-334e-4650-b393-7cdb9b03770e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:54.831974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590fde-334e-4650-b393-7cdb9b03770e admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:54.832684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2590fde-334e-4650-b393-7cdb9b03770e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:54.835697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2590fde-334e-4650-b393-7cdb9b03770e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:54.891357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d920a1-2a93-4af7-a8cb-13820cb9d9fd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09e518d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:54.892101 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d920a1-2a93-4af7-a8cb-13820cb9d9fd admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:54.892272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d920a1-2a93-4af7-a8cb-13820cb9d9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:54.892561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d920a1-2a93-4af7-a8cb-13820cb9d9fd admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:54.893211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d920a1-2a93-4af7-a8cb-13820cb9d9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:54.895318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d920a1-2a93-4af7-a8cb-13820cb9d9fd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.009218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 994/1964] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:54 2022] POST /identity/v3/users => generated 286 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:55.014032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2590fde-334e-4650-b393-7cdb9b03770e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.023833 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2590fde-334e-4650-b393-7cdb9b03770e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.034686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0bbf4-697b-410a-a407-1e8ed1fd9c20 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e269460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.035965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0bbf4-697b-410a-a407-1e8ed1fd9c20 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.041447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0bbf4-697b-410a-a407-1e8ed1fd9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.041447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0bbf4-697b-410a-a407-1e8ed1fd9c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.041447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0bbf4-697b-410a-a407-1e8ed1fd9c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.041447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0bbf4-697b-410a-a407-1e8ed1fd9c20 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.051605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 995/1965] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:55.055652 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0bbf4-697b-410a-a407-1e8ed1fd9c20 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.066131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0bbf4-697b-410a-a407-1e8ed1fd9c20 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.071102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ed8f-c016-4d63-88d6-8eaa4718bb55 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e55f610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.071752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ed8f-c016-4d63-88d6-8eaa4718bb55 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.072186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ed8f-c016-4d63-88d6-8eaa4718bb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.072462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ed8f-c016-4d63-88d6-8eaa4718bb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.073710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 971/1966] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:54 2022] POST /identity/v3/users => generated 298 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:55.076258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504ed8f-c016-4d63-88d6-8eaa4718bb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.077220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d920a1-2a93-4af7-a8cb-13820cb9d9fd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.077845 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504ed8f-c016-4d63-88d6-8eaa4718bb55 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.091542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d920a1-2a93-4af7-a8cb-13820cb9d9fd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.098452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 996/1967] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:55.098587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efb490-cbd1-4ffe-9138-22bc851a66b3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09e143e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.098587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efb490-cbd1-4ffe-9138-22bc851a66b3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.098587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efb490-cbd1-4ffe-9138-22bc851a66b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.098587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efb490-cbd1-4ffe-9138-22bc851a66b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.098899 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efb490-cbd1-4ffe-9138-22bc851a66b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.100577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efb490-cbd1-4ffe-9138-22bc851a66b3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.101329 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ed8f-c016-4d63-88d6-8eaa4718bb55 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.112014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ed8f-c016-4d63-88d6-8eaa4718bb55 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.112534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 972/1968] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:55.117055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efb490-cbd1-4ffe-9138-22bc851a66b3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.121538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05620041-0763-4772-a3e0-1dae71ca4831 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e55f820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.127284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620041-0763-4772-a3e0-1dae71ca4831 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.127284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620041-0763-4772-a3e0-1dae71ca4831 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.127284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05620041-0763-4772-a3e0-1dae71ca4831 admin admin] PATH_INFO: `/v3/projects/0fee780e43a84255b33934a96c9c8025/users/14c87e9dc4c14387bc0a2cac9d8791b6/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.128714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efb490-cbd1-4ffe-9138-22bc851a66b3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.135063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3531c-f2a6-4294-a8eb-8a8778d17227 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09e198e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.136358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3531c-f2a6-4294-a8eb-8a8778d17227 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.136358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3531c-f2a6-4294-a8eb-8a8778d17227 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.136553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3531c-f2a6-4294-a8eb-8a8778d17227 admin admin] PATH_INFO: `/v3/projects/cbc88e420d8f4e1f81b9ed1e326f09ef/users/21f25b9ce1ad42ba880808c798b3b6ce/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.143829 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05620041-0763-4772-a3e0-1dae71ca4831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fee780e43a84255b33934a96c9c8025, user_id=14c87e9dc4c14387bc0a2cac9d8791b6, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.146026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05620041-0763-4772-a3e0-1dae71ca4831 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.158781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3531c-f2a6-4294-a8eb-8a8778d17227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc88e420d8f4e1f81b9ed1e326f09ef, user_id=21f25b9ce1ad42ba880808c798b3b6ce, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.161676 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3531c-f2a6-4294-a8eb-8a8778d17227 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.270937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 997/1969] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:55 2022] PUT /identity/v3/projects/0fee780e43a84255b33934a96c9c8025/users/14c87e9dc4c14387bc0a2cac9d8791b6/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:55.281352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a946b-99bd-4eb7-975d-68bc58485db2 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.281743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a946b-99bd-4eb7-975d-68bc58485db2 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.282256 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a946b-99bd-4eb7-975d-68bc58485db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.308302 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 973/1970] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:55 2022] PUT /identity/v3/projects/cbc88e420d8f4e1f81b9ed1e326f09ef/users/21f25b9ce1ad42ba880808c798b3b6ce/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:55.309412 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3531c-f2a6-4294-a8eb-8a8778d17227 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.329142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-2f2a946b-99bd-4eb7-975d-68bc58485db2 None None] MFA Rules not processed for user `14c87e9dc4c14387bc0a2cac9d8791b6`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:55.330478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2f2a946b-99bd-4eb7-975d-68bc58485db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:55.387774 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3531c-f2a6-4294-a8eb-8a8778d17227 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.394308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928befe-8976-44d7-96d5-451d9f4f31d8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09de6c4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.394955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928befe-8976-44d7-96d5-451d9f4f31d8 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.395276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928befe-8976-44d7-96d5-451d9f4f31d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.395558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928befe-8976-44d7-96d5-451d9f4f31d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.396271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928befe-8976-44d7-96d5-451d9f4f31d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.397901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928befe-8976-44d7-96d5-451d9f4f31d8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.419378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 998/1971] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:55 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:02:55.421716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a946b-99bd-4eb7-975d-68bc58485db2 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.427161 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 974/1972] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:55.428762 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928befe-8976-44d7-96d5-451d9f4f31d8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.434671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a946b-99bd-4eb7-975d-68bc58485db2 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.441312 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de757365-2eb0-4105-8de0-ffd36e5f1dd5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e14e6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.442102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de757365-2eb0-4105-8de0-ffd36e5f1dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.442548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de757365-2eb0-4105-8de0-ffd36e5f1dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.442929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de757365-2eb0-4105-8de0-ffd36e5f1dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.443561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928befe-8976-44d7-96d5-451d9f4f31d8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.443856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de757365-2eb0-4105-8de0-ffd36e5f1dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.445951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de757365-2eb0-4105-8de0-ffd36e5f1dd5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.450099 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf5c99-35f7-414f-ba7f-969a3d9fdaa4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09e3e9eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.451257 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5c99-35f7-414f-ba7f-969a3d9fdaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.451552 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5c99-35f7-414f-ba7f-969a3d9fdaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.451836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5c99-35f7-414f-ba7f-969a3d9fdaa4 admin admin] PATH_INFO: `/v3/projects/cbc88e420d8f4e1f81b9ed1e326f09ef/users/21f25b9ce1ad42ba880808c798b3b6ce/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.454831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf5c99-35f7-414f-ba7f-969a3d9fdaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc88e420d8f4e1f81b9ed1e326f09ef, user_id=21f25b9ce1ad42ba880808c798b3b6ce, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.458494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf5c99-35f7-414f-ba7f-969a3d9fdaa4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.474232 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 975/1973] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:55 2022] PUT /identity/v3/projects/cbc88e420d8f4e1f81b9ed1e326f09ef/users/21f25b9ce1ad42ba880808c798b3b6ce/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:55.488604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29f36-9fce-45c1-9148-233d99c7f7d1 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.488897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29f36-9fce-45c1-9148-233d99c7f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.489183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29f36-9fce-45c1-9148-233d99c7f7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.538886 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c7a29f36-9fce-45c1-9148-233d99c7f7d1 None None] MFA Rules not processed for user `21f25b9ce1ad42ba880808c798b3b6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:55.540191 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c7a29f36-9fce-45c1-9148-233d99c7f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:55.590698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 999/1974] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:55 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:55.594718 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de757365-2eb0-4105-8de0-ffd36e5f1dd5 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.639408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 976/1975] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:55 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:55.651727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29f36-9fce-45c1-9148-233d99c7f7d1 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.653167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c7a29f36-9fce-45c1-9148-233d99c7f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:55.679806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de757365-2eb0-4105-8de0-ffd36e5f1dd5 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.686395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa27c4-80c4-4ce0-aa74-ee8315fd5ba7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e62fc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.687018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa27c4-80c4-4ce0-aa74-ee8315fd5ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.687360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa27c4-80c4-4ce0-aa74-ee8315fd5ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.687652 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa27c4-80c4-4ce0-aa74-ee8315fd5ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.688298 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa27c4-80c4-4ce0-aa74-ee8315fd5ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.690383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa27c4-80c4-4ce0-aa74-ee8315fd5ba7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.728024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29f36-9fce-45c1-9148-233d99c7f7d1 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.790392 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1000/1976] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:55 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:55.797072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa27c4-80c4-4ce0-aa74-ee8315fd5ba7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.812521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b62ef-c165-498f-ab4e-ebca552fed76 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e143fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.812521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b62ef-c165-498f-ab4e-ebca552fed76 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.812521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b62ef-c165-498f-ab4e-ebca552fed76 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.812926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b62ef-c165-498f-ab4e-ebca552fed76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.818277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa27c4-80c4-4ce0-aa74-ee8315fd5ba7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.823220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d3e93-4b99-49dd-af3b-c8eec2029f96 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09df24040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.823882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d3e93-4b99-49dd-af3b-c8eec2029f96 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.824128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d3e93-4b99-49dd-af3b-c8eec2029f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.824859 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d3e93-4b99-49dd-af3b-c8eec2029f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.825081 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d3e93-4b99-49dd-af3b-c8eec2029f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.826900 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d3e93-4b99-49dd-af3b-c8eec2029f96 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.841406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1001/1977] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:55.841406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d3e93-4b99-49dd-af3b-c8eec2029f96 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.843104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-af5d3e93-4b99-49dd-af3b-c8eec2029f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:55.856666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d3e93-4b99-49dd-af3b-c8eec2029f96 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.861891 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e4f36d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.862908 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.864300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.864300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] PATH_INFO: `/v3/users/6de6f32e63ed4f798f4b897ac3bdd9d0` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.864851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de6f32e63ed4f798f4b897ac3bdd9d0)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.866856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.893510 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b62ef-c165-498f-ab4e-ebca552fed76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.894954 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b62ef-c165-498f-ab4e-ebca552fed76 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:55.906747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 977/1978] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:55 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:02:55.907694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b62ef-c165-498f-ab4e-ebca552fed76 service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:55.919555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b62ef-c165-498f-ab4e-ebca552fed76 service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:55.925814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a6db1-0197-4ab0-81ff-0461ba3dbbea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e363130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:55.926907 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a6db1-0197-4ab0-81ff-0461ba3dbbea admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:55.927300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a6db1-0197-4ab0-81ff-0461ba3dbbea admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:55.927590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a6db1-0197-4ab0-81ff-0461ba3dbbea admin admin] PATH_INFO: `/v3/projects/1c35870b76cf43199a807cfcf668d083/users/aa2fdb8bdb2349358d1af9384ce034a1/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:55.951699 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a6db1-0197-4ab0-81ff-0461ba3dbbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c35870b76cf43199a807cfcf668d083, user_id=aa2fdb8bdb2349358d1af9384ce034a1, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:55.954408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a6db1-0197-4ab0-81ff-0461ba3dbbea admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:56.046446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de6f32e63ed4f798f4b897ac3bdd9d0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:56.060030 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de6f32e63ed4f798f4b897ac3bdd9d0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:56.060441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 978/1979] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:55 2022] PUT /identity/v3/projects/1c35870b76cf43199a807cfcf668d083/users/aa2fdb8bdb2349358d1af9384ce034a1/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:56.062245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de6f32e63ed4f798f4b897ac3bdd9d0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:56.062905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de6f32e63ed4f798f4b897ac3bdd9d0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:56.067313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a6db1-0197-4ab0-81ff-0461ba3dbbea admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:56.068901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-018a6db1-0197-4ab0-81ff-0461ba3dbbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:56.127190 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de6f32e63ed4f798f4b897ac3bdd9d0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:56.141171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a6db1-0197-4ab0-81ff-0461ba3dbbea admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:56.141808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1002/1980] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:55 2022] DELETE /identity/v3/users/6de6f32e63ed4f798f4b897ac3bdd9d0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:56.210502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c8b39-96c3-4eba-a942-3442a538f511 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09ddd8df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:56.211251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c8b39-96c3-4eba-a942-3442a538f511 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:56.211546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c8b39-96c3-4eba-a942-3442a538f511 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:56.211829 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c8b39-96c3-4eba-a942-3442a538f511 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:56.212610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c8b39-96c3-4eba-a942-3442a538f511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:56.214276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c8b39-96c3-4eba-a942-3442a538f511 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:56.224461 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 979/1981] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:02:56.228693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:56.238240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d6e73-23d9-4462-bc30-65031e38199d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:56.243288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3edce-8443-497b-a25f-bca221b5ab6e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e3b5fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:56.245348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3edce-8443-497b-a25f-bca221b5ab6e admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:56.245482 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3edce-8443-497b-a25f-bca221b5ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:56.245681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3edce-8443-497b-a25f-bca221b5ab6e admin admin] PATH_INFO: `/v3/projects/1c35870b76cf43199a807cfcf668d083/users/aa2fdb8bdb2349358d1af9384ce034a1/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:56.247538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3edce-8443-497b-a25f-bca221b5ab6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c35870b76cf43199a807cfcf668d083, user_id=aa2fdb8bdb2349358d1af9384ce034a1, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:56.250166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3edce-8443-497b-a25f-bca221b5ab6e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:56.261727 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1003/1982] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:56 2022] PUT /identity/v3/projects/1c35870b76cf43199a807cfcf668d083/users/aa2fdb8bdb2349358d1af9384ce034a1/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:56.272444 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ea62a-9b7f-4016-b7da-719c475ad95c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:56.272744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ea62a-9b7f-4016-b7da-719c475ad95c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:56.273031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ea62a-9b7f-4016-b7da-719c475ad95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:56.309840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-6d2ea62a-9b7f-4016-b7da-719c475ad95c None None] MFA Rules not processed for user `aa2fdb8bdb2349358d1af9384ce034a1`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:56.311055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-6d2ea62a-9b7f-4016-b7da-719c475ad95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:56.387260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 980/1983] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:56 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:56.398537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3edce-8443-497b-a25f-bca221b5ab6e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:56.400412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-75c3edce-8443-497b-a25f-bca221b5ab6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:56.466131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3edce-8443-497b-a25f-bca221b5ab6e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:56.469996 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe37d89-a294-4d1c-8e2a-728c70a2593d service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e1a18b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:56.470897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe37d89-a294-4d1c-8e2a-728c70a2593d service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:56.470897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe37d89-a294-4d1c-8e2a-728c70a2593d service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:56.473536 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe37d89-a294-4d1c-8e2a-728c70a2593d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:56.485035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ea62a-9b7f-4016-b7da-719c475ad95c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:56.486669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe37d89-a294-4d1c-8e2a-728c70a2593d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:56.486979 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-6d2ea62a-9b7f-4016-b7da-719c475ad95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:56.488157 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe37d89-a294-4d1c-8e2a-728c70a2593d service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:56.499935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1004/1984] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:56 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:56.562443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ea62a-9b7f-4016-b7da-719c475ad95c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:56.567106 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e1df130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:56.571297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:56.571297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:56.571297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] PATH_INFO: `/v3/projects/97ba918f80ee4a9db77d523cdc9a90da` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:56.571297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ba918f80ee4a9db77d523cdc9a90da)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:56.571715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:56.722940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ba918f80ee4a9db77d523cdc9a90da', 'request_id': 'req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:56.729681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe37d89-a294-4d1c-8e2a-728c70a2593d service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:56.735472 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ba918f80ee4a9db77d523cdc9a90da', 'request_id': 'req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:56.738545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe37d89-a294-4d1c-8e2a-728c70a2593d service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:56.798095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6db33-cba4-4734-a846-e6f5e0816bb4 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09defe820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:56.798688 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6db33-cba4-4734-a846-e6f5e0816bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:56.811181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6db33-cba4-4734-a846-e6f5e0816bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:56.811181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6db33-cba4-4734-a846-e6f5e0816bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:56.811181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-edf6db33-cba4-4734-a846-e6f5e0816bb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:56.862984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ba918f80ee4a9db77d523cdc9a90da', 'request_id': 'req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:56.870645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6db33-cba4-4734-a846-e6f5e0816bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:56.872152 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6db33-cba4-4734-a846-e6f5e0816bb4 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:56.874814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] The token cache is being invalidate because project 97ba918f80ee4a9db77d523cdc9a90da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:56.875103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:56.875781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:56.877255 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 981/1985] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:56 2022] DELETE /identity/v3/projects/97ba918f80ee4a9db77d523cdc9a90da => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:56.881313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:56.881446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1005/1986] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:56 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:02:56.882699 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:56.982485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2ae7e-3b75-458e-b232-e23f549cd3c6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:56.987659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bc7c2-0cca-452c-b345-43145bf5c884 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e143fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:56.988603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bc7c2-0cca-452c-b345-43145bf5c884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:56.988965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bc7c2-0cca-452c-b345-43145bf5c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:56.989343 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bc7c2-0cca-452c-b345-43145bf5c884 admin admin] PATH_INFO: `/v3/users/7727ae17f1f94129802c6f20d1989992` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:56.990615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bc7c2-0cca-452c-b345-43145bf5c884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7727ae17f1f94129802c6f20d1989992)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:56.993239 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bc7c2-0cca-452c-b345-43145bf5c884 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:57.311045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bc1bc7c2-0cca-452c-b345-43145bf5c884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7727ae17f1f94129802c6f20d1989992'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:57.382064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bc1bc7c2-0cca-452c-b345-43145bf5c884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7727ae17f1f94129802c6f20d1989992'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:57.394641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bc1bc7c2-0cca-452c-b345-43145bf5c884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7727ae17f1f94129802c6f20d1989992'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:57.395307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bc1bc7c2-0cca-452c-b345-43145bf5c884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7727ae17f1f94129802c6f20d1989992'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:57.395912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bc1bc7c2-0cca-452c-b345-43145bf5c884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7727ae17f1f94129802c6f20d1989992'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:57.409148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 982/1987] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:56 2022] DELETE /identity/v3/users/7727ae17f1f94129802c6f20d1989992 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:57.676881 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6db33-cba4-4734-a846-e6f5e0816bb4 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:57.688386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6db33-cba4-4734-a846-e6f5e0816bb4 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:57.751740 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TkXMC-pXSHmW8tV-gsCi3g, audit_chain_id=['TkXMC-pXSHmW8tV-gsCi3g']) at 0x7fe09e7b7eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:57.752524 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:57.752812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:57.753094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] PATH_INFO: `/v3/projects/ec54d6ff24f84281b85f72f20db5347d` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:57.754180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec54d6ff24f84281b85f72f20db5347d)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:57.756099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:57.888254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec54d6ff24f84281b85f72f20db5347d', 'request_id': 'req-64fbb289-e4e7-48be-bbfc-a287692a83a6'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:57.960830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec54d6ff24f84281b85f72f20db5347d', 'request_id': 'req-64fbb289-e4e7-48be-bbfc-a287692a83a6'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:57.972718 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec54d6ff24f84281b85f72f20db5347d', 'request_id': 'req-64fbb289-e4e7-48be-bbfc-a287692a83a6'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:57.983287 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] The token cache is being invalidate because project ec54d6ff24f84281b85f72f20db5347d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:57.983578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:57.984239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-64fbb289-e4e7-48be-bbfc-a287692a83a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:57.985703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1006/1988] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:57 2022] DELETE /identity/v3/projects/ec54d6ff24f84281b85f72f20db5347d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:57.991433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e1e8c-ffd8-4e5e-993c-31bce1400f77 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:57.991906 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e1e8c-ffd8-4e5e-993c-31bce1400f77 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:57.991997 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e1e8c-ffd8-4e5e-993c-31bce1400f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:58.015549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-271e1e8c-ffd8-4e5e-993c-31bce1400f77 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:58.016702 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-271e1e8c-ffd8-4e5e-993c-31bce1400f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:58.086111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 983/1989] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:58.094375 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f1cfa-2c1b-4645-8e3b-961872c8dcc6 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:58.094375 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f1cfa-2c1b-4645-8e3b-961872c8dcc6 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:58.094570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f1cfa-2c1b-4645-8e3b-961872c8dcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:58.118117 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-0b8f1cfa-2c1b-4645-8e3b-961872c8dcc6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:58.119923 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0b8f1cfa-2c1b-4645-8e3b-961872c8dcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:58.130891 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1007/1990] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:58.135238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e1e8c-ffd8-4e5e-993c-31bce1400f77 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:58.145103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e1e8c-ffd8-4e5e-993c-31bce1400f77 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:58.150720 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a016157-a8e1-4b83-8965-cd45d0a4aab2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1UnMtlRyR5GPr4zRLe2qyg, audit_chain_id=['1UnMtlRyR5GPr4zRLe2qyg']) at 0x7fe09e162520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:58.151357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a016157-a8e1-4b83-8965-cd45d0a4aab2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:58.151750 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a016157-a8e1-4b83-8965-cd45d0a4aab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:58.151918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a016157-a8e1-4b83-8965-cd45d0a4aab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:58.152641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a016157-a8e1-4b83-8965-cd45d0a4aab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:02:58.152934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a016157-a8e1-4b83-8965-cd45d0a4aab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:58.154533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a016157-a8e1-4b83-8965-cd45d0a4aab2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:58.168394 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 984/1991] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:02:58.173041 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f1cfa-2c1b-4645-8e3b-961872c8dcc6 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:58.182800 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f1cfa-2c1b-4645-8e3b-961872c8dcc6 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:58.187301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c90e1-2a09-45f7-851f-4567ce20c3fd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1UnMtlRyR5GPr4zRLe2qyg, audit_chain_id=['1UnMtlRyR5GPr4zRLe2qyg']) at 0x7fe09e196af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:58.187882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c90e1-2a09-45f7-851f-4567ce20c3fd admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:58.188175 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c90e1-2a09-45f7-851f-4567ce20c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:58.188457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c90e1-2a09-45f7-851f-4567ce20c3fd admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:58.189166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c90e1-2a09-45f7-851f-4567ce20c3fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:58.190969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c90e1-2a09-45f7-851f-4567ce20c3fd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:58.283580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1008/1992] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:02:58 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:02:58.287820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a016157-a8e1-4b83-8965-cd45d0a4aab2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:58.300098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a016157-a8e1-4b83-8965-cd45d0a4aab2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:58.368573 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fda851-61b8-4374-a64e-7696e70aa019 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1UnMtlRyR5GPr4zRLe2qyg, audit_chain_id=['1UnMtlRyR5GPr4zRLe2qyg']) at 0x7fe09e3de190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:58.369651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fda851-61b8-4374-a64e-7696e70aa019 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:58.369944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fda851-61b8-4374-a64e-7696e70aa019 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:58.370226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fda851-61b8-4374-a64e-7696e70aa019 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:58.370873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fda851-61b8-4374-a64e-7696e70aa019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:58.372820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fda851-61b8-4374-a64e-7696e70aa019 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:58.508034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 985/1993] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:02:58 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:02:58.509869 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c90e1-2a09-45f7-851f-4567ce20c3fd admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:58.522312 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c90e1-2a09-45f7-851f-4567ce20c3fd admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:58.531481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf724b-ee1b-4300-85bb-e57da24d3720 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1UnMtlRyR5GPr4zRLe2qyg, audit_chain_id=['1UnMtlRyR5GPr4zRLe2qyg']) at 0x7fe09e1c07f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:58.532122 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf724b-ee1b-4300-85bb-e57da24d3720 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:58.532420 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf724b-ee1b-4300-85bb-e57da24d3720 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:58.532706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf724b-ee1b-4300-85bb-e57da24d3720 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:58.533495 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf724b-ee1b-4300-85bb-e57da24d3720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:58.535196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf724b-ee1b-4300-85bb-e57da24d3720 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:58.548093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1009/1994] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:58.551788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fda851-61b8-4374-a64e-7696e70aa019 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:58.562093 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fda851-61b8-4374-a64e-7696e70aa019 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:58.566655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304de2d-e6a6-4e1b-ba0a-f0724c64c4be admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1UnMtlRyR5GPr4zRLe2qyg, audit_chain_id=['1UnMtlRyR5GPr4zRLe2qyg']) at 0x7fe09de546a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:58.567294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304de2d-e6a6-4e1b-ba0a-f0724c64c4be admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:58.567574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304de2d-e6a6-4e1b-ba0a-f0724c64c4be admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:58.567862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304de2d-e6a6-4e1b-ba0a-f0724c64c4be admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:58.568564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304de2d-e6a6-4e1b-ba0a-f0724c64c4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:58.570216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304de2d-e6a6-4e1b-ba0a-f0724c64c4be admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:58.586506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 986/1995] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:02:58.591600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf724b-ee1b-4300-85bb-e57da24d3720 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:58.601167 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf724b-ee1b-4300-85bb-e57da24d3720 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:58.606321 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4ba50-81ba-4d77-86ce-db2af89c5016 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1UnMtlRyR5GPr4zRLe2qyg, audit_chain_id=['1UnMtlRyR5GPr4zRLe2qyg']) at 0x7fe09e705b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:58.607182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ba50-81ba-4d77-86ce-db2af89c5016 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:58.607483 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ba50-81ba-4d77-86ce-db2af89c5016 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:58.607766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ba50-81ba-4d77-86ce-db2af89c5016 admin admin] PATH_INFO: `/v3/projects/ffcd1f62155b481e9b67e2c6b4453142/users/b75bc315501e40478faac752d3872790/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:58.626417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4ba50-81ba-4d77-86ce-db2af89c5016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcd1f62155b481e9b67e2c6b4453142, user_id=b75bc315501e40478faac752d3872790, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:58.629028 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4ba50-81ba-4d77-86ce-db2af89c5016 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:58.699204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1010/1996] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:02:58 2022] PUT /identity/v3/projects/ffcd1f62155b481e9b67e2c6b4453142/users/b75bc315501e40478faac752d3872790/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:58.709460 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017416f-f9e4-4dab-a251-b474c64b644e None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:58.709850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017416f-f9e4-4dab-a251-b474c64b644e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:58.710169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017416f-f9e4-4dab-a251-b474c64b644e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:58.746855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d017416f-f9e4-4dab-a251-b474c64b644e None None] MFA Rules not processed for user `b75bc315501e40478faac752d3872790`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:02:58.748169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d017416f-f9e4-4dab-a251-b474c64b644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:58.823690 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 987/1997] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:02:58 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:02:58.833657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4ba50-81ba-4d77-86ce-db2af89c5016 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:58.835320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-bda4ba50-81ba-4d77-86ce-db2af89c5016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:58.903774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4ba50-81ba-4d77-86ce-db2af89c5016 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:58.907408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c0af-593e-438d-9245-e5e95c7b04a5 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e480dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:58.907999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c0af-593e-438d-9245-e5e95c7b04a5 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:58.908301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c0af-593e-438d-9245-e5e95c7b04a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:58.908589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c0af-593e-438d-9245-e5e95c7b04a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:58.918104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37c0af-593e-438d-9245-e5e95c7b04a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:58.919518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37c0af-593e-438d-9245-e5e95c7b04a5 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:02:58.930528 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1011/1998] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:02:58 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:05.013882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017416f-f9e4-4dab-a251-b474c64b644e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:05.093358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017416f-f9e4-4dab-a251-b474c64b644e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:05.098032 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1UnMtlRyR5GPr4zRLe2qyg, audit_chain_id=['1UnMtlRyR5GPr4zRLe2qyg']) at 0x7fe09dec96d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:05.098863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:05.099683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:05.099683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] PATH_INFO: `/v3/users/b75bc315501e40478faac752d3872790` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:05.100787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75bc315501e40478faac752d3872790)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:05.102759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:05.364711 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75bc315501e40478faac752d3872790'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:05.450910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75bc315501e40478faac752d3872790'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:05.465578 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75bc315501e40478faac752d3872790'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:05.465578 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75bc315501e40478faac752d3872790'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:05.465578 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75bc315501e40478faac752d3872790'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:05.478882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 988/1999] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:03:05 2022] DELETE /identity/v3/users/b75bc315501e40478faac752d3872790 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:05.483282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59668a-0c76-4024-894d-5cfb380a9888 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:05.483768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59668a-0c76-4024-894d-5cfb380a9888 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:05.483878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59668a-0c76-4024-894d-5cfb380a9888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:05.515484 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-aa59668a-0c76-4024-894d-5cfb380a9888 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:05.515484 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-aa59668a-0c76-4024-894d-5cfb380a9888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:05.575538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1012/2000] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:05.585623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:05.586964 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:05.653110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35368bee-a012-4513-afd3-bb9cf091c4a7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:05.656568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a7f39-c336-4f7e-8814-aac966c6b647 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e1d7df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:05.657153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7f39-c336-4f7e-8814-aac966c6b647 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:05.657440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7f39-c336-4f7e-8814-aac966c6b647 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:05.657854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7f39-c336-4f7e-8814-aac966c6b647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:05.667741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a7f39-c336-4f7e-8814-aac966c6b647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:05.669203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a7f39-c336-4f7e-8814-aac966c6b647 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:05.679089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 989/2001] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:05 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:06.221064 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59668a-0c76-4024-894d-5cfb380a9888 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:06.222602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-aa59668a-0c76-4024-894d-5cfb380a9888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:06.235606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59668a-0c76-4024-894d-5cfb380a9888 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:06.239962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1UnMtlRyR5GPr4zRLe2qyg, audit_chain_id=['1UnMtlRyR5GPr4zRLe2qyg']) at 0x7fe09e474fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:06.240774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:06.241059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:06.241335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] PATH_INFO: `/v3/projects/ffcd1f62155b481e9b67e2c6b4453142` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:06.242422 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcd1f62155b481e9b67e2c6b4453142)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:06.245222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:06.390175 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcd1f62155b481e9b67e2c6b4453142', 'request_id': 'req-df62ecd2-e20b-4955-949f-810a2057d15e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:06.498340 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcd1f62155b481e9b67e2c6b4453142', 'request_id': 'req-df62ecd2-e20b-4955-949f-810a2057d15e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:06.509964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcd1f62155b481e9b67e2c6b4453142', 'request_id': 'req-df62ecd2-e20b-4955-949f-810a2057d15e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:06.520820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] The token cache is being invalidate because project ffcd1f62155b481e9b67e2c6b4453142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:03:06.521232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:06.521990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-df62ecd2-e20b-4955-949f-810a2057d15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:06.524080 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1013/2002] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:03:06 2022] DELETE /identity/v3/projects/ffcd1f62155b481e9b67e2c6b4453142 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:06.529272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af430bc9-dbf8-4611-a8f4-1f7e84958d4c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:06.529682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af430bc9-dbf8-4611-a8f4-1f7e84958d4c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:06.529875 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af430bc9-dbf8-4611-a8f4-1f7e84958d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:06.552852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-af430bc9-dbf8-4611-a8f4-1f7e84958d4c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:06.554077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-af430bc9-dbf8-4611-a8f4-1f7e84958d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:06.629547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 990/2003] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:06.636834 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e5527-9cb1-41c8-b010-bbdb2057c424 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:06.637151 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e5527-9cb1-41c8-b010-bbdb2057c424 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:06.637439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e5527-9cb1-41c8-b010-bbdb2057c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:06.660345 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-7d4e5527-9cb1-41c8-b010-bbdb2057c424 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:06.661504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7d4e5527-9cb1-41c8-b010-bbdb2057c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:06.669302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1014/2004] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:06.673709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af430bc9-dbf8-4611-a8f4-1f7e84958d4c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:06.683866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af430bc9-dbf8-4611-a8f4-1f7e84958d4c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:06.688363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09e3e3-a35c-48b2-8f7a-e5cbb0c88194 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ByzkBjsIS6e4I6Xuk7RRjA, audit_chain_id=['ByzkBjsIS6e4I6Xuk7RRjA']) at 0x7fe09de9dc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:06.688952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09e3e3-a35c-48b2-8f7a-e5cbb0c88194 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:06.689258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09e3e3-a35c-48b2-8f7a-e5cbb0c88194 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:06.689518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09e3e3-a35c-48b2-8f7a-e5cbb0c88194 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:06.690203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09e3e3-a35c-48b2-8f7a-e5cbb0c88194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:03:06.690501 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09e3e3-a35c-48b2-8f7a-e5cbb0c88194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:06.692239 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09e3e3-a35c-48b2-8f7a-e5cbb0c88194 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:06.705336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 991/2005] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:03:06.713253 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e5527-9cb1-41c8-b010-bbdb2057c424 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:06.722318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e5527-9cb1-41c8-b010-bbdb2057c424 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:06.726888 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24529c4-e06a-4edd-9b55-eb06d3a76e0b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ByzkBjsIS6e4I6Xuk7RRjA, audit_chain_id=['ByzkBjsIS6e4I6Xuk7RRjA']) at 0x7fe09de56040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:06.727509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24529c4-e06a-4edd-9b55-eb06d3a76e0b admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:06.727853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24529c4-e06a-4edd-9b55-eb06d3a76e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:06.728665 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24529c4-e06a-4edd-9b55-eb06d3a76e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:06.729344 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24529c4-e06a-4edd-9b55-eb06d3a76e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:06.731390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24529c4-e06a-4edd-9b55-eb06d3a76e0b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:06.876909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1015/2006] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:03:06 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:03:06.880828 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09e3e3-a35c-48b2-8f7a-e5cbb0c88194 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:06.891262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09e3e3-a35c-48b2-8f7a-e5cbb0c88194 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:06.959706 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7cf00-971a-46cb-8e50-9a7d34adbc73 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ByzkBjsIS6e4I6Xuk7RRjA, audit_chain_id=['ByzkBjsIS6e4I6Xuk7RRjA']) at 0x7fe09de6cd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:06.960443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7cf00-971a-46cb-8e50-9a7d34adbc73 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:06.960613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7cf00-971a-46cb-8e50-9a7d34adbc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:06.960896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7cf00-971a-46cb-8e50-9a7d34adbc73 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:06.961547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7cf00-971a-46cb-8e50-9a7d34adbc73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:06.964456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7cf00-971a-46cb-8e50-9a7d34adbc73 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:07.097805 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 992/2007] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:03:06 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:03:07.101856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24529c4-e06a-4edd-9b55-eb06d3a76e0b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:07.111742 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24529c4-e06a-4edd-9b55-eb06d3a76e0b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:07.115988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11236a-7e49-43cb-8310-fa36e7018e20 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ByzkBjsIS6e4I6Xuk7RRjA, audit_chain_id=['ByzkBjsIS6e4I6Xuk7RRjA']) at 0x7fe09de9b640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:07.116587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11236a-7e49-43cb-8310-fa36e7018e20 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:07.116876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11236a-7e49-43cb-8310-fa36e7018e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:07.117158 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11236a-7e49-43cb-8310-fa36e7018e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:07.117851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11236a-7e49-43cb-8310-fa36e7018e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:07.119554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11236a-7e49-43cb-8310-fa36e7018e20 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:07.129485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1016/2008] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:03:07.133234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7cf00-971a-46cb-8e50-9a7d34adbc73 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:07.143489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7cf00-971a-46cb-8e50-9a7d34adbc73 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:07.147999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59bba4-8ee2-4057-8ab4-6e529721ec27 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ByzkBjsIS6e4I6Xuk7RRjA, audit_chain_id=['ByzkBjsIS6e4I6Xuk7RRjA']) at 0x7fe09e94cd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:07.148588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bba4-8ee2-4057-8ab4-6e529721ec27 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:07.148877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bba4-8ee2-4057-8ab4-6e529721ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:07.149162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bba4-8ee2-4057-8ab4-6e529721ec27 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:07.150645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59bba4-8ee2-4057-8ab4-6e529721ec27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:07.152338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59bba4-8ee2-4057-8ab4-6e529721ec27 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:07.162234 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 993/2009] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:03:07.166390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11236a-7e49-43cb-8310-fa36e7018e20 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:07.175935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11236a-7e49-43cb-8310-fa36e7018e20 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:07.180331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a83b51-222a-44ff-9157-a97715c71010 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ByzkBjsIS6e4I6Xuk7RRjA, audit_chain_id=['ByzkBjsIS6e4I6Xuk7RRjA']) at 0x7fe09dde6040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:07.181198 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a83b51-222a-44ff-9157-a97715c71010 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:07.181490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a83b51-222a-44ff-9157-a97715c71010 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:07.181817 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a83b51-222a-44ff-9157-a97715c71010 admin admin] PATH_INFO: `/v3/projects/698ab903e7a64154a98e457b2b2ff209/users/585fbe6c71e2449c9e5b28e1756c8b2d/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:07.201667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a83b51-222a-44ff-9157-a97715c71010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698ab903e7a64154a98e457b2b2ff209, user_id=585fbe6c71e2449c9e5b28e1756c8b2d, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:07.204338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a83b51-222a-44ff-9157-a97715c71010 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:07.309934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1017/2010] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:03:07 2022] PUT /identity/v3/projects/698ab903e7a64154a98e457b2b2ff209/users/585fbe6c71e2449c9e5b28e1756c8b2d/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:03:07.319968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3675b77-9ce3-4722-aa4e-1b7b3b826e8c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:07.320259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3675b77-9ce3-4722-aa4e-1b7b3b826e8c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:07.320567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3675b77-9ce3-4722-aa4e-1b7b3b826e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:07.357280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e3675b77-9ce3-4722-aa4e-1b7b3b826e8c None None] MFA Rules not processed for user `585fbe6c71e2449c9e5b28e1756c8b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:07.358439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e3675b77-9ce3-4722-aa4e-1b7b3b826e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:07.428742 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 994/2011] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:07 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:07.438860 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a83b51-222a-44ff-9157-a97715c71010 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:07.440562 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-82a83b51-222a-44ff-9157-a97715c71010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:07.505231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a83b51-222a-44ff-9157-a97715c71010 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:07.508834 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34ba90-22e7-4dd4-a60c-8014b69e7afa service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09def99d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:07.510458 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34ba90-22e7-4dd4-a60c-8014b69e7afa service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:07.510752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34ba90-22e7-4dd4-a60c-8014b69e7afa service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:07.511032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34ba90-22e7-4dd4-a60c-8014b69e7afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:07.519426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34ba90-22e7-4dd4-a60c-8014b69e7afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:07.520846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34ba90-22e7-4dd4-a60c-8014b69e7afa service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:07.529388 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1018/2012] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:07 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:07.551460 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3675b77-9ce3-4722-aa4e-1b7b3b826e8c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:07.619940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3675b77-9ce3-4722-aa4e-1b7b3b826e8c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:07.624228 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ByzkBjsIS6e4I6Xuk7RRjA, audit_chain_id=['ByzkBjsIS6e4I6Xuk7RRjA']) at 0x7fe09e472fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:07.625025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:07.625310 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:07.625592 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] PATH_INFO: `/v3/users/585fbe6c71e2449c9e5b28e1756c8b2d` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:07.626704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] RBAC: Authorizing `identity:delete_user(user_id=585fbe6c71e2449c9e5b28e1756c8b2d)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:07.628637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:07.814412 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585fbe6c71e2449c9e5b28e1756c8b2d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:07.926795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585fbe6c71e2449c9e5b28e1756c8b2d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:07.944599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585fbe6c71e2449c9e5b28e1756c8b2d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:07.945326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585fbe6c71e2449c9e5b28e1756c8b2d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:07.946078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585fbe6c71e2449c9e5b28e1756c8b2d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:07.962272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 995/2013] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:03:07 2022] DELETE /identity/v3/users/585fbe6c71e2449c9e5b28e1756c8b2d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:07.966820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef2273-76e8-42e2-9e9a-d597cd894f8d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:07.969583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef2273-76e8-42e2-9e9a-d597cd894f8d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:07.969583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef2273-76e8-42e2-9e9a-d597cd894f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:07.991722 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-2eef2273-76e8-42e2-9e9a-d597cd894f8d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:07.992980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2eef2273-76e8-42e2-9e9a-d597cd894f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:08.065938 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1019/2014] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:08.079748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:08.081207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:08.165241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b268456-bc12-4273-bd12-1625df04857d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:08.169497 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08a451-8593-4c3a-b0d5-a2d94b013a95 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09deed190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:08.170090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08a451-8593-4c3a-b0d5-a2d94b013a95 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:08.170635 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08a451-8593-4c3a-b0d5-a2d94b013a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:08.170929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08a451-8593-4c3a-b0d5-a2d94b013a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:08.180239 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08a451-8593-4c3a-b0d5-a2d94b013a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:08.181958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08a451-8593-4c3a-b0d5-a2d94b013a95 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:08.191912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 996/2015] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:03:08.700842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef2273-76e8-42e2-9e9a-d597cd894f8d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:08.702282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2eef2273-76e8-42e2-9e9a-d597cd894f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:08.713682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef2273-76e8-42e2-9e9a-d597cd894f8d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:08.718131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ByzkBjsIS6e4I6Xuk7RRjA, audit_chain_id=['ByzkBjsIS6e4I6Xuk7RRjA']) at 0x7fe09e680f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:08.728445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:08.728445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:08.728445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] PATH_INFO: `/v3/projects/698ab903e7a64154a98e457b2b2ff209` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:08.728445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698ab903e7a64154a98e457b2b2ff209)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:08.728445 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:08.833569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698ab903e7a64154a98e457b2b2ff209', 'request_id': 'req-359abb2b-7cab-4887-8b0e-5d3e06863694'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:08.896326 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698ab903e7a64154a98e457b2b2ff209', 'request_id': 'req-359abb2b-7cab-4887-8b0e-5d3e06863694'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:08.907925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698ab903e7a64154a98e457b2b2ff209', 'request_id': 'req-359abb2b-7cab-4887-8b0e-5d3e06863694'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:08.918424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] The token cache is being invalidate because project 698ab903e7a64154a98e457b2b2ff209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:03:08.918708 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:08.919374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-359abb2b-7cab-4887-8b0e-5d3e06863694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:08.921107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1020/2016] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:03:08 2022] DELETE /identity/v3/projects/698ab903e7a64154a98e457b2b2ff209 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:08.926063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d9b0-ba15-4486-8962-a15b89800a4c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:08.926536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d9b0-ba15-4486-8962-a15b89800a4c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:08.926616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84d9b0-ba15-4486-8962-a15b89800a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:08.949360 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-7a84d9b0-ba15-4486-8962-a15b89800a4c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:08.950423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7a84d9b0-ba15-4486-8962-a15b89800a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:09.016854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 997/2017] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:09.026742 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a4ea4-a5fb-4c88-b1f8-5826bbc4be31 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:09.027036 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a4ea4-a5fb-4c88-b1f8-5826bbc4be31 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:09.027355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a4ea4-a5fb-4c88-b1f8-5826bbc4be31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:09.051322 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-d18a4ea4-a5fb-4c88-b1f8-5826bbc4be31 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:09.052505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d18a4ea4-a5fb-4c88-b1f8-5826bbc4be31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:09.060495 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1021/2018] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:09.064597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d9b0-ba15-4486-8962-a15b89800a4c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:09.074165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84d9b0-ba15-4486-8962-a15b89800a4c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:09.078572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cff54-865b-408e-98d1-4d1cd24fb691 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kdpyGqvIQ0CCCCkTE1Ja8g, audit_chain_id=['kdpyGqvIQ0CCCCkTE1Ja8g']) at 0x7fe09e3edbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:09.079196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cff54-865b-408e-98d1-4d1cd24fb691 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:09.079495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cff54-865b-408e-98d1-4d1cd24fb691 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:09.079774 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cff54-865b-408e-98d1-4d1cd24fb691 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:09.080562 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cff54-865b-408e-98d1-4d1cd24fb691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:03:09.080886 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cff54-865b-408e-98d1-4d1cd24fb691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:09.082475 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cff54-865b-408e-98d1-4d1cd24fb691 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:09.096646 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 998/2019] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:03:09.100911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a4ea4-a5fb-4c88-b1f8-5826bbc4be31 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:09.110805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a4ea4-a5fb-4c88-b1f8-5826bbc4be31 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:09.116709 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed69d3-5c4a-4583-b4d8-32ceb02bb14d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kdpyGqvIQ0CCCCkTE1Ja8g, audit_chain_id=['kdpyGqvIQ0CCCCkTE1Ja8g']) at 0x7fe09e45d430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:09.117422 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed69d3-5c4a-4583-b4d8-32ceb02bb14d admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:09.117767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed69d3-5c4a-4583-b4d8-32ceb02bb14d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:09.118036 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed69d3-5c4a-4583-b4d8-32ceb02bb14d admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:09.118715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed69d3-5c4a-4583-b4d8-32ceb02bb14d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:09.120955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed69d3-5c4a-4583-b4d8-32ceb02bb14d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:09.220959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1022/2020] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:03:09 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:03:09.222155 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cff54-865b-408e-98d1-4d1cd24fb691 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:09.232468 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cff54-865b-408e-98d1-4d1cd24fb691 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:09.304700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdf4f2-594b-41a2-8e9e-0f5a3297d3fa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kdpyGqvIQ0CCCCkTE1Ja8g, audit_chain_id=['kdpyGqvIQ0CCCCkTE1Ja8g']) at 0x7fe09e1d7a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:09.305318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdf4f2-594b-41a2-8e9e-0f5a3297d3fa admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:09.305611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdf4f2-594b-41a2-8e9e-0f5a3297d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:09.306053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdf4f2-594b-41a2-8e9e-0f5a3297d3fa admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:09.306982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdf4f2-594b-41a2-8e9e-0f5a3297d3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:09.309017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdf4f2-594b-41a2-8e9e-0f5a3297d3fa admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:09.417925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 999/2021] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:03:09 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:03:09.419136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed69d3-5c4a-4583-b4d8-32ceb02bb14d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:09.429262 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed69d3-5c4a-4583-b4d8-32ceb02bb14d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:09.433803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c49bf0-e115-473e-9b66-099b910fc023 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kdpyGqvIQ0CCCCkTE1Ja8g, audit_chain_id=['kdpyGqvIQ0CCCCkTE1Ja8g']) at 0x7fe09de8a8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:09.437389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c49bf0-e115-473e-9b66-099b910fc023 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:09.437389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c49bf0-e115-473e-9b66-099b910fc023 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:09.437389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c49bf0-e115-473e-9b66-099b910fc023 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:09.437389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c49bf0-e115-473e-9b66-099b910fc023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:09.437389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c49bf0-e115-473e-9b66-099b910fc023 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:09.448870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1023/2022] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:03:09.452084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdf4f2-594b-41a2-8e9e-0f5a3297d3fa admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:09.509893 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdf4f2-594b-41a2-8e9e-0f5a3297d3fa admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:09.514395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e420e-0c00-46b8-bd39-46bc0d1e94e9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kdpyGqvIQ0CCCCkTE1Ja8g, audit_chain_id=['kdpyGqvIQ0CCCCkTE1Ja8g']) at 0x7fe09e2048e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:09.515008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e420e-0c00-46b8-bd39-46bc0d1e94e9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:09.515326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e420e-0c00-46b8-bd39-46bc0d1e94e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:09.515614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e420e-0c00-46b8-bd39-46bc0d1e94e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:09.516356 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e420e-0c00-46b8-bd39-46bc0d1e94e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:09.518111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e420e-0c00-46b8-bd39-46bc0d1e94e9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:09.529388 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1000/2023] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:03:09.533635 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c49bf0-e115-473e-9b66-099b910fc023 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:09.579603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c49bf0-e115-473e-9b66-099b910fc023 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:09.583896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25acab-4f3d-40f1-8096-fe949c4d5f17 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kdpyGqvIQ0CCCCkTE1Ja8g, audit_chain_id=['kdpyGqvIQ0CCCCkTE1Ja8g']) at 0x7fe09e14e910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:09.584714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25acab-4f3d-40f1-8096-fe949c4d5f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:09.585004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25acab-4f3d-40f1-8096-fe949c4d5f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:09.585285 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25acab-4f3d-40f1-8096-fe949c4d5f17 admin admin] PATH_INFO: `/v3/projects/3122eb370c1248188f0f85446ca000e2/users/c5fc6b37e7aa4d7a80b8017dda957536/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:09.605501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25acab-4f3d-40f1-8096-fe949c4d5f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3122eb370c1248188f0f85446ca000e2, user_id=c5fc6b37e7aa4d7a80b8017dda957536, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:09.608256 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25acab-4f3d-40f1-8096-fe949c4d5f17 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:09.698639 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1024/2024] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:03:09 2022] PUT /identity/v3/projects/3122eb370c1248188f0f85446ca000e2/users/c5fc6b37e7aa4d7a80b8017dda957536/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:03:09.714053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f62a-5573-4750-b380-b087d34ae0b2 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:09.714357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f62a-5573-4750-b380-b087d34ae0b2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:09.714645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f62a-5573-4750-b380-b087d34ae0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:09.752411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-1120f62a-5573-4750-b380-b087d34ae0b2 None None] MFA Rules not processed for user `c5fc6b37e7aa4d7a80b8017dda957536`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:09.753572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1120f62a-5573-4750-b380-b087d34ae0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:09.825970 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1001/2025] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:09 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:09.835176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25acab-4f3d-40f1-8096-fe949c4d5f17 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:09.836820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-fe25acab-4f3d-40f1-8096-fe949c4d5f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:09.917965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25acab-4f3d-40f1-8096-fe949c4d5f17 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:09.922091 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a0f2-9217-4d30-a6c1-b41c6f08cfa5 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e21e8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:09.922673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a0f2-9217-4d30-a6c1-b41c6f08cfa5 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:09.922991 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a0f2-9217-4d30-a6c1-b41c6f08cfa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:09.923332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a0f2-9217-4d30-a6c1-b41c6f08cfa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:09.931711 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320a0f2-9217-4d30-a6c1-b41c6f08cfa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:09.933132 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320a0f2-9217-4d30-a6c1-b41c6f08cfa5 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:09.942310 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1025/2026] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:09 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:12.444864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f62a-5573-4750-b380-b087d34ae0b2 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:12.446559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1120f62a-5573-4750-b380-b087d34ae0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:12.528807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f62a-5573-4750-b380-b087d34ae0b2 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:12.544468 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09e47e880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:12.545616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:12.545911 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:12.546197 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] PATH_INFO: `/v3/users/bf0c91f716bf4580a545fa3ec959028b` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:12.547460 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf0c91f716bf4580a545fa3ec959028b)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:12.549469 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:12.690733 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a0f2-9217-4d30-a6c1-b41c6f08cfa5 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:12.692095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3320a0f2-9217-4d30-a6c1-b41c6f08cfa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:12.703909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a0f2-9217-4d30-a6c1-b41c6f08cfa5 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:12.707804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b3cc4-c20f-4273-9009-eae6f0ec079c service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e1833d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:12.708599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b3cc4-c20f-4273-9009-eae6f0ec079c service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:12.709095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b3cc4-c20f-4273-9009-eae6f0ec079c service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:12.709507 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b3cc4-c20f-4273-9009-eae6f0ec079c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:12.712032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-bd8b3cc4-c20f-4273-9009-eae6f0ec079c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:12.791561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b3cc4-c20f-4273-9009-eae6f0ec079c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:12.791561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b3cc4-c20f-4273-9009-eae6f0ec079c service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:12.797718 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1026/2027] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:12 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:12.991515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf0c91f716bf4580a545fa3ec959028b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:13.172810 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf0c91f716bf4580a545fa3ec959028b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:13.185972 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf0c91f716bf4580a545fa3ec959028b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:13.188730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf0c91f716bf4580a545fa3ec959028b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:13.188730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf0c91f716bf4580a545fa3ec959028b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:13.200332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1002/2028] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:03:12 2022] DELETE /identity/v3/users/bf0c91f716bf4580a545fa3ec959028b => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:13.204731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e83e95-1534-42c8-80c5-40eb6375f059 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:13.205109 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e83e95-1534-42c8-80c5-40eb6375f059 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:13.205347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e83e95-1534-42c8-80c5-40eb6375f059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:13.240537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-91e83e95-1534-42c8-80c5-40eb6375f059 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:13.241703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-91e83e95-1534-42c8-80c5-40eb6375f059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:13.306342 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1027/2029] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:13.316793 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:13.318181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:13.423238 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdad45c-6c75-4b35-8c02-c35f35dedd77 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:13.426824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4f346-d3d8-431a-8286-9e439fe4cc56 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e8faa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:13.427431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f346-d3d8-431a-8286-9e439fe4cc56 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:13.427719 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f346-d3d8-431a-8286-9e439fe4cc56 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:13.427997 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f346-d3d8-431a-8286-9e439fe4cc56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:13.438725 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4f346-d3d8-431a-8286-9e439fe4cc56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:13.440222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4f346-d3d8-431a-8286-9e439fe4cc56 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:13.450406 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1003/2030] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:13 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:03:14.364904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e83e95-1534-42c8-80c5-40eb6375f059 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:14.366324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-91e83e95-1534-42c8-80c5-40eb6375f059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:14.378938 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e83e95-1534-42c8-80c5-40eb6375f059 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:14.383741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09de98850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:14.385230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:14.385784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:14.385784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] PATH_INFO: `/v3/projects/c450a7a45bee48e392468053c4a63c90` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:14.387964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c450a7a45bee48e392468053c4a63c90)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:14.389880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:14.574268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c450a7a45bee48e392468053c4a63c90', 'request_id': 'req-9514052f-b55a-434f-84d4-094087df5f05'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:14.709800 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c450a7a45bee48e392468053c4a63c90', 'request_id': 'req-9514052f-b55a-434f-84d4-094087df5f05'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:14.721831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c450a7a45bee48e392468053c4a63c90', 'request_id': 'req-9514052f-b55a-434f-84d4-094087df5f05'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:14.732481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] The token cache is being invalidate because project c450a7a45bee48e392468053c4a63c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:03:14.732767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:14.733428 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:14.735065 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1028/2031] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:03:14 2022] DELETE /identity/v3/projects/c450a7a45bee48e392468053c4a63c90 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:14.738869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4f346-d3d8-431a-8286-9e439fe4cc56 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:14.749563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4f346-d3d8-431a-8286-9e439fe4cc56 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:14.825504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b5a57-b76e-40d2-bdaf-851bb66a8f0c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09e3f0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:14.826365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b5a57-b76e-40d2-bdaf-851bb66a8f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:14.826656 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b5a57-b76e-40d2-bdaf-851bb66a8f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:14.826934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b5a57-b76e-40d2-bdaf-851bb66a8f0c admin admin] PATH_INFO: `/v3/users/288b1b8eaf53425e9cdaadc3b93fffde` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:14.828468 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b5a57-b76e-40d2-bdaf-851bb66a8f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=288b1b8eaf53425e9cdaadc3b93fffde)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:14.831542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b5a57-b76e-40d2-bdaf-851bb66a8f0c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:15.179935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-562b5a57-b76e-40d2-bdaf-851bb66a8f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288b1b8eaf53425e9cdaadc3b93fffde'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:15.315029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-562b5a57-b76e-40d2-bdaf-851bb66a8f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288b1b8eaf53425e9cdaadc3b93fffde'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:15.328349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-562b5a57-b76e-40d2-bdaf-851bb66a8f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288b1b8eaf53425e9cdaadc3b93fffde'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:15.329042 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-562b5a57-b76e-40d2-bdaf-851bb66a8f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288b1b8eaf53425e9cdaadc3b93fffde'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:15.329674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-562b5a57-b76e-40d2-bdaf-851bb66a8f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288b1b8eaf53425e9cdaadc3b93fffde'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:15.343147 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1004/2032] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:03:14 2022] DELETE /identity/v3/users/288b1b8eaf53425e9cdaadc3b93fffde => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:15.985963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:15.988118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:16.004174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514052f-b55a-434f-84d4-094087df5f05 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:16.069197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pcvUfsvFRI6Ko67iy8T5aQ, audit_chain_id=['pcvUfsvFRI6Ko67iy8T5aQ']) at 0x7fe09df24b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:16.069990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:16.070281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:16.070564 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] PATH_INFO: `/v3/projects/b1c3173c73974ad1a179bb747db2f61d` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:16.071848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c3173c73974ad1a179bb747db2f61d)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:16.073796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:16.211025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c3173c73974ad1a179bb747db2f61d', 'request_id': 'req-7f52af62-c8eb-466e-8612-7c75a05e3cc5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:16.319163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c3173c73974ad1a179bb747db2f61d', 'request_id': 'req-7f52af62-c8eb-466e-8612-7c75a05e3cc5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:16.331933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c3173c73974ad1a179bb747db2f61d', 'request_id': 'req-7f52af62-c8eb-466e-8612-7c75a05e3cc5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:16.343234 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] The token cache is being invalidate because project b1c3173c73974ad1a179bb747db2f61d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:03:16.343522 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:16.344173 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7f52af62-c8eb-466e-8612-7c75a05e3cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:16.349070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1029/2033] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:03:15 2022] DELETE /identity/v3/projects/b1c3173c73974ad1a179bb747db2f61d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:16.350989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac9d9f-581d-4006-9c5d-e36a4c46f8e7 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:16.351439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac9d9f-581d-4006-9c5d-e36a4c46f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:16.351617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac9d9f-581d-4006-9c5d-e36a4c46f8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:16.402747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a0ac9d9f-581d-4006-9c5d-e36a4c46f8e7 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:16.404033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a0ac9d9f-581d-4006-9c5d-e36a4c46f8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:16.482301 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1005/2034] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:16.497210 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838035f-c2ed-46ef-ac01-aa08793060d5 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:16.497660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838035f-c2ed-46ef-ac01-aa08793060d5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:16.498013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838035f-c2ed-46ef-ac01-aa08793060d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:16.521932 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-9838035f-c2ed-46ef-ac01-aa08793060d5 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:16.523106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9838035f-c2ed-46ef-ac01-aa08793060d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:16.531103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1030/2035] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:16.535353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac9d9f-581d-4006-9c5d-e36a4c46f8e7 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:16.545616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac9d9f-581d-4006-9c5d-e36a4c46f8e7 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:16.550285 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd8baa-2d9b-4e9a-8d7e-586fd33e19f1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09e3edbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:16.550915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8baa-2d9b-4e9a-8d7e-586fd33e19f1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:16.551241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8baa-2d9b-4e9a-8d7e-586fd33e19f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:16.551527 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8baa-2d9b-4e9a-8d7e-586fd33e19f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:16.552247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd8baa-2d9b-4e9a-8d7e-586fd33e19f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:03:16.552670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd8baa-2d9b-4e9a-8d7e-586fd33e19f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:16.554530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd8baa-2d9b-4e9a-8d7e-586fd33e19f1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:16.568432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1006/2036] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:03:16.572976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838035f-c2ed-46ef-ac01-aa08793060d5 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:16.582097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838035f-c2ed-46ef-ac01-aa08793060d5 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:16.586488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155ab6b-92d1-4340-b143-5531f5213d8e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09e555c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:16.587948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155ab6b-92d1-4340-b143-5531f5213d8e admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:16.593124 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155ab6b-92d1-4340-b143-5531f5213d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:16.593124 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155ab6b-92d1-4340-b143-5531f5213d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:16.593124 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155ab6b-92d1-4340-b143-5531f5213d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:16.593124 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155ab6b-92d1-4340-b143-5531f5213d8e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:16.710791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1031/2037] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:03:16 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:03:16.715555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd8baa-2d9b-4e9a-8d7e-586fd33e19f1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:16.725947 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd8baa-2d9b-4e9a-8d7e-586fd33e19f1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:16.810416 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475ebfe-5b9e-4b85-8c6a-4b558860cae8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09de7f520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:16.811581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475ebfe-5b9e-4b85-8c6a-4b558860cae8 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:16.812084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475ebfe-5b9e-4b85-8c6a-4b558860cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:16.812576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475ebfe-5b9e-4b85-8c6a-4b558860cae8 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:16.813612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475ebfe-5b9e-4b85-8c6a-4b558860cae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:16.816318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475ebfe-5b9e-4b85-8c6a-4b558860cae8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:17.038010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1007/2038] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:03:16 2022] POST /identity/v3/users => generated 284 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:03:17.042357 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155ab6b-92d1-4340-b143-5531f5213d8e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:17.052599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155ab6b-92d1-4340-b143-5531f5213d8e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:17.058269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4544-3caa-4f2d-83cd-f92fd9928044 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09de9db50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:17.058869 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4544-3caa-4f2d-83cd-f92fd9928044 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:17.059316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4544-3caa-4f2d-83cd-f92fd9928044 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:17.059577 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4544-3caa-4f2d-83cd-f92fd9928044 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:17.060273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad4544-3caa-4f2d-83cd-f92fd9928044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:17.061958 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad4544-3caa-4f2d-83cd-f92fd9928044 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:17.073118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1032/2039] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:03:17.077515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475ebfe-5b9e-4b85-8c6a-4b558860cae8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:17.088865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475ebfe-5b9e-4b85-8c6a-4b558860cae8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:17.093634 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169d6b7-67d3-44b9-bac7-e230eaa329d3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09e3de4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:17.094268 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169d6b7-67d3-44b9-bac7-e230eaa329d3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:17.094560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169d6b7-67d3-44b9-bac7-e230eaa329d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:17.094846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169d6b7-67d3-44b9-bac7-e230eaa329d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:17.095633 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169d6b7-67d3-44b9-bac7-e230eaa329d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:17.097298 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169d6b7-67d3-44b9-bac7-e230eaa329d3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:17.107545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1008/2040] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:03:17.111766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4544-3caa-4f2d-83cd-f92fd9928044 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:17.122079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4544-3caa-4f2d-83cd-f92fd9928044 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:17.126332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b2dd-9a03-4d28-9bd1-c7faf0bebc5f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09e155a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:17.127171 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b2dd-9a03-4d28-9bd1-c7faf0bebc5f admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:17.127464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b2dd-9a03-4d28-9bd1-c7faf0bebc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:17.127748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b2dd-9a03-4d28-9bd1-c7faf0bebc5f admin admin] PATH_INFO: `/v3/projects/5a3415a33dec44b597e3bf71115a0c95/users/bcbfbbb0e51243bca61348bb9d084465/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:17.148017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b2dd-9a03-4d28-9bd1-c7faf0bebc5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3415a33dec44b597e3bf71115a0c95, user_id=bcbfbbb0e51243bca61348bb9d084465, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:17.151031 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b2dd-9a03-4d28-9bd1-c7faf0bebc5f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:17.269299 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1033/2041] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:03:17 2022] PUT /identity/v3/projects/5a3415a33dec44b597e3bf71115a0c95/users/bcbfbbb0e51243bca61348bb9d084465/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:03:17.280666 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1f8e6-7551-4b10-ac74-43d28d705b7e None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:17.280666 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1f8e6-7551-4b10-ac74-43d28d705b7e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:17.280666 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1f8e6-7551-4b10-ac74-43d28d705b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:17.320733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e8b1f8e6-7551-4b10-ac74-43d28d705b7e None None] MFA Rules not processed for user `bcbfbbb0e51243bca61348bb9d084465`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:17.322588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e8b1f8e6-7551-4b10-ac74-43d28d705b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:17.421561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1009/2042] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:17 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:17.425790 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b2dd-9a03-4d28-9bd1-c7faf0bebc5f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:17.542878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b2dd-9a03-4d28-9bd1-c7faf0bebc5f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:17.550586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8626fb-35cf-47cb-a106-4b760cf1311a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09de9d6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:17.551573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8626fb-35cf-47cb-a106-4b760cf1311a admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:17.554385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8626fb-35cf-47cb-a106-4b760cf1311a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:17.554385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8626fb-35cf-47cb-a106-4b760cf1311a admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:17.554385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8626fb-35cf-47cb-a106-4b760cf1311a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:17.556393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8626fb-35cf-47cb-a106-4b760cf1311a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:17.713403 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1034/2043] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:03:17 2022] POST /identity/v3/projects => generated 365 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:03:17.714702 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1f8e6-7551-4b10-ac74-43d28d705b7e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:17.734537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1f8e6-7551-4b10-ac74-43d28d705b7e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:17.802641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9d77-a4e2-4994-960a-7b3059783b3c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09e3f3c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:17.803285 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9d77-a4e2-4994-960a-7b3059783b3c admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:17.803577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9d77-a4e2-4994-960a-7b3059783b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:17.803860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9d77-a4e2-4994-960a-7b3059783b3c admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:17.804518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9d77-a4e2-4994-960a-7b3059783b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:17.807683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9d77-a4e2-4994-960a-7b3059783b3c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:17.912683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1010/2044] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:03:17 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:03:17.917063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8626fb-35cf-47cb-a106-4b760cf1311a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:17.927625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8626fb-35cf-47cb-a106-4b760cf1311a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:17.932273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13688b85-be48-457c-b1da-9ab9850e5d73 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09ded1d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:17.932999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688b85-be48-457c-b1da-9ab9850e5d73 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:17.933349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688b85-be48-457c-b1da-9ab9850e5d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:17.933698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688b85-be48-457c-b1da-9ab9850e5d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:17.934461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13688b85-be48-457c-b1da-9ab9850e5d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:17.936243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13688b85-be48-457c-b1da-9ab9850e5d73 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:17.950792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1035/2045] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:03:17.952572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9d77-a4e2-4994-960a-7b3059783b3c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:17.964521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9d77-a4e2-4994-960a-7b3059783b3c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:17.970200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadb4a2-d2cf-4c90-9058-8ca5973133e3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09e4113d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:17.970961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadb4a2-d2cf-4c90-9058-8ca5973133e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:17.971290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadb4a2-d2cf-4c90-9058-8ca5973133e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:17.971573 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadb4a2-d2cf-4c90-9058-8ca5973133e3 admin admin] PATH_INFO: `/v3/projects/dbc0f5c49c954d788d7283082a67b245/users/2cf4aa610425427fae0ce5c518816db2/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:17.993946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadb4a2-d2cf-4c90-9058-8ca5973133e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc0f5c49c954d788d7283082a67b245, user_id=2cf4aa610425427fae0ce5c518816db2, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:17.996660 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadb4a2-d2cf-4c90-9058-8ca5973133e3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:18.087200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1011/2046] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:03:17 2022] PUT /identity/v3/projects/dbc0f5c49c954d788d7283082a67b245/users/2cf4aa610425427fae0ce5c518816db2/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:18.091097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13688b85-be48-457c-b1da-9ab9850e5d73 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:18.101032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13688b85-be48-457c-b1da-9ab9850e5d73 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:18.175299 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218efabe-b39c-4d86-9f1e-df8431695168 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09de5ea30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:18.176034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218efabe-b39c-4d86-9f1e-df8431695168 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:18.176343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218efabe-b39c-4d86-9f1e-df8431695168 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:18.176648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218efabe-b39c-4d86-9f1e-df8431695168 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:18.177347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218efabe-b39c-4d86-9f1e-df8431695168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:18.179058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218efabe-b39c-4d86-9f1e-df8431695168 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:18.189493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1036/2047] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:03:18.193712 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadb4a2-d2cf-4c90-9058-8ca5973133e3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:18.204188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadb4a2-d2cf-4c90-9058-8ca5973133e3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:18.208877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3949c-4c9e-4a67-8f97-690bbb11d9a6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09de6d4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:18.209704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3949c-4c9e-4a67-8f97-690bbb11d9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:18.209991 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3949c-4c9e-4a67-8f97-690bbb11d9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:18.210872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3949c-4c9e-4a67-8f97-690bbb11d9a6 admin admin] PATH_INFO: `/v3/projects/dbc0f5c49c954d788d7283082a67b245/users/2cf4aa610425427fae0ce5c518816db2/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:18.212845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3949c-4c9e-4a67-8f97-690bbb11d9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc0f5c49c954d788d7283082a67b245, user_id=2cf4aa610425427fae0ce5c518816db2, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:18.215656 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3949c-4c9e-4a67-8f97-690bbb11d9a6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:18.225690 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1012/2048] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:03:18 2022] PUT /identity/v3/projects/dbc0f5c49c954d788d7283082a67b245/users/2cf4aa610425427fae0ce5c518816db2/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:03:18.237013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6d8b5-f6a3-4b4f-b122-f6578e207c83 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:18.237306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6d8b5-f6a3-4b4f-b122-f6578e207c83 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:18.237589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6d8b5-f6a3-4b4f-b122-f6578e207c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:18.278659 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-5cf6d8b5-f6a3-4b4f-b122-f6578e207c83 None None] MFA Rules not processed for user `2cf4aa610425427fae0ce5c518816db2`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:18.279850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-5cf6d8b5-f6a3-4b4f-b122-f6578e207c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:18.360226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1037/2049] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:18 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:18.371343 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3949c-4c9e-4a67-8f97-690bbb11d9a6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:18.372970 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e9a3949c-4c9e-4a67-8f97-690bbb11d9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:18.441446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3949c-4c9e-4a67-8f97-690bbb11d9a6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:18.445702 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38c128-487c-49ff-bc31-41f2d7dd99df service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09de43b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:18.446877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38c128-487c-49ff-bc31-41f2d7dd99df service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:18.447251 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38c128-487c-49ff-bc31-41f2d7dd99df service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:18.447574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38c128-487c-49ff-bc31-41f2d7dd99df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:18.457374 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38c128-487c-49ff-bc31-41f2d7dd99df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:18.458914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38c128-487c-49ff-bc31-41f2d7dd99df service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:18.468985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1013/2050] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:18 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:18.928896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6d8b5-f6a3-4b4f-b122-f6578e207c83 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:18.938988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6d8b5-f6a3-4b4f-b122-f6578e207c83 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:18.946927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370ec4e-5155-4de1-ab50-79e767ca0245 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09de0ffa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:18.948098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370ec4e-5155-4de1-ab50-79e767ca0245 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:18.948597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370ec4e-5155-4de1-ab50-79e767ca0245 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:18.949076 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370ec4e-5155-4de1-ab50-79e767ca0245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:19.020911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370ec4e-5155-4de1-ab50-79e767ca0245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:19.023397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370ec4e-5155-4de1-ab50-79e767ca0245 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:19.033000 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1038/2051] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:18 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:20.182205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5cd78-1d2b-4676-9f35-9cce900fa85a None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:20.183199 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5cd78-1d2b-4676-9f35-9cce900fa85a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:20.183692 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5cd78-1d2b-4676-9f35-9cce900fa85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:20.208977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d7f5cd78-1d2b-4676-9f35-9cce900fa85a None None] MFA Rules not processed for user `46e767d2e3624a3fa799c8c1b20b0516`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:20.210830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d7f5cd78-1d2b-4676-9f35-9cce900fa85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:20.281154 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1014/2052] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:20 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:03:22.796176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370ec4e-5155-4de1-ab50-79e767ca0245 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:22.797608 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b370ec4e-5155-4de1-ab50-79e767ca0245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:22.881253 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370ec4e-5155-4de1-ab50-79e767ca0245 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:22.885977 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09df25d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:22.886792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:22.887174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:22.887464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] PATH_INFO: `/v3/users/f9c27629111f492aba6ce885a5ece91d` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:22.888632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c27629111f492aba6ce885a5ece91d)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:22.890660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:23.433630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c27629111f492aba6ce885a5ece91d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:23.450787 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c27629111f492aba6ce885a5ece91d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:23.451592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c27629111f492aba6ce885a5ece91d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:23.452204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c27629111f492aba6ce885a5ece91d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:23.532396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c27629111f492aba6ce885a5ece91d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:23.552762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1039/2053] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:03:22 2022] DELETE /identity/v3/users/f9c27629111f492aba6ce885a5ece91d => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:23.554180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a613c4-a52b-4e9c-9e8d-56bc42dcd67e None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:23.554645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a613c4-a52b-4e9c-9e8d-56bc42dcd67e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:23.554898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a613c4-a52b-4e9c-9e8d-56bc42dcd67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:23.579661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-47a613c4-a52b-4e9c-9e8d-56bc42dcd67e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:23.581242 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-47a613c4-a52b-4e9c-9e8d-56bc42dcd67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:23.663744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1015/2054] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:03:23.675515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:23.676835 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:23.758959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad483c3-9c03-4521-9acb-2cb0857f22f8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:23.766618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54437684-655a-4129-a6b1-e1eb0870fc7c service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e50e0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:23.767332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437684-655a-4129-a6b1-e1eb0870fc7c service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:23.767628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437684-655a-4129-a6b1-e1eb0870fc7c service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:23.767916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437684-655a-4129-a6b1-e1eb0870fc7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:23.783147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54437684-655a-4129-a6b1-e1eb0870fc7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:23.784814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54437684-655a-4129-a6b1-e1eb0870fc7c service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:23.796037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1040/2055] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:24.691978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a613c4-a52b-4e9c-9e8d-56bc42dcd67e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:24.702687 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-47a613c4-a52b-4e9c-9e8d-56bc42dcd67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:24.722141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a613c4-a52b-4e9c-9e8d-56bc42dcd67e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:24.727078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09ea9b550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:24.730038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:24.730335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:24.730622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] PATH_INFO: `/v3/projects/28e23b27615743a2bb67513d3de568c8` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:24.731826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e23b27615743a2bb67513d3de568c8)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:24.733769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:24.945597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e23b27615743a2bb67513d3de568c8', 'request_id': 'req-ae8a2979-9dfe-4774-bca8-9c0b7e796497'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:24.959368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e23b27615743a2bb67513d3de568c8', 'request_id': 'req-ae8a2979-9dfe-4774-bca8-9c0b7e796497'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:25.075410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e23b27615743a2bb67513d3de568c8', 'request_id': 'req-ae8a2979-9dfe-4774-bca8-9c0b7e796497'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:25.089575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] The token cache is being invalidate because project 28e23b27615743a2bb67513d3de568c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:03:25.093530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:25.093859 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:25.095404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1016/2056] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:03:24 2022] DELETE /identity/v3/projects/28e23b27615743a2bb67513d3de568c8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:25.099590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54437684-655a-4129-a6b1-e1eb0870fc7c service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:25.110886 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54437684-655a-4129-a6b1-e1eb0870fc7c service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:25.219776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5709da-e783-49b6-8291-f5667500843e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09de9de50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:25.220597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5709da-e783-49b6-8291-f5667500843e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:25.220887 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5709da-e783-49b6-8291-f5667500843e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:25.221164 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5709da-e783-49b6-8291-f5667500843e admin admin] PATH_INFO: `/v3/users/21f25b9ce1ad42ba880808c798b3b6ce` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:25.222515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5709da-e783-49b6-8291-f5667500843e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f25b9ce1ad42ba880808c798b3b6ce)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:25.224947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5709da-e783-49b6-8291-f5667500843e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:25.543921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-da5709da-e783-49b6-8291-f5667500843e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f25b9ce1ad42ba880808c798b3b6ce'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:25.561899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-da5709da-e783-49b6-8291-f5667500843e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f25b9ce1ad42ba880808c798b3b6ce'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:25.562681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-da5709da-e783-49b6-8291-f5667500843e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f25b9ce1ad42ba880808c798b3b6ce'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:25.563493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-da5709da-e783-49b6-8291-f5667500843e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f25b9ce1ad42ba880808c798b3b6ce'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:25.646852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-da5709da-e783-49b6-8291-f5667500843e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f25b9ce1ad42ba880808c798b3b6ce'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:25.671978 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1041/2057] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:03:25 2022] DELETE /identity/v3/users/21f25b9ce1ad42ba880808c798b3b6ce => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:26.731632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:26.733038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:26.747935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a2979-9dfe-4774-bca8-9c0b7e796497 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:26.820518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=vio4LCFkQrOXCX4_SXOZVg, audit_chain_id=['vio4LCFkQrOXCX4_SXOZVg']) at 0x7fe09ddd86a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:26.822082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:26.822380 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:26.822678 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] PATH_INFO: `/v3/projects/cbc88e420d8f4e1f81b9ed1e326f09ef` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:26.829557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc88e420d8f4e1f81b9ed1e326f09ef)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:26.829557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:27.041632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc88e420d8f4e1f81b9ed1e326f09ef', 'request_id': 'req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:27.053347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc88e420d8f4e1f81b9ed1e326f09ef', 'request_id': 'req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:27.153318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc88e420d8f4e1f81b9ed1e326f09ef', 'request_id': 'req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:27.167963 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] The token cache is being invalidate because project cbc88e420d8f4e1f81b9ed1e326f09ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:03:27.168277 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:27.169546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f5e7e47f-75ec-488c-a4c8-aa67d11aaa99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:27.171462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1017/2058] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:03:26 2022] DELETE /identity/v3/projects/cbc88e420d8f4e1f81b9ed1e326f09ef => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:27.177901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670b05-58bd-457c-a5b4-eed41c9828d8 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:27.178782 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670b05-58bd-457c-a5b4-eed41c9828d8 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:27.179187 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da670b05-58bd-457c-a5b4-eed41c9828d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:27.206701 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-da670b05-58bd-457c-a5b4-eed41c9828d8 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:27.206996 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-da670b05-58bd-457c-a5b4-eed41c9828d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:27.284030 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1042/2059] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:27.285880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc1310-958b-4c0a-87f1-18469300fdc8 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:27.286176 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc1310-958b-4c0a-87f1-18469300fdc8 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:27.286465 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc1310-958b-4c0a-87f1-18469300fdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:27.311139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-24bc1310-958b-4c0a-87f1-18469300fdc8 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:27.312301 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-24bc1310-958b-4c0a-87f1-18469300fdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:27.319691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1018/2060] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:27.325001 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da670b05-58bd-457c-a5b4-eed41c9828d8 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:27.334665 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da670b05-58bd-457c-a5b4-eed41c9828d8 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:27.340418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bf712-2a07-419e-989f-ab2184dfe994 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kFIyX7YtTpWWKRZ2tx9IYw, audit_chain_id=['kFIyX7YtTpWWKRZ2tx9IYw']) at 0x7fe09e1aed90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:27.341092 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bf712-2a07-419e-989f-ab2184dfe994 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:27.341448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bf712-2a07-419e-989f-ab2184dfe994 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:27.341848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bf712-2a07-419e-989f-ab2184dfe994 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:27.342668 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bf712-2a07-419e-989f-ab2184dfe994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:03:27.343054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bf712-2a07-419e-989f-ab2184dfe994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:27.344863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bf712-2a07-419e-989f-ab2184dfe994 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:27.361082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1043/2061] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:03:27.363608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc1310-958b-4c0a-87f1-18469300fdc8 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:27.384319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc1310-958b-4c0a-87f1-18469300fdc8 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:27.384319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1149c-f338-40fd-b73d-025ee0124eb3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kFIyX7YtTpWWKRZ2tx9IYw, audit_chain_id=['kFIyX7YtTpWWKRZ2tx9IYw']) at 0x7fe09e3ad730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:27.384319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1149c-f338-40fd-b73d-025ee0124eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:27.384319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1149c-f338-40fd-b73d-025ee0124eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:27.384694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1149c-f338-40fd-b73d-025ee0124eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:27.384694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1149c-f338-40fd-b73d-025ee0124eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:27.386250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1149c-f338-40fd-b73d-025ee0124eb3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:27.511059 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1019/2062] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:03:27 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:03:27.511941 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bf712-2a07-419e-989f-ab2184dfe994 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:27.523249 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bf712-2a07-419e-989f-ab2184dfe994 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:27.603302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7d897-9ac4-4017-a981-af172bf252f9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kFIyX7YtTpWWKRZ2tx9IYw, audit_chain_id=['kFIyX7YtTpWWKRZ2tx9IYw']) at 0x7fe09de5e040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:27.604153 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7d897-9ac4-4017-a981-af172bf252f9 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:27.604577 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7d897-9ac4-4017-a981-af172bf252f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:27.604858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7d897-9ac4-4017-a981-af172bf252f9 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:27.605738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7d897-9ac4-4017-a981-af172bf252f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:27.608632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7d897-9ac4-4017-a981-af172bf252f9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:27.864063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1044/2063] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:03:27 2022] POST /identity/v3/users => generated 288 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:03:27.865679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1149c-f338-40fd-b73d-025ee0124eb3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:27.876215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1149c-f338-40fd-b73d-025ee0124eb3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:27.880524 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e90df2-b38d-4bdd-8e12-39b423d48c63 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kFIyX7YtTpWWKRZ2tx9IYw, audit_chain_id=['kFIyX7YtTpWWKRZ2tx9IYw']) at 0x7fe09e3d5d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:27.881121 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e90df2-b38d-4bdd-8e12-39b423d48c63 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:27.881415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e90df2-b38d-4bdd-8e12-39b423d48c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:27.884590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e90df2-b38d-4bdd-8e12-39b423d48c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:27.884590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e90df2-b38d-4bdd-8e12-39b423d48c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:27.885855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e90df2-b38d-4bdd-8e12-39b423d48c63 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:27.897894 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1020/2064] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:03:27.902361 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7d897-9ac4-4017-a981-af172bf252f9 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:27.913592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7d897-9ac4-4017-a981-af172bf252f9 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:27.953541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f7c66-7fc7-4200-9f03-c1070e825c71 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kFIyX7YtTpWWKRZ2tx9IYw, audit_chain_id=['kFIyX7YtTpWWKRZ2tx9IYw']) at 0x7fe09e62fc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:27.953541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f7c66-7fc7-4200-9f03-c1070e825c71 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:27.953541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f7c66-7fc7-4200-9f03-c1070e825c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:27.953541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f7c66-7fc7-4200-9f03-c1070e825c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:27.953951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f7c66-7fc7-4200-9f03-c1070e825c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:27.953951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f7c66-7fc7-4200-9f03-c1070e825c71 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:27.953951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1045/2065] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:03:27.965411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e90df2-b38d-4bdd-8e12-39b423d48c63 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:27.975875 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e90df2-b38d-4bdd-8e12-39b423d48c63 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:27.981124 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc7e05-eb5a-40e0-91e4-c9cac56d2515 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kFIyX7YtTpWWKRZ2tx9IYw, audit_chain_id=['kFIyX7YtTpWWKRZ2tx9IYw']) at 0x7fe09ddd8400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:27.982003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc7e05-eb5a-40e0-91e4-c9cac56d2515 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:27.982297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc7e05-eb5a-40e0-91e4-c9cac56d2515 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:27.982613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc7e05-eb5a-40e0-91e4-c9cac56d2515 admin admin] PATH_INFO: `/v3/projects/26b9e0b327de49368dae688c1e31a260/users/97042cb03f154e3b89cf2f0b51f1e603/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:28.003740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc7e05-eb5a-40e0-91e4-c9cac56d2515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b9e0b327de49368dae688c1e31a260, user_id=97042cb03f154e3b89cf2f0b51f1e603, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:28.010393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc7e05-eb5a-40e0-91e4-c9cac56d2515 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:28.168547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1021/2066] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:03:27 2022] PUT /identity/v3/projects/26b9e0b327de49368dae688c1e31a260/users/97042cb03f154e3b89cf2f0b51f1e603/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:03:28.180664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f9a74-64dd-4bd3-8b72-97f49514bd36 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:28.181202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f9a74-64dd-4bd3-8b72-97f49514bd36 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:28.181374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f9a74-64dd-4bd3-8b72-97f49514bd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:28.223552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-483f9a74-64dd-4bd3-8b72-97f49514bd36 None None] MFA Rules not processed for user `97042cb03f154e3b89cf2f0b51f1e603`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:28.224787 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-483f9a74-64dd-4bd3-8b72-97f49514bd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:28.264529 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc7e05-eb5a-40e0-91e4-c9cac56d2515 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:28.267473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ffdc7e05-eb5a-40e0-91e4-c9cac56d2515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:28.324616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1046/2067] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:28 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:28.357715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc7e05-eb5a-40e0-91e4-c9cac56d2515 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:28.368313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f9a74-64dd-4bd3-8b72-97f49514bd36 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:28.369737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-483f9a74-64dd-4bd3-8b72-97f49514bd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:28.375505 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kdpyGqvIQ0CCCCkTE1Ja8g, audit_chain_id=['kdpyGqvIQ0CCCCkTE1Ja8g']) at 0x7fe09e50f460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:28.376449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:28.376732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:28.377013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] PATH_INFO: `/v3/users/c5fc6b37e7aa4d7a80b8017dda957536` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:28.380266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5fc6b37e7aa4d7a80b8017dda957536)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:28.385476 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:28.440589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f9a74-64dd-4bd3-8b72-97f49514bd36 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:28.444248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9bd41-c88a-458b-820a-7488c01e5013 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e212310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:28.444821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9bd41-c88a-458b-820a-7488c01e5013 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:28.445110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9bd41-c88a-458b-820a-7488c01e5013 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:28.445390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9bd41-c88a-458b-820a-7488c01e5013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:28.454349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9bd41-c88a-458b-820a-7488c01e5013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:28.455830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9bd41-c88a-458b-820a-7488c01e5013 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:28.465692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1047/2068] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:28 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:28.616971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5fc6b37e7aa4d7a80b8017dda957536'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:28.696287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5fc6b37e7aa4d7a80b8017dda957536'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:28.710577 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5fc6b37e7aa4d7a80b8017dda957536'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:28.711419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5fc6b37e7aa4d7a80b8017dda957536'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:28.712958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5fc6b37e7aa4d7a80b8017dda957536'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:28.730262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1022/2069] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:03:28 2022] DELETE /identity/v3/users/c5fc6b37e7aa4d7a80b8017dda957536 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:03:28.731474 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac55ac-8e67-4bd4-b9ca-50564bb36f54 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:28.731771 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac55ac-8e67-4bd4-b9ca-50564bb36f54 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:28.732142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac55ac-8e67-4bd4-b9ca-50564bb36f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:28.754741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-99ac55ac-8e67-4bd4-b9ca-50564bb36f54 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:28.755952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-99ac55ac-8e67-4bd4-b9ca-50564bb36f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:28.830702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1048/2070] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:03:28.841332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:28.842751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:28.932490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a817646-00f8-4bc6-8246-ae932bd43e35 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:28.936165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07ee2-0838-4403-ad8d-8ef1cc111afd service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09ded65b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:28.937932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07ee2-0838-4403-ad8d-8ef1cc111afd service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:28.938653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07ee2-0838-4403-ad8d-8ef1cc111afd service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:28.939183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07ee2-0838-4403-ad8d-8ef1cc111afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:28.952975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea07ee2-0838-4403-ad8d-8ef1cc111afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:28.954764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea07ee2-0838-4403-ad8d-8ef1cc111afd service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:28.966462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1023/2071] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:29.557597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac55ac-8e67-4bd4-b9ca-50564bb36f54 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:29.559216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-99ac55ac-8e67-4bd4-b9ca-50564bb36f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:29.571746 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac55ac-8e67-4bd4-b9ca-50564bb36f54 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:29.578072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kdpyGqvIQ0CCCCkTE1Ja8g, audit_chain_id=['kdpyGqvIQ0CCCCkTE1Ja8g']) at 0x7fe09e105970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:29.578072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:29.578072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:29.578072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] PATH_INFO: `/v3/projects/3122eb370c1248188f0f85446ca000e2` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:29.579435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3122eb370c1248188f0f85446ca000e2)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:29.580549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:29.744698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3122eb370c1248188f0f85446ca000e2', 'request_id': 'req-d83e5bff-4e90-4038-9429-a8930871e8ca'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:29.854535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3122eb370c1248188f0f85446ca000e2', 'request_id': 'req-d83e5bff-4e90-4038-9429-a8930871e8ca'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:29.854535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3122eb370c1248188f0f85446ca000e2', 'request_id': 'req-d83e5bff-4e90-4038-9429-a8930871e8ca'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:29.865230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] The token cache is being invalidate because project 3122eb370c1248188f0f85446ca000e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:03:29.865855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:29.866623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d83e5bff-4e90-4038-9429-a8930871e8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:29.868623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1049/2072] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:03:29 2022] DELETE /identity/v3/projects/3122eb370c1248188f0f85446ca000e2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:29.884243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07ee2-0838-4403-ad8d-8ef1cc111afd service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:29.885816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3ea07ee2-0838-4403-ad8d-8ef1cc111afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:29.899728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07ee2-0838-4403-ad8d-8ef1cc111afd service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:30.000258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09e4084f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:30.001145 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:30.001440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:30.005698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] PATH_INFO: `/v3/users/bcbfbbb0e51243bca61348bb9d084465` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:30.011209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbfbbb0e51243bca61348bb9d084465)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:30.016028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:30.300994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbfbbb0e51243bca61348bb9d084465'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:30.401407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbfbbb0e51243bca61348bb9d084465'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:30.416332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbfbbb0e51243bca61348bb9d084465'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:30.417158 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbfbbb0e51243bca61348bb9d084465'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:30.417792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbfbbb0e51243bca61348bb9d084465'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:30.431598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1024/2073] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:03:29 2022] DELETE /identity/v3/users/bcbfbbb0e51243bca61348bb9d084465 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:30.436119 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125c0c7-7f37-403e-b7d8-2bebc7036a88 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:30.436441 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125c0c7-7f37-403e-b7d8-2bebc7036a88 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:30.436732 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125c0c7-7f37-403e-b7d8-2bebc7036a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:30.460560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4125c0c7-7f37-403e-b7d8-2bebc7036a88 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:30.462275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4125c0c7-7f37-403e-b7d8-2bebc7036a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:30.536882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1050/2074] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:30.549264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:30.550679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:30.615963 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f23b2-0e44-4035-8639-f006dc3fb2f1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:30.619761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f38ed2-f292-4d82-9684-bd9eb49feba9 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e1fb850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:30.620342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f38ed2-f292-4d82-9684-bd9eb49feba9 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:30.620633 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f38ed2-f292-4d82-9684-bd9eb49feba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:30.620918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f38ed2-f292-4d82-9684-bd9eb49feba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:30.629854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f38ed2-f292-4d82-9684-bd9eb49feba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:30.631334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f38ed2-f292-4d82-9684-bd9eb49feba9 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:30.640979 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1025/2075] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:31.213473 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125c0c7-7f37-403e-b7d8-2bebc7036a88 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:31.214827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4125c0c7-7f37-403e-b7d8-2bebc7036a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:31.226730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125c0c7-7f37-403e-b7d8-2bebc7036a88 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:31.231311 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09e78e4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:31.232103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:31.232394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:31.232673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] PATH_INFO: `/v3/projects/5a3415a33dec44b597e3bf71115a0c95` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:31.233776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3415a33dec44b597e3bf71115a0c95)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:31.235812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:31.372114 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3415a33dec44b597e3bf71115a0c95', 'request_id': 'req-ab018884-5606-4c04-9f5e-0f21660183f9'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:31.474539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3415a33dec44b597e3bf71115a0c95', 'request_id': 'req-ab018884-5606-4c04-9f5e-0f21660183f9'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:31.487563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3415a33dec44b597e3bf71115a0c95', 'request_id': 'req-ab018884-5606-4c04-9f5e-0f21660183f9'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:31.499225 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] The token cache is being invalidate because project 5a3415a33dec44b597e3bf71115a0c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:03:31.499520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:31.500198 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:31.501665 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1051/2076] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:03:31 2022] DELETE /identity/v3/projects/5a3415a33dec44b597e3bf71115a0c95 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:31.505805 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f38ed2-f292-4d82-9684-bd9eb49feba9 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:31.515606 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f38ed2-f292-4d82-9684-bd9eb49feba9 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:31.585504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0352fe9-0fd6-4fc3-9b83-feb713a5f36c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09e3f8430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:31.587280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352fe9-0fd6-4fc3-9b83-feb713a5f36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:31.587576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352fe9-0fd6-4fc3-9b83-feb713a5f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:31.587861 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352fe9-0fd6-4fc3-9b83-feb713a5f36c admin admin] PATH_INFO: `/v3/users/2cf4aa610425427fae0ce5c518816db2` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:31.589156 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0352fe9-0fd6-4fc3-9b83-feb713a5f36c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf4aa610425427fae0ce5c518816db2)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:31.591100 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0352fe9-0fd6-4fc3-9b83-feb713a5f36c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:31.871716 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b0352fe9-0fd6-4fc3-9b83-feb713a5f36c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf4aa610425427fae0ce5c518816db2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:31.958627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b0352fe9-0fd6-4fc3-9b83-feb713a5f36c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf4aa610425427fae0ce5c518816db2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:31.971442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b0352fe9-0fd6-4fc3-9b83-feb713a5f36c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf4aa610425427fae0ce5c518816db2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:31.972115 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b0352fe9-0fd6-4fc3-9b83-feb713a5f36c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf4aa610425427fae0ce5c518816db2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:31.972709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b0352fe9-0fd6-4fc3-9b83-feb713a5f36c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf4aa610425427fae0ce5c518816db2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:31.985740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1026/2077] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:03:31 2022] DELETE /identity/v3/users/2cf4aa610425427fae0ce5c518816db2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:32.522263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:32.524143 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:32.537631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab018884-5606-4c04-9f5e-0f21660183f9 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:32.602181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BFKXqVQbQwiDOViDD8YYMA, audit_chain_id=['BFKXqVQbQwiDOViDD8YYMA']) at 0x7fe09e78ef10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:32.603139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:32.603496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:32.603815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] PATH_INFO: `/v3/projects/dbc0f5c49c954d788d7283082a67b245` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:32.605135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc0f5c49c954d788d7283082a67b245)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:32.607243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:32.732845 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc0f5c49c954d788d7283082a67b245', 'request_id': 'req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:32.817631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc0f5c49c954d788d7283082a67b245', 'request_id': 'req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:32.830544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc0f5c49c954d788d7283082a67b245', 'request_id': 'req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:32.841063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] The token cache is being invalidate because project dbc0f5c49c954d788d7283082a67b245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:03:32.841485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:32.842201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-56ca6830-2a2a-46ff-b0a6-ca0b2df12946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:32.843783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1052/2078] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:03:32 2022] DELETE /identity/v3/projects/dbc0f5c49c954d788d7283082a67b245 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:03:32.848629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9577ce-1d4d-49bb-8cee-ce24aec99c1e None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:32.849111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9577ce-1d4d-49bb-8cee-ce24aec99c1e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:32.849212 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9577ce-1d4d-49bb-8cee-ce24aec99c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:32.883897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-ea9577ce-1d4d-49bb-8cee-ce24aec99c1e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:32.898102 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ea9577ce-1d4d-49bb-8cee-ce24aec99c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:32.949944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1027/2079] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:32.957662 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e43abf-beab-4567-9d89-3a571c72bac6 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:32.957960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e43abf-beab-4567-9d89-3a571c72bac6 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:32.958360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e43abf-beab-4567-9d89-3a571c72bac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:32.981699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-47e43abf-beab-4567-9d89-3a571c72bac6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:32.982855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-47e43abf-beab-4567-9d89-3a571c72bac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:32.990086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1053/2080] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:03:32.994566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9577ce-1d4d-49bb-8cee-ce24aec99c1e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:33.004147 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9577ce-1d4d-49bb-8cee-ce24aec99c1e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:33.009290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426a089-b596-4b8e-84a2-1eb7f9fe61c5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uwFqFJSJRhuuHG7sTs__2g, audit_chain_id=['uwFqFJSJRhuuHG7sTs__2g']) at 0x7fe09e472fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:33.009896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426a089-b596-4b8e-84a2-1eb7f9fe61c5 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:33.010180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426a089-b596-4b8e-84a2-1eb7f9fe61c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:33.010457 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426a089-b596-4b8e-84a2-1eb7f9fe61c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:33.011207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426a089-b596-4b8e-84a2-1eb7f9fe61c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:03:33.011508 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426a089-b596-4b8e-84a2-1eb7f9fe61c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:33.013110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426a089-b596-4b8e-84a2-1eb7f9fe61c5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:33.028407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1028/2081] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:03:33.032571 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e43abf-beab-4567-9d89-3a571c72bac6 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:33.042107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e43abf-beab-4567-9d89-3a571c72bac6 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:33.046745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7fc50-e319-42d6-be1f-b59f0e7aa2b2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uwFqFJSJRhuuHG7sTs__2g, audit_chain_id=['uwFqFJSJRhuuHG7sTs__2g']) at 0x7fe0a38b1910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:33.047377 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7fc50-e319-42d6-be1f-b59f0e7aa2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:33.047672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7fc50-e319-42d6-be1f-b59f0e7aa2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:33.047957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7fc50-e319-42d6-be1f-b59f0e7aa2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:33.048606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7fc50-e319-42d6-be1f-b59f0e7aa2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:33.050492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7fc50-e319-42d6-be1f-b59f0e7aa2b2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:33.168272 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1054/2082] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:03:33 2022] POST /identity/v3/projects => generated 361 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:03:33.172574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426a089-b596-4b8e-84a2-1eb7f9fe61c5 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:33.182221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426a089-b596-4b8e-84a2-1eb7f9fe61c5 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:33.244932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3c7db-39d7-411d-a516-ee156f1ecc10 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uwFqFJSJRhuuHG7sTs__2g, audit_chain_id=['uwFqFJSJRhuuHG7sTs__2g']) at 0x7fe09e3ed280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:33.245466 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3c7db-39d7-411d-a516-ee156f1ecc10 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:33.245760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3c7db-39d7-411d-a516-ee156f1ecc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:33.246047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3c7db-39d7-411d-a516-ee156f1ecc10 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:33.246705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3c7db-39d7-411d-a516-ee156f1ecc10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:33.248698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3c7db-39d7-411d-a516-ee156f1ecc10 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:33.370032 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1029/2083] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:03:33 2022] POST /identity/v3/users => generated 281 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:03:33.373897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7fc50-e319-42d6-be1f-b59f0e7aa2b2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:33.384156 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7fc50-e319-42d6-be1f-b59f0e7aa2b2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:33.388591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dad30-9599-4736-9060-0f0cec1533f7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uwFqFJSJRhuuHG7sTs__2g, audit_chain_id=['uwFqFJSJRhuuHG7sTs__2g']) at 0x7fe09ded1d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:33.389894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dad30-9599-4736-9060-0f0cec1533f7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:33.389894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dad30-9599-4736-9060-0f0cec1533f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:33.389894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dad30-9599-4736-9060-0f0cec1533f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:33.390544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dad30-9599-4736-9060-0f0cec1533f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:33.392165 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dad30-9599-4736-9060-0f0cec1533f7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:33.403458 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1055/2084] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:03:33.407518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3c7db-39d7-411d-a516-ee156f1ecc10 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:33.417971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3c7db-39d7-411d-a516-ee156f1ecc10 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:33.422548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd3090-370d-44bf-8e51-1641f227511e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uwFqFJSJRhuuHG7sTs__2g, audit_chain_id=['uwFqFJSJRhuuHG7sTs__2g']) at 0x7fe09e50f460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:33.423153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd3090-370d-44bf-8e51-1641f227511e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:33.423442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd3090-370d-44bf-8e51-1641f227511e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:33.423718 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd3090-370d-44bf-8e51-1641f227511e admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:33.424427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd3090-370d-44bf-8e51-1641f227511e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:33.426000 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd3090-370d-44bf-8e51-1641f227511e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:33.438960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1030/2085] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:03:33.440119 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dad30-9599-4736-9060-0f0cec1533f7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:33.449812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dad30-9599-4736-9060-0f0cec1533f7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:33.454064 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82326be6-27a0-408b-9ed0-5dadccc59eab admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uwFqFJSJRhuuHG7sTs__2g, audit_chain_id=['uwFqFJSJRhuuHG7sTs__2g']) at 0x7fe09df24040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:33.454888 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82326be6-27a0-408b-9ed0-5dadccc59eab admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:33.455213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82326be6-27a0-408b-9ed0-5dadccc59eab admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:33.455592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82326be6-27a0-408b-9ed0-5dadccc59eab admin admin] PATH_INFO: `/v3/projects/cf3785db3dab4795a05dcac39e61e0d3/users/4aa42106b56d47c582d9b90f789e4d1c/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:33.475663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82326be6-27a0-408b-9ed0-5dadccc59eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3785db3dab4795a05dcac39e61e0d3, user_id=4aa42106b56d47c582d9b90f789e4d1c, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:33.479158 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82326be6-27a0-408b-9ed0-5dadccc59eab admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:33.547766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1056/2086] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:03:33 2022] PUT /identity/v3/projects/cf3785db3dab4795a05dcac39e61e0d3/users/4aa42106b56d47c582d9b90f789e4d1c/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:03:33.558283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce9c01-0237-4757-8c06-ede924d7beaf None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:33.558684 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce9c01-0237-4757-8c06-ede924d7beaf None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:33.558992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce9c01-0237-4757-8c06-ede924d7beaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:33.595210 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a0ce9c01-0237-4757-8c06-ede924d7beaf None None] MFA Rules not processed for user `4aa42106b56d47c582d9b90f789e4d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:33.596365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a0ce9c01-0237-4757-8c06-ede924d7beaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:33.675597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1031/2087] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:33 2022] POST /identity/v3/auth/tokens => generated 3668 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:33.706760 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f292a9-4460-409c-bbb7-c943f249fec5 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:33.707061 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f292a9-4460-409c-bbb7-c943f249fec5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:33.707374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f292a9-4460-409c-bbb7-c943f249fec5 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:33.709043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1057/2088] 10.222.0.21 () {54 vars in 962 bytes} [Mon Feb 28 19:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:03:33.715010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4233c-8027-4671-ac91-811097bbfa43 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:33.715341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4233c-8027-4671-ac91-811097bbfa43 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:33.715629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4233c-8027-4671-ac91-811097bbfa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:33.750418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-48b4233c-8027-4671-ac91-811097bbfa43 None None] MFA Rules not processed for user `43304b4fcb06440f9d5166ca439a581b`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:33.751753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-48b4233c-8027-4671-ac91-811097bbfa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:33.810806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1032/2089] 10.222.0.21 () {58 vars in 1059 bytes} [Mon Feb 28 19:03:33 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:33.818377 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f292a9-4460-409c-bbb7-c943f249fec5 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:33.829491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f292a9-4460-409c-bbb7-c943f249fec5 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:33.832854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a9c30-0d3a-458b-b1c5-a52d0883ea6c service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=AdG4elKgRumQuiVJPQxROQ, audit_chain_id=['AdG4elKgRumQuiVJPQxROQ']) at 0x7fe09e155850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:33.833429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a9c30-0d3a-458b-b1c5-a52d0883ea6c service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:33.833712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a9c30-0d3a-458b-b1c5-a52d0883ea6c service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:33.833995 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a9c30-0d3a-458b-b1c5-a52d0883ea6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:33.843218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a9c30-0d3a-458b-b1c5-a52d0883ea6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:33.844634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a9c30-0d3a-458b-b1c5-a52d0883ea6c service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:33.857339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1058/2090] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:33 2022] GET /identity/v3/auth/tokens => generated 3668 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:34.160728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4233c-8027-4671-ac91-811097bbfa43 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:34.232751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4233c-8027-4671-ac91-811097bbfa43 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:34.237046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uwFqFJSJRhuuHG7sTs__2g, audit_chain_id=['uwFqFJSJRhuuHG7sTs__2g']) at 0x7fe09e3e27c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:34.237845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:34.238141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:34.238423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] PATH_INFO: `/v3/users/4aa42106b56d47c582d9b90f789e4d1c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:34.239596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa42106b56d47c582d9b90f789e4d1c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:34.241505 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:34.447895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa42106b56d47c582d9b90f789e4d1c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:34.529061 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa42106b56d47c582d9b90f789e4d1c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:34.541546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa42106b56d47c582d9b90f789e4d1c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:34.542183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa42106b56d47c582d9b90f789e4d1c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:34.542789 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa42106b56d47c582d9b90f789e4d1c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:34.556523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1033/2091] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:03:34 2022] DELETE /identity/v3/users/4aa42106b56d47c582d9b90f789e4d1c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:34.561118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c366c-9b5f-41f9-a06a-9b51d82de3f4 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:34.561588 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c366c-9b5f-41f9-a06a-9b51d82de3f4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:34.561831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c366c-9b5f-41f9-a06a-9b51d82de3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:34.583244 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-902c366c-9b5f-41f9-a06a-9b51d82de3f4 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:34.584385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-902c366c-9b5f-41f9-a06a-9b51d82de3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:34.647759 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1059/2092] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:34.657771 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:34.659099 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:34.723710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c7d00-4177-4698-902d-42ff3bc8bcea admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:34.727925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c67262-36f0-4bdf-b71b-83369f3f8220 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e3f3c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:34.728555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c67262-36f0-4bdf-b71b-83369f3f8220 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:34.728802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c67262-36f0-4bdf-b71b-83369f3f8220 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:34.729081 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c67262-36f0-4bdf-b71b-83369f3f8220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:34.738394 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c67262-36f0-4bdf-b71b-83369f3f8220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:34.739845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c67262-36f0-4bdf-b71b-83369f3f8220 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:34.749864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1034/2093] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:35.558916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c366c-9b5f-41f9-a06a-9b51d82de3f4 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:35.560284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-902c366c-9b5f-41f9-a06a-9b51d82de3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:35.571832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c366c-9b5f-41f9-a06a-9b51d82de3f4 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:35.577231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uwFqFJSJRhuuHG7sTs__2g, audit_chain_id=['uwFqFJSJRhuuHG7sTs__2g']) at 0x7fe09e269e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:35.578132 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:35.578461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:35.578802 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] PATH_INFO: `/v3/projects/cf3785db3dab4795a05dcac39e61e0d3` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:35.580013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3785db3dab4795a05dcac39e61e0d3)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:35.581969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:35.694478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3785db3dab4795a05dcac39e61e0d3', 'request_id': 'req-d860a344-63ea-4ebc-b835-04b706d27e8a'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:35.769603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3785db3dab4795a05dcac39e61e0d3', 'request_id': 'req-d860a344-63ea-4ebc-b835-04b706d27e8a'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:35.781482 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3785db3dab4795a05dcac39e61e0d3', 'request_id': 'req-d860a344-63ea-4ebc-b835-04b706d27e8a'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:35.796060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] The token cache is being invalidate because project cf3785db3dab4795a05dcac39e61e0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:03:35.796060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:35.796060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d860a344-63ea-4ebc-b835-04b706d27e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:03:35.796060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1060/2094] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:03:35 2022] DELETE /identity/v3/projects/cf3785db3dab4795a05dcac39e61e0d3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:35.799313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac4c55-ef7d-4d69-b8f1-41d719b1e84f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:35.799772 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac4c55-ef7d-4d69-b8f1-41d719b1e84f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:35.799883 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac4c55-ef7d-4d69-b8f1-41d719b1e84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:35.822140 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-daac4c55-ef7d-4d69-b8f1-41d719b1e84f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:35.824766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-daac4c55-ef7d-4d69-b8f1-41d719b1e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:35.888441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1035/2095] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:35.897000 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be594fa-56e9-4844-8730-cfa67c227195 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:35.897315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be594fa-56e9-4844-8730-cfa67c227195 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:35.897595 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be594fa-56e9-4844-8730-cfa67c227195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:35.920768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-8be594fa-56e9-4844-8730-cfa67c227195 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:35.921921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8be594fa-56e9-4844-8730-cfa67c227195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:35.929144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1061/2096] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:35.933844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac4c55-ef7d-4d69-b8f1-41d719b1e84f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:35.943265 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac4c55-ef7d-4d69-b8f1-41d719b1e84f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:35.948711 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f452c-f1b3-4a44-bf85-db4e52f06e88 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AcDh_yoSRoiiebOEqES7YA, audit_chain_id=['AcDh_yoSRoiiebOEqES7YA']) at 0x7fe09e162520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:35.949310 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f452c-f1b3-4a44-bf85-db4e52f06e88 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:35.949598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f452c-f1b3-4a44-bf85-db4e52f06e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:35.949880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f452c-f1b3-4a44-bf85-db4e52f06e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:35.950579 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f452c-f1b3-4a44-bf85-db4e52f06e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:03:35.950961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f452c-f1b3-4a44-bf85-db4e52f06e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:35.952691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f452c-f1b3-4a44-bf85-db4e52f06e88 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:35.967813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1036/2097] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:03:35.971930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be594fa-56e9-4844-8730-cfa67c227195 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:35.981461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be594fa-56e9-4844-8730-cfa67c227195 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:35.987487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010e198-bd4d-418a-9e61-181981117c66 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AcDh_yoSRoiiebOEqES7YA, audit_chain_id=['AcDh_yoSRoiiebOEqES7YA']) at 0x7fe09de9b640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:35.988093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010e198-bd4d-418a-9e61-181981117c66 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:35.988897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010e198-bd4d-418a-9e61-181981117c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:35.988897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010e198-bd4d-418a-9e61-181981117c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:35.989375 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010e198-bd4d-418a-9e61-181981117c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:35.991503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010e198-bd4d-418a-9e61-181981117c66 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:36.099481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1062/2098] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:03:35 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:03:36.103620 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f452c-f1b3-4a44-bf85-db4e52f06e88 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:36.118237 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f452c-f1b3-4a44-bf85-db4e52f06e88 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:36.184677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6c680-44e8-4b93-867b-c3f2b8684bad admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AcDh_yoSRoiiebOEqES7YA, audit_chain_id=['AcDh_yoSRoiiebOEqES7YA']) at 0x7fe09de6c970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:36.185280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6c680-44e8-4b93-867b-c3f2b8684bad admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:36.185568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6c680-44e8-4b93-867b-c3f2b8684bad admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:36.185849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6c680-44e8-4b93-867b-c3f2b8684bad admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:36.186492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6c680-44e8-4b93-867b-c3f2b8684bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:36.188481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6c680-44e8-4b93-867b-c3f2b8684bad admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:36.281838 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1037/2099] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:03:36 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:03:36.288447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010e198-bd4d-418a-9e61-181981117c66 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:36.298816 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010e198-bd4d-418a-9e61-181981117c66 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:36.308227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3334d5-0ecb-4fcc-a197-6409df6455ef admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AcDh_yoSRoiiebOEqES7YA, audit_chain_id=['AcDh_yoSRoiiebOEqES7YA']) at 0x7fe09e14e6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:36.308227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3334d5-0ecb-4fcc-a197-6409df6455ef admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:36.308227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3334d5-0ecb-4fcc-a197-6409df6455ef admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:36.308227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3334d5-0ecb-4fcc-a197-6409df6455ef admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:36.308660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3334d5-0ecb-4fcc-a197-6409df6455ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:36.308660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3334d5-0ecb-4fcc-a197-6409df6455ef admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:36.317170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1063/2100] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:03:36.322262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6c680-44e8-4b93-867b-c3f2b8684bad admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:36.332250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6c680-44e8-4b93-867b-c3f2b8684bad admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:36.336848 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d500cd-6544-4543-80f5-071bbffbd8ae admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AcDh_yoSRoiiebOEqES7YA, audit_chain_id=['AcDh_yoSRoiiebOEqES7YA']) at 0x7fe09e162f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:36.337437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d500cd-6544-4543-80f5-071bbffbd8ae admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:36.337726 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d500cd-6544-4543-80f5-071bbffbd8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:36.338007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d500cd-6544-4543-80f5-071bbffbd8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:36.338699 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d500cd-6544-4543-80f5-071bbffbd8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:36.340414 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d500cd-6544-4543-80f5-071bbffbd8ae admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:36.350321 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1038/2101] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:03:36.354464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3334d5-0ecb-4fcc-a197-6409df6455ef admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:36.363912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3334d5-0ecb-4fcc-a197-6409df6455ef admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:36.368880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d978471-6c93-4bbf-b0a8-29655a861b3f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AcDh_yoSRoiiebOEqES7YA, audit_chain_id=['AcDh_yoSRoiiebOEqES7YA']) at 0x7fe09e25b5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:36.369678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978471-6c93-4bbf-b0a8-29655a861b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:36.369969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978471-6c93-4bbf-b0a8-29655a861b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:36.370286 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d978471-6c93-4bbf-b0a8-29655a861b3f admin admin] PATH_INFO: `/v3/projects/1bdeeae6a56d4607962f8b0a1490547a/users/3484bc7ebe7d4ddd972788b2ce5434ff/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:36.391219 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d978471-6c93-4bbf-b0a8-29655a861b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdeeae6a56d4607962f8b0a1490547a, user_id=3484bc7ebe7d4ddd972788b2ce5434ff, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:36.393911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d978471-6c93-4bbf-b0a8-29655a861b3f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:36.474327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1064/2102] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:03:36 2022] PUT /identity/v3/projects/1bdeeae6a56d4607962f8b0a1490547a/users/3484bc7ebe7d4ddd972788b2ce5434ff/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:03:36.478997 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966aa2b-cc3e-41a3-a631-a189ebbbb853 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:36.479583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966aa2b-cc3e-41a3-a631-a189ebbbb853 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:36.479880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966aa2b-cc3e-41a3-a631-a189ebbbb853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:36.505881 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a966aa2b-cc3e-41a3-a631-a189ebbbb853 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:36.507132 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a966aa2b-cc3e-41a3-a631-a189ebbbb853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:36.584515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1039/2103] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:36.594595 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d978471-6c93-4bbf-b0a8-29655a861b3f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:36.596276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8d978471-6c93-4bbf-b0a8-29655a861b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:36.675730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d978471-6c93-4bbf-b0a8-29655a861b3f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:36.679491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f573f3a-ac3c-44c5-8bba-ddceace83afe service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09ddd5640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:36.680213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f573f3a-ac3c-44c5-8bba-ddceace83afe service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:36.680503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f573f3a-ac3c-44c5-8bba-ddceace83afe service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:36.680783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f573f3a-ac3c-44c5-8bba-ddceace83afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:36.690837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f573f3a-ac3c-44c5-8bba-ddceace83afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:36.692324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f573f3a-ac3c-44c5-8bba-ddceace83afe service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:36.702538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1065/2104] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:38.392330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c851-046f-45ac-b3d0-1cd549eed39d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:38.392844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c851-046f-45ac-b3d0-1cd549eed39d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:38.393054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c851-046f-45ac-b3d0-1cd549eed39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:38.431898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a3f8c851-046f-45ac-b3d0-1cd549eed39d None None] MFA Rules not processed for user `3484bc7ebe7d4ddd972788b2ce5434ff`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:38.433080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a3f8c851-046f-45ac-b3d0-1cd549eed39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:38.507739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1040/2105] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:38 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:03:38.517700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f573f3a-ac3c-44c5-8bba-ddceace83afe service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:03:38.519079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3f573f3a-ac3c-44c5-8bba-ddceace83afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:38.583485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f573f3a-ac3c-44c5-8bba-ddceace83afe service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:03:38.587088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60ec4c-6747-4670-868b-55c8e9d419ad service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e1aebe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:03:38.587710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ec4c-6747-4670-868b-55c8e9d419ad service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:38.588006 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ec4c-6747-4670-868b-55c8e9d419ad service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:38.588296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ec4c-6747-4670-868b-55c8e9d419ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:38.596838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60ec4c-6747-4670-868b-55c8e9d419ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:03:38.598265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60ec4c-6747-4670-868b-55c8e9d419ad service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:03:38.606858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1066/2106] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:03:38 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:03:55.776520 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d0b7-2042-467f-b974-54127bd5f1f2 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:03:55.777110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d0b7-2042-467f-b974-54127bd5f1f2 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:03:55.777110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d0b7-2042-467f-b974-54127bd5f1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:03:55.801896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c036d0b7-2042-467f-b974-54127bd5f1f2 None None] MFA Rules not processed for user `3484bc7ebe7d4ddd972788b2ce5434ff`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:03:55.803175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c036d0b7-2042-467f-b974-54127bd5f1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:03:55.810075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1041/2107] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:03:55 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:20.230960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60ec4c-6747-4670-868b-55c8e9d419ad service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:20.232370 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2b60ec4c-6747-4670-868b-55c8e9d419ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:20.247039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60ec4c-6747-4670-868b-55c8e9d419ad service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:20.251411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kFIyX7YtTpWWKRZ2tx9IYw, audit_chain_id=['kFIyX7YtTpWWKRZ2tx9IYw']) at 0x7fe09e555c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:20.252353 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:20.252758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:20.253483 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] PATH_INFO: `/v3/users/97042cb03f154e3b89cf2f0b51f1e603` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:20.254977 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97042cb03f154e3b89cf2f0b51f1e603)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:20.257366 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:20.524384 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97042cb03f154e3b89cf2f0b51f1e603'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:20.536412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97042cb03f154e3b89cf2f0b51f1e603'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:20.537171 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97042cb03f154e3b89cf2f0b51f1e603'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:20.537876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97042cb03f154e3b89cf2f0b51f1e603'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:20.628025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97042cb03f154e3b89cf2f0b51f1e603'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:20.642464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1067/2108] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:04:20 2022] DELETE /identity/v3/users/97042cb03f154e3b89cf2f0b51f1e603 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:04:20.647085 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d391-e9d2-4e9c-a8f2-198262bb8697 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:20.647701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d391-e9d2-4e9c-a8f2-198262bb8697 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:20.647701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d391-e9d2-4e9c-a8f2-198262bb8697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:20.669724 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c020d391-e9d2-4e9c-a8f2-198262bb8697 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:20.671037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c020d391-e9d2-4e9c-a8f2-198262bb8697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:20.736898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1042/2109] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:04:20.747281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:20.748732 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:20.815016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d48e4-3e8d-4be9-85ab-3f6d37381ee2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:20.818574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bad664-6ebc-4566-ac94-bd2fc1db882b service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09de8bf70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:20.819188 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bad664-6ebc-4566-ac94-bd2fc1db882b service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:20.820042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bad664-6ebc-4566-ac94-bd2fc1db882b service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:20.820324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bad664-6ebc-4566-ac94-bd2fc1db882b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:20.829738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bad664-6ebc-4566-ac94-bd2fc1db882b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:20.831179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bad664-6ebc-4566-ac94-bd2fc1db882b service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:20.840857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1068/2110] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:04:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:04:21.268499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020d391-e9d2-4e9c-a8f2-198262bb8697 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:21.269982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c020d391-e9d2-4e9c-a8f2-198262bb8697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:21.285110 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020d391-e9d2-4e9c-a8f2-198262bb8697 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:21.292876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceeab4-88ae-43fe-8a13-23933b375fdb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09dec9b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:21.294071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceeab4-88ae-43fe-8a13-23933b375fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:21.294492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceeab4-88ae-43fe-8a13-23933b375fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:21.294861 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceeab4-88ae-43fe-8a13-23933b375fdb admin admin] PATH_INFO: `/v3/users/14c87e9dc4c14387bc0a2cac9d8791b6` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:21.296254 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceeab4-88ae-43fe-8a13-23933b375fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c87e9dc4c14387bc0a2cac9d8791b6)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:21.298276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceeab4-88ae-43fe-8a13-23933b375fdb admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:21.428502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bad664-6ebc-4566-ac94-bd2fc1db882b service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:21.429993 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-57bad664-6ebc-4566-ac94-bd2fc1db882b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:21.443259 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bad664-6ebc-4566-ac94-bd2fc1db882b service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:21.453213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kFIyX7YtTpWWKRZ2tx9IYw, audit_chain_id=['kFIyX7YtTpWWKRZ2tx9IYw']) at 0x7fe09de8b790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:21.454084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:21.454455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:21.454804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] PATH_INFO: `/v3/projects/26b9e0b327de49368dae688c1e31a260` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:21.456346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b9e0b327de49368dae688c1e31a260)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:21.458250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:21.522935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-deceeab4-88ae-43fe-8a13-23933b375fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c87e9dc4c14387bc0a2cac9d8791b6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:21.665640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b9e0b327de49368dae688c1e31a260', 'request_id': 'req-8daacfa3-bd82-4705-a745-701a06879063'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:21.679937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-deceeab4-88ae-43fe-8a13-23933b375fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c87e9dc4c14387bc0a2cac9d8791b6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:21.692565 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-deceeab4-88ae-43fe-8a13-23933b375fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c87e9dc4c14387bc0a2cac9d8791b6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:21.693207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-deceeab4-88ae-43fe-8a13-23933b375fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c87e9dc4c14387bc0a2cac9d8791b6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:21.693830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-deceeab4-88ae-43fe-8a13-23933b375fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c87e9dc4c14387bc0a2cac9d8791b6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:21.707332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1043/2111] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:04:21 2022] DELETE /identity/v3/users/14c87e9dc4c14387bc0a2cac9d8791b6 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:21.712500 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d396c5-08e9-47a7-91ed-d38505933d53 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:21.712796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d396c5-08e9-47a7-91ed-d38505933d53 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:21.713086 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d396c5-08e9-47a7-91ed-d38505933d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:21.734433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-03d396c5-08e9-47a7-91ed-d38505933d53 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:21.735641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-03d396c5-08e9-47a7-91ed-d38505933d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:21.796857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b9e0b327de49368dae688c1e31a260', 'request_id': 'req-8daacfa3-bd82-4705-a745-701a06879063'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:21.800148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1044/2112] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:04:21.808716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b9e0b327de49368dae688c1e31a260', 'request_id': 'req-8daacfa3-bd82-4705-a745-701a06879063'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:21.810643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d396c5-08e9-47a7-91ed-d38505933d53 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:21.811938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-03d396c5-08e9-47a7-91ed-d38505933d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:21.819086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] The token cache is being invalidate because project 26b9e0b327de49368dae688c1e31a260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:04:21.820099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:21.820929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:21.822438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1069/2113] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:04:21 2022] DELETE /identity/v3/projects/26b9e0b327de49368dae688c1e31a260 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:04:21.884873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d396c5-08e9-47a7-91ed-d38505933d53 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:21.888994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0f7d4-5266-40aa-b8ae-18ce47ff1e3b service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09de984c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:21.889599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0f7d4-5266-40aa-b8ae-18ce47ff1e3b service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:21.889887 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0f7d4-5266-40aa-b8ae-18ce47ff1e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:21.890169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0f7d4-5266-40aa-b8ae-18ce47ff1e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:21.892211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4bd0f7d4-5266-40aa-b8ae-18ce47ff1e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:21.905493 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0f7d4-5266-40aa-b8ae-18ce47ff1e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:21.907149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0f7d4-5266-40aa-b8ae-18ce47ff1e3b service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:21.921411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1045/2114] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:04:21 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:04:22.476039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:22.477516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:22.550283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daacfa3-bd82-4705-a745-701a06879063 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:22.554963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e62fc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:22.555780 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:22.556073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:22.556357 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] PATH_INFO: `/v3/projects/0fee780e43a84255b33934a96c9c8025` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:22.557461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fee780e43a84255b33934a96c9c8025)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:22.559385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:22.740347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fee780e43a84255b33934a96c9c8025', 'request_id': 'req-538d9e76-dc6e-44da-8153-4690a971839b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:22.830808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fee780e43a84255b33934a96c9c8025', 'request_id': 'req-538d9e76-dc6e-44da-8153-4690a971839b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:22.843771 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fee780e43a84255b33934a96c9c8025', 'request_id': 'req-538d9e76-dc6e-44da-8153-4690a971839b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:22.854470 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] The token cache is being invalidate because project 0fee780e43a84255b33934a96c9c8025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:04:22.854767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:22.856704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:22.856946 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1070/2115] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:04:22 2022] DELETE /identity/v3/projects/0fee780e43a84255b33934a96c9c8025 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:22.861115 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0f7d4-5266-40aa-b8ae-18ce47ff1e3b service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:22.871671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0f7d4-5266-40aa-b8ae-18ce47ff1e3b service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:22.936623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aede76-6700-4c7e-aa5d-85c479609bdb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e1cc8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:22.937439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aede76-6700-4c7e-aa5d-85c479609bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:22.937729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aede76-6700-4c7e-aa5d-85c479609bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:22.938011 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aede76-6700-4c7e-aa5d-85c479609bdb admin admin] PATH_INFO: `/v3/users/aa2fdb8bdb2349358d1af9384ce034a1` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:22.939171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aede76-6700-4c7e-aa5d-85c479609bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2fdb8bdb2349358d1af9384ce034a1)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:22.941087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aede76-6700-4c7e-aa5d-85c479609bdb admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:23.200461 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-62aede76-6700-4c7e-aa5d-85c479609bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2fdb8bdb2349358d1af9384ce034a1'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:23.319976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-62aede76-6700-4c7e-aa5d-85c479609bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2fdb8bdb2349358d1af9384ce034a1'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:23.332260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-62aede76-6700-4c7e-aa5d-85c479609bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2fdb8bdb2349358d1af9384ce034a1'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:23.332948 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-62aede76-6700-4c7e-aa5d-85c479609bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2fdb8bdb2349358d1af9384ce034a1'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:23.333564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-62aede76-6700-4c7e-aa5d-85c479609bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2fdb8bdb2349358d1af9384ce034a1'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:23.346644 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1046/2116] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:04:22 2022] DELETE /identity/v3/users/aa2fdb8bdb2349358d1af9384ce034a1 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:23.947175 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:23.948627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:23.962533 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d9e76-dc6e-44da-8153-4690a971839b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:24.027298 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Jt5fUf34RoqeiqYWn-Gasw, audit_chain_id=['Jt5fUf34RoqeiqYWn-Gasw']) at 0x7fe09e9d10a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:24.028090 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:24.028381 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:24.028664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] PATH_INFO: `/v3/projects/1c35870b76cf43199a807cfcf668d083` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:24.029765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c35870b76cf43199a807cfcf668d083)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:24.031694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:24.182871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c35870b76cf43199a807cfcf668d083', 'request_id': 'req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:24.285017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c35870b76cf43199a807cfcf668d083', 'request_id': 'req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:24.299863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c35870b76cf43199a807cfcf668d083', 'request_id': 'req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:24.324520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] The token cache is being invalidate because project 1c35870b76cf43199a807cfcf668d083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:04:24.324802 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:24.325488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ced830b9-6c9f-4aa6-81f6-f7f71f77bb28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:24.327336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1071/2117] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:04:23 2022] DELETE /identity/v3/projects/1c35870b76cf43199a807cfcf668d083 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:24.331989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069a762-2630-4856-a83c-de20750e33e6 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:24.335895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069a762-2630-4856-a83c-de20750e33e6 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:24.335895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069a762-2630-4856-a83c-de20750e33e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:24.355595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f069a762-2630-4856-a83c-de20750e33e6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:24.356752 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f069a762-2630-4856-a83c-de20750e33e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:24.424108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1047/2118] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:24.432543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9445f-24e8-458d-aab6-754d10259984 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:24.432837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9445f-24e8-458d-aab6-754d10259984 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:24.433123 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9445f-24e8-458d-aab6-754d10259984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:24.455992 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3ff9445f-24e8-458d-aab6-754d10259984 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:24.457150 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3ff9445f-24e8-458d-aab6-754d10259984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:24.465922 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1072/2119] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:24.468926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069a762-2630-4856-a83c-de20750e33e6 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:24.478366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069a762-2630-4856-a83c-de20750e33e6 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:24.482734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad8bfa-93ba-44e8-b307-4b8fe484c828 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09e162520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:24.483354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8bfa-93ba-44e8-b307-4b8fe484c828 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:24.483643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8bfa-93ba-44e8-b307-4b8fe484c828 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:24.483927 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8bfa-93ba-44e8-b307-4b8fe484c828 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:24.484622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad8bfa-93ba-44e8-b307-4b8fe484c828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:04:24.484937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad8bfa-93ba-44e8-b307-4b8fe484c828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:24.486579 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad8bfa-93ba-44e8-b307-4b8fe484c828 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:24.500048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1048/2120] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:04:24.509724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9445f-24e8-458d-aab6-754d10259984 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:24.518970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9445f-24e8-458d-aab6-754d10259984 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:24.524581 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81285b-d1ec-4c96-a0b4-b352ff300438 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09de551f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:24.525178 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81285b-d1ec-4c96-a0b4-b352ff300438 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:24.525471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81285b-d1ec-4c96-a0b4-b352ff300438 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:24.525756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81285b-d1ec-4c96-a0b4-b352ff300438 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:24.526464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81285b-d1ec-4c96-a0b4-b352ff300438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:24.528404 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81285b-d1ec-4c96-a0b4-b352ff300438 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:24.701208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1073/2121] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:04:24 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:04:24.705563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad8bfa-93ba-44e8-b307-4b8fe484c828 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:24.715680 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad8bfa-93ba-44e8-b307-4b8fe484c828 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:24.784686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c192a8a-b50d-4086-aff5-1af8545e6235 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09e1cc130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:24.785295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c192a8a-b50d-4086-aff5-1af8545e6235 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:24.785583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c192a8a-b50d-4086-aff5-1af8545e6235 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:24.785863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c192a8a-b50d-4086-aff5-1af8545e6235 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:24.786500 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c192a8a-b50d-4086-aff5-1af8545e6235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:24.789114 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c192a8a-b50d-4086-aff5-1af8545e6235 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:24.885313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1049/2122] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:04:24 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:04:24.889523 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81285b-d1ec-4c96-a0b4-b352ff300438 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:24.900057 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81285b-d1ec-4c96-a0b4-b352ff300438 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:24.904614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f1377-4e37-4ca3-bb35-bf6b614f14c3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09de396d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:24.905220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f1377-4e37-4ca3-bb35-bf6b614f14c3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:24.905538 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f1377-4e37-4ca3-bb35-bf6b614f14c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:24.905801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f1377-4e37-4ca3-bb35-bf6b614f14c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:24.906559 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f1377-4e37-4ca3-bb35-bf6b614f14c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:24.908203 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f1377-4e37-4ca3-bb35-bf6b614f14c3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:24.920807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1074/2123] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:04:24.924266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c192a8a-b50d-4086-aff5-1af8545e6235 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:24.935742 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c192a8a-b50d-4086-aff5-1af8545e6235 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:24.940536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188bc59-49ed-4d3e-8027-1537de2f94e4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09ddd5bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:24.945604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188bc59-49ed-4d3e-8027-1537de2f94e4 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:24.945604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188bc59-49ed-4d3e-8027-1537de2f94e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:24.945604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188bc59-49ed-4d3e-8027-1537de2f94e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:24.945604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188bc59-49ed-4d3e-8027-1537de2f94e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:24.945604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188bc59-49ed-4d3e-8027-1537de2f94e4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:24.955614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1050/2124] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:04:24.960186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f1377-4e37-4ca3-bb35-bf6b614f14c3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:24.973490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f1377-4e37-4ca3-bb35-bf6b614f14c3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:24.988396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90034eb5-e818-4a8d-a056-4e4252b8eb5c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09e555910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:24.990214 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90034eb5-e818-4a8d-a056-4e4252b8eb5c admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:24.990518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90034eb5-e818-4a8d-a056-4e4252b8eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:24.990808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90034eb5-e818-4a8d-a056-4e4252b8eb5c admin admin] PATH_INFO: `/v3/projects/7590feb28b264614a1722895b111f1bf/users/dbc86ee53971446e80921ce695427cf8/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:25.014164 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90034eb5-e818-4a8d-a056-4e4252b8eb5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7590feb28b264614a1722895b111f1bf, user_id=dbc86ee53971446e80921ce695427cf8, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:25.017026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90034eb5-e818-4a8d-a056-4e4252b8eb5c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:25.133881 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1075/2125] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:04:24 2022] PUT /identity/v3/projects/7590feb28b264614a1722895b111f1bf/users/dbc86ee53971446e80921ce695427cf8/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:25.144550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694a795-e0a1-43d7-be00-8269b7590070 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:25.144850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694a795-e0a1-43d7-be00-8269b7590070 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:25.145133 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694a795-e0a1-43d7-be00-8269b7590070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:25.185027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f694a795-e0a1-43d7-be00-8269b7590070 None None] MFA Rules not processed for user `dbc86ee53971446e80921ce695427cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:25.186197 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f694a795-e0a1-43d7-be00-8269b7590070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:25.257135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1051/2126] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:25 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:25.261413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90034eb5-e818-4a8d-a056-4e4252b8eb5c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:25.345879 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90034eb5-e818-4a8d-a056-4e4252b8eb5c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:25.352630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b882a1-8d31-453a-9c5a-62aeedffbd85 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09e978730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:25.353378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b882a1-8d31-453a-9c5a-62aeedffbd85 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:25.353786 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b882a1-8d31-453a-9c5a-62aeedffbd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:25.354346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b882a1-8d31-453a-9c5a-62aeedffbd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:25.355099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b882a1-8d31-453a-9c5a-62aeedffbd85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:25.357307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b882a1-8d31-453a-9c5a-62aeedffbd85 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:25.514644 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1076/2127] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:04:25 2022] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:04:25.516444 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694a795-e0a1-43d7-be00-8269b7590070 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:25.527319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694a795-e0a1-43d7-be00-8269b7590070 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:25.596213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee279-d3bb-4c90-94b7-b6154956dfeb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09de528e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:25.596839 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee279-d3bb-4c90-94b7-b6154956dfeb admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:25.597132 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee279-d3bb-4c90-94b7-b6154956dfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:25.597420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee279-d3bb-4c90-94b7-b6154956dfeb admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:25.598440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ee279-d3bb-4c90-94b7-b6154956dfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:25.600090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ee279-d3bb-4c90-94b7-b6154956dfeb admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:25.729412 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1052/2128] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:04:25 2022] POST /identity/v3/users => generated 296 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:04:25.733206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b882a1-8d31-453a-9c5a-62aeedffbd85 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:25.744366 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b882a1-8d31-453a-9c5a-62aeedffbd85 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:25.748581 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be8a21-98a6-44cb-ac12-616ea6c2b272 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09ded1070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:25.749276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be8a21-98a6-44cb-ac12-616ea6c2b272 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:25.749569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be8a21-98a6-44cb-ac12-616ea6c2b272 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:25.749857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be8a21-98a6-44cb-ac12-616ea6c2b272 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:25.750542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be8a21-98a6-44cb-ac12-616ea6c2b272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:25.752143 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be8a21-98a6-44cb-ac12-616ea6c2b272 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:25.763173 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1077/2129] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:04:25.767396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee279-d3bb-4c90-94b7-b6154956dfeb admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:25.777766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee279-d3bb-4c90-94b7-b6154956dfeb admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:25.782207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8e2e6-2738-412f-a555-e759b243f764 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09e1f3610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:25.783032 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8e2e6-2738-412f-a555-e759b243f764 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:25.783347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8e2e6-2738-412f-a555-e759b243f764 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:25.783629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8e2e6-2738-412f-a555-e759b243f764 admin admin] PATH_INFO: `/v3/projects/e2043a5509a14a62bd70ddd014f95e8c/users/325b921456194190ac9c761903ed39ca/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:25.805283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8e2e6-2738-412f-a555-e759b243f764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2043a5509a14a62bd70ddd014f95e8c, user_id=325b921456194190ac9c761903ed39ca, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:25.807954 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8e2e6-2738-412f-a555-e759b243f764 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:25.956723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1053/2130] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:04:25 2022] PUT /identity/v3/projects/e2043a5509a14a62bd70ddd014f95e8c/users/325b921456194190ac9c761903ed39ca/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:25.966972 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be8a21-98a6-44cb-ac12-616ea6c2b272 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:25.970785 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be8a21-98a6-44cb-ac12-616ea6c2b272 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:26.038988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f818a-a525-40ff-b87b-36734cf53700 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09df3b550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:26.039654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f818a-a525-40ff-b87b-36734cf53700 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:26.039950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f818a-a525-40ff-b87b-36734cf53700 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:26.040235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f818a-a525-40ff-b87b-36734cf53700 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:26.040937 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f818a-a525-40ff-b87b-36734cf53700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:26.042550 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f818a-a525-40ff-b87b-36734cf53700 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:26.057586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1078/2131] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:04:26.058669 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8e2e6-2738-412f-a555-e759b243f764 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:26.069884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8e2e6-2738-412f-a555-e759b243f764 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:26.074712 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720385b-7c3e-4206-a9cb-52cb7478335d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09e50f160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:26.075571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720385b-7c3e-4206-a9cb-52cb7478335d admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:26.075858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720385b-7c3e-4206-a9cb-52cb7478335d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:26.076694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720385b-7c3e-4206-a9cb-52cb7478335d admin admin] PATH_INFO: `/v3/projects/e2043a5509a14a62bd70ddd014f95e8c/users/325b921456194190ac9c761903ed39ca/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:26.078562 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720385b-7c3e-4206-a9cb-52cb7478335d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2043a5509a14a62bd70ddd014f95e8c, user_id=325b921456194190ac9c761903ed39ca, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:26.080762 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720385b-7c3e-4206-a9cb-52cb7478335d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:26.093012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1054/2132] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:04:26 2022] PUT /identity/v3/projects/e2043a5509a14a62bd70ddd014f95e8c/users/325b921456194190ac9c761903ed39ca/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:26.103497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6975e-d25f-4444-9b8c-16aed8b3b31d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:26.104624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6975e-d25f-4444-9b8c-16aed8b3b31d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:26.104918 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6975e-d25f-4444-9b8c-16aed8b3b31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:26.145547 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-dce6975e-d25f-4444-9b8c-16aed8b3b31d None None] MFA Rules not processed for user `325b921456194190ac9c761903ed39ca`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:26.146868 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-dce6975e-d25f-4444-9b8c-16aed8b3b31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:26.235880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1079/2133] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:26 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:26.247018 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720385b-7c3e-4206-a9cb-52cb7478335d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:26.248712 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f720385b-7c3e-4206-a9cb-52cb7478335d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:26.347089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720385b-7c3e-4206-a9cb-52cb7478335d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:26.351750 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9789b6-e46a-4719-80cf-9dae14940181 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09deedd00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:26.352367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9789b6-e46a-4719-80cf-9dae14940181 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:26.352662 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9789b6-e46a-4719-80cf-9dae14940181 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:26.352950 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9789b6-e46a-4719-80cf-9dae14940181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:26.362214 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9789b6-e46a-4719-80cf-9dae14940181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:26.363710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9789b6-e46a-4719-80cf-9dae14940181 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:26.374737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1055/2134] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:04:26 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:04:26.600016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409dcdc-1496-49a1-b7e7-56fc9e6041fc None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:26.600016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409dcdc-1496-49a1-b7e7-56fc9e6041fc None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:26.600016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409dcdc-1496-49a1-b7e7-56fc9e6041fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:26.622504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-6409dcdc-1496-49a1-b7e7-56fc9e6041fc None None] MFA Rules not processed for user `46e767d2e3624a3fa799c8c1b20b0516`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:26.623806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6409dcdc-1496-49a1-b7e7-56fc9e6041fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:26.690813 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1080/2135] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:26 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:26.765457 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9789b6-e46a-4719-80cf-9dae14940181 service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:26.776623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9789b6-e46a-4719-80cf-9dae14940181 service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:26.781473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d427900-231d-48b1-abd1-f156d3b86948 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e3e4bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:26.782300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427900-231d-48b1-abd1-f156d3b86948 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:26.782816 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427900-231d-48b1-abd1-f156d3b86948 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:26.783325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427900-231d-48b1-abd1-f156d3b86948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:26.863054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d427900-231d-48b1-abd1-f156d3b86948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:26.864531 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d427900-231d-48b1-abd1-f156d3b86948 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:26.874543 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1056/2136] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:04:26 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:04:29.805634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65b41-25c8-47ac-8ad9-efdb647ba5d0 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:29.806068 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65b41-25c8-47ac-8ad9-efdb647ba5d0 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:29.806206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65b41-25c8-47ac-8ad9-efdb647ba5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:29.836060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-0ad65b41-25c8-47ac-8ad9-efdb647ba5d0 None None] MFA Rules not processed for user `3484bc7ebe7d4ddd972788b2ce5434ff`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:29.837271 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0ad65b41-25c8-47ac-8ad9-efdb647ba5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:29.912256 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1081/2137] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:29 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:32.738002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d427900-231d-48b1-abd1-f156d3b86948 service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:32.739456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9d427900-231d-48b1-abd1-f156d3b86948 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:32.864162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d427900-231d-48b1-abd1-f156d3b86948 service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:32.870502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03ff81-e080-4668-98a0-8477009ddf80 service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=PTVXDCHNQWCQjy3BZQYY3Q, audit_chain_id=['PTVXDCHNQWCQjy3BZQYY3Q']) at 0x7fe09e1f3610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f330acd453f445ea31acf9fc43b53ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:32.871103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03ff81-e080-4668-98a0-8477009ddf80 service placement] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:32.871467 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03ff81-e080-4668-98a0-8477009ddf80 service placement] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:32.872035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03ff81-e080-4668-98a0-8477009ddf80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:32.873452 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4b03ff81-e080-4668-98a0-8477009ddf80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:32.886542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03ff81-e080-4668-98a0-8477009ddf80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:32.888147 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03ff81-e080-4668-98a0-8477009ddf80 service placement] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:32.898771 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1057/2138] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:04:32 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:04:43.782049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad65b41-25c8-47ac-8ad9-efdb647ba5d0 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:43.850772 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad65b41-25c8-47ac-8ad9-efdb647ba5d0 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:43.855958 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09dddb760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:43.856759 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:43.857045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:43.857327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] PATH_INFO: `/v3/users/dbc86ee53971446e80921ce695427cf8` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:43.858426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc86ee53971446e80921ce695427cf8)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:43.860603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:44.128479 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc86ee53971446e80921ce695427cf8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:44.143501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc86ee53971446e80921ce695427cf8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:44.144238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc86ee53971446e80921ce695427cf8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:44.144906 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc86ee53971446e80921ce695427cf8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:44.256407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc86ee53971446e80921ce695427cf8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:44.270624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1082/2139] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:04:43 2022] DELETE /identity/v3/users/dbc86ee53971446e80921ce695427cf8 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:44.275854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0cf1a-646e-41a8-97a8-4288fdfb4161 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:44.276369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0cf1a-646e-41a8-97a8-4288fdfb4161 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:44.276526 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0cf1a-646e-41a8-97a8-4288fdfb4161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:44.298174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-1ee0cf1a-646e-41a8-97a8-4288fdfb4161 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:44.299341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1ee0cf1a-646e-41a8-97a8-4288fdfb4161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:44.366673 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1058/2140] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:44.376960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:44.378327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:44.444267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32bec4-021c-41ca-ba50-d9e90b2e8f26 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:44.448449 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7e9d4-8e59-4486-8d32-086bfc2cd8e9 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09ddd5310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:44.449032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7e9d4-8e59-4486-8d32-086bfc2cd8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:44.449327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7e9d4-8e59-4486-8d32-086bfc2cd8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:44.449613 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7e9d4-8e59-4486-8d32-086bfc2cd8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:44.458349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7e9d4-8e59-4486-8d32-086bfc2cd8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:44.459808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7e9d4-8e59-4486-8d32-086bfc2cd8e9 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:44.469072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1083/2141] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:04:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:04:45.147407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0cf1a-646e-41a8-97a8-4288fdfb4161 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:45.151486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1ee0cf1a-646e-41a8-97a8-4288fdfb4161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:45.163515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0cf1a-646e-41a8-97a8-4288fdfb4161 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:45.169820 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09de5f640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:45.170601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:45.171063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:45.171523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] PATH_INFO: `/v3/projects/7590feb28b264614a1722895b111f1bf` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:45.173104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7590feb28b264614a1722895b111f1bf)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:45.174601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:45.320629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7590feb28b264614a1722895b111f1bf', 'request_id': 'req-a9377142-07e4-408c-bf6a-e3fc46210f87'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:45.332853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7590feb28b264614a1722895b111f1bf', 'request_id': 'req-a9377142-07e4-408c-bf6a-e3fc46210f87'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:45.453183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7590feb28b264614a1722895b111f1bf', 'request_id': 'req-a9377142-07e4-408c-bf6a-e3fc46210f87'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:45.469801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] The token cache is being invalidate because project 7590feb28b264614a1722895b111f1bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:04:45.469801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:45.469801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:45.469801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1059/2142] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:04:45 2022] DELETE /identity/v3/projects/7590feb28b264614a1722895b111f1bf => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:45.476735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7e9d4-8e59-4486-8d32-086bfc2cd8e9 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:45.488089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7e9d4-8e59-4486-8d32-086bfc2cd8e9 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:45.557107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace30de8-b642-4a86-b00f-f18e16302370 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09dddb760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:45.557951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace30de8-b642-4a86-b00f-f18e16302370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:45.558244 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace30de8-b642-4a86-b00f-f18e16302370 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:45.558528 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace30de8-b642-4a86-b00f-f18e16302370 admin admin] PATH_INFO: `/v3/users/325b921456194190ac9c761903ed39ca` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:45.559837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace30de8-b642-4a86-b00f-f18e16302370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325b921456194190ac9c761903ed39ca)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:45.561794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace30de8-b642-4a86-b00f-f18e16302370 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:45.815952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ace30de8-b642-4a86-b00f-f18e16302370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325b921456194190ac9c761903ed39ca'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:45.828558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ace30de8-b642-4a86-b00f-f18e16302370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325b921456194190ac9c761903ed39ca'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:45.829249 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ace30de8-b642-4a86-b00f-f18e16302370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325b921456194190ac9c761903ed39ca'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:45.829844 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ace30de8-b642-4a86-b00f-f18e16302370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325b921456194190ac9c761903ed39ca'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:45.959388 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ace30de8-b642-4a86-b00f-f18e16302370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325b921456194190ac9c761903ed39ca'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:45.974492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1084/2143] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:04:45 2022] DELETE /identity/v3/users/325b921456194190ac9c761903ed39ca => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:46.486868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:46.488344 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:46.501686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9377142-07e4-408c-bf6a-e3fc46210f87 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:46.568040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tOe-qflySNa53cbAWw0S_A, audit_chain_id=['tOe-qflySNa53cbAWw0S_A']) at 0x7fe09e159b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:46.568841 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:46.569132 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:46.569416 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] PATH_INFO: `/v3/projects/e2043a5509a14a62bd70ddd014f95e8c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:46.570540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2043a5509a14a62bd70ddd014f95e8c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:46.572625 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:46.746037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2043a5509a14a62bd70ddd014f95e8c', 'request_id': 'req-cd7035cf-1635-4dd3-94e2-c01c56aee61c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:46.758938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2043a5509a14a62bd70ddd014f95e8c', 'request_id': 'req-cd7035cf-1635-4dd3-94e2-c01c56aee61c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:46.907896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2043a5509a14a62bd70ddd014f95e8c', 'request_id': 'req-cd7035cf-1635-4dd3-94e2-c01c56aee61c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:46.919560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] The token cache is being invalidate because project e2043a5509a14a62bd70ddd014f95e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:04:46.919841 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:46.920466 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cd7035cf-1635-4dd3-94e2-c01c56aee61c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:46.921987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1060/2144] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:04:46 2022] DELETE /identity/v3/projects/e2043a5509a14a62bd70ddd014f95e8c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:46.933461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76512633-144e-49d2-8c20-21a8422ccef6 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:46.933959 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76512633-144e-49d2-8c20-21a8422ccef6 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:46.934053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76512633-144e-49d2-8c20-21a8422ccef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:46.957760 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-76512633-144e-49d2-8c20-21a8422ccef6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:46.958952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-76512633-144e-49d2-8c20-21a8422ccef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:47.026155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1085/2145] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:47.034760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9518b-dc99-4d55-a073-6c4261866743 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:47.035053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9518b-dc99-4d55-a073-6c4261866743 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:47.035368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9518b-dc99-4d55-a073-6c4261866743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:47.058611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-dbc9518b-dc99-4d55-a073-6c4261866743 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:47.059787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-dbc9518b-dc99-4d55-a073-6c4261866743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:47.066905 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1061/2146] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:47.070913 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76512633-144e-49d2-8c20-21a8422ccef6 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:47.080601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76512633-144e-49d2-8c20-21a8422ccef6 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:47.084891 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fa308-fd4f-47dc-b78d-214cb76e33c2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09de8b790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:47.085476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa308-fd4f-47dc-b78d-214cb76e33c2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:47.085766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa308-fd4f-47dc-b78d-214cb76e33c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:47.086047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa308-fd4f-47dc-b78d-214cb76e33c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:47.086736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fa308-fd4f-47dc-b78d-214cb76e33c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:04:47.087041 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fa308-fd4f-47dc-b78d-214cb76e33c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:47.089328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fa308-fd4f-47dc-b78d-214cb76e33c2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:47.101839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1086/2147] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:04:47.106105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9518b-dc99-4d55-a073-6c4261866743 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:47.114854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9518b-dc99-4d55-a073-6c4261866743 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:47.119604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c4886-0a67-42a0-b397-70f9a8347e5d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09e198760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:47.120177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4886-0a67-42a0-b397-70f9a8347e5d admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:47.120461 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4886-0a67-42a0-b397-70f9a8347e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:47.120743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4886-0a67-42a0-b397-70f9a8347e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:47.121384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c4886-0a67-42a0-b397-70f9a8347e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:47.123291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c4886-0a67-42a0-b397-70f9a8347e5d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:47.294278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1062/2148] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:04:47 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:04:47.298350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fa308-fd4f-47dc-b78d-214cb76e33c2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:47.307887 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fa308-fd4f-47dc-b78d-214cb76e33c2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:47.369141 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dc470-8018-4d86-a5ec-d0b33ba118d4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09de56040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:47.369735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dc470-8018-4d86-a5ec-d0b33ba118d4 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:47.370024 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dc470-8018-4d86-a5ec-d0b33ba118d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:47.370306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dc470-8018-4d86-a5ec-d0b33ba118d4 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:47.370934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201dc470-8018-4d86-a5ec-d0b33ba118d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:47.372853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201dc470-8018-4d86-a5ec-d0b33ba118d4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:47.501423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1087/2149] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:04:47 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:04:47.502874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c4886-0a67-42a0-b397-70f9a8347e5d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:47.514486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c4886-0a67-42a0-b397-70f9a8347e5d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:47.518115 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1953cfa-adec-48af-b929-43c90ebde68e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09e1cc8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:47.518700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1953cfa-adec-48af-b929-43c90ebde68e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:47.518988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1953cfa-adec-48af-b929-43c90ebde68e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:47.519290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1953cfa-adec-48af-b929-43c90ebde68e admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:47.519975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1953cfa-adec-48af-b929-43c90ebde68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:47.521551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1953cfa-adec-48af-b929-43c90ebde68e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:47.536613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1063/2150] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:04:47.538336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dc470-8018-4d86-a5ec-d0b33ba118d4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:47.548167 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dc470-8018-4d86-a5ec-d0b33ba118d4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:47.552616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ab782-ac23-4db5-809d-5233fb99cc1a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09eacf9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:47.553215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab782-ac23-4db5-809d-5233fb99cc1a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:47.553502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab782-ac23-4db5-809d-5233fb99cc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:47.553781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab782-ac23-4db5-809d-5233fb99cc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:47.554469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ab782-ac23-4db5-809d-5233fb99cc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:47.556572 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ab782-ac23-4db5-809d-5233fb99cc1a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:47.567139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1088/2151] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:04:47.571585 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1953cfa-adec-48af-b929-43c90ebde68e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:47.581777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1953cfa-adec-48af-b929-43c90ebde68e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:47.586107 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d549df-32d3-489b-bc3a-6db109e276f2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09de9d7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:47.586919 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d549df-32d3-489b-bc3a-6db109e276f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:47.587438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d549df-32d3-489b-bc3a-6db109e276f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:47.587799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d549df-32d3-489b-bc3a-6db109e276f2 admin admin] PATH_INFO: `/v3/projects/3b92df90400d485b981f9ecc9d6522c3/users/67858568552c4f83b572c2fceef91fff/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:47.606865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d549df-32d3-489b-bc3a-6db109e276f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b92df90400d485b981f9ecc9d6522c3, user_id=67858568552c4f83b572c2fceef91fff, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:47.609514 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d549df-32d3-489b-bc3a-6db109e276f2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:47.751176 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1064/2152] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:04:47 2022] PUT /identity/v3/projects/3b92df90400d485b981f9ecc9d6522c3/users/67858568552c4f83b572c2fceef91fff/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:04:47.761912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334086-89fd-4e51-ad41-b2372879b518 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:47.762213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334086-89fd-4e51-ad41-b2372879b518 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:47.762501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334086-89fd-4e51-ad41-b2372879b518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:47.798293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-be334086-89fd-4e51-ad41-b2372879b518 None None] MFA Rules not processed for user `67858568552c4f83b572c2fceef91fff`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:47.799426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-be334086-89fd-4e51-ad41-b2372879b518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:47.871537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1089/2153] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:47 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:47.875966 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d549df-32d3-489b-bc3a-6db109e276f2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:47.965611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d549df-32d3-489b-bc3a-6db109e276f2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:47.970857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d8004-21d4-43aa-95dc-d895328c4e0c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09e15b9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:47.971503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d8004-21d4-43aa-95dc-d895328c4e0c admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:47.971796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d8004-21d4-43aa-95dc-d895328c4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:47.972082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d8004-21d4-43aa-95dc-d895328c4e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:47.972906 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d8004-21d4-43aa-95dc-d895328c4e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:47.974899 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d8004-21d4-43aa-95dc-d895328c4e0c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:48.100732 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be334086-89fd-4e51-ad41-b2372879b518 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:48.103739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1065/2154] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:04:47 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:04:48.112968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be334086-89fd-4e51-ad41-b2372879b518 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:48.190059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fb2fa-ec36-426c-8acf-14d892e624bb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09ddcf5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:48.190672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fb2fa-ec36-426c-8acf-14d892e624bb admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:48.190988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fb2fa-ec36-426c-8acf-14d892e624bb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:48.191300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fb2fa-ec36-426c-8acf-14d892e624bb admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:48.191934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fb2fa-ec36-426c-8acf-14d892e624bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:48.193841 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fb2fa-ec36-426c-8acf-14d892e624bb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:48.322020 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1090/2155] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:04:48 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:04:48.325993 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d8004-21d4-43aa-95dc-d895328c4e0c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:48.336261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d8004-21d4-43aa-95dc-d895328c4e0c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:48.341705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6310c67-9abd-4e7d-b529-c06756464a17 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09e3e4190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:48.342433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6310c67-9abd-4e7d-b529-c06756464a17 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:48.342761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6310c67-9abd-4e7d-b529-c06756464a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:48.343047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6310c67-9abd-4e7d-b529-c06756464a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:48.343778 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6310c67-9abd-4e7d-b529-c06756464a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:48.345386 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6310c67-9abd-4e7d-b529-c06756464a17 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:48.358943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1066/2156] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:04:48.361930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fb2fa-ec36-426c-8acf-14d892e624bb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:48.372063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fb2fa-ec36-426c-8acf-14d892e624bb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:48.376418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c1a4a-38e8-42ca-9994-414ae1f191f9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09defed00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:48.377263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c1a4a-38e8-42ca-9994-414ae1f191f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:48.377548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c1a4a-38e8-42ca-9994-414ae1f191f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:48.377825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c1a4a-38e8-42ca-9994-414ae1f191f9 admin admin] PATH_INFO: `/v3/projects/f64f137aa2214e4d9764490dea5d04f8/users/8c124c05ac3f4e87ba8f4e8b834127c0/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:48.397079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c1a4a-38e8-42ca-9994-414ae1f191f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64f137aa2214e4d9764490dea5d04f8, user_id=8c124c05ac3f4e87ba8f4e8b834127c0, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:48.400509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c1a4a-38e8-42ca-9994-414ae1f191f9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:48.493803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1091/2157] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:04:48 2022] PUT /identity/v3/projects/f64f137aa2214e4d9764490dea5d04f8/users/8c124c05ac3f4e87ba8f4e8b834127c0/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:48.497910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6310c67-9abd-4e7d-b529-c06756464a17 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:48.507802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6310c67-9abd-4e7d-b529-c06756464a17 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:48.574509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cea5bb-c069-4198-bcd5-f11dba38ce4b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09de6c040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:48.575133 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cea5bb-c069-4198-bcd5-f11dba38ce4b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:48.575427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cea5bb-c069-4198-bcd5-f11dba38ce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:48.575704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cea5bb-c069-4198-bcd5-f11dba38ce4b admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:48.576396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cea5bb-c069-4198-bcd5-f11dba38ce4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:48.577983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cea5bb-c069-4198-bcd5-f11dba38ce4b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:48.591393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1067/2158] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:04:48.595607 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c1a4a-38e8-42ca-9994-414ae1f191f9 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:48.605852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c1a4a-38e8-42ca-9994-414ae1f191f9 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:48.610320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da540-2072-4717-8e80-cc1db4625c4f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09e15e070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:48.611083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da540-2072-4717-8e80-cc1db4625c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:48.611427 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da540-2072-4717-8e80-cc1db4625c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:48.611712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da540-2072-4717-8e80-cc1db4625c4f admin admin] PATH_INFO: `/v3/projects/f64f137aa2214e4d9764490dea5d04f8/users/8c124c05ac3f4e87ba8f4e8b834127c0/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:48.613504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847da540-2072-4717-8e80-cc1db4625c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64f137aa2214e4d9764490dea5d04f8, user_id=8c124c05ac3f4e87ba8f4e8b834127c0, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:48.616173 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847da540-2072-4717-8e80-cc1db4625c4f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:48.626008 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1092/2159] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:04:48 2022] PUT /identity/v3/projects/f64f137aa2214e4d9764490dea5d04f8/users/8c124c05ac3f4e87ba8f4e8b834127c0/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:48.636638 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b45cc9-1053-42ec-928c-8cd8f15c7258 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:48.636936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b45cc9-1053-42ec-928c-8cd8f15c7258 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:48.637221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b45cc9-1053-42ec-928c-8cd8f15c7258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:48.673562 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f0b45cc9-1053-42ec-928c-8cd8f15c7258 None None] MFA Rules not processed for user `8c124c05ac3f4e87ba8f4e8b834127c0`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:48.674735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f0b45cc9-1053-42ec-928c-8cd8f15c7258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:48.750387 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1068/2160] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:48 2022] POST /identity/v3/auth/tokens => generated 3737 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:48.761381 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da540-2072-4717-8e80-cc1db4625c4f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:48.763024 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-847da540-2072-4717-8e80-cc1db4625c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:48.831373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da540-2072-4717-8e80-cc1db4625c4f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:48.835035 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf052af9-b793-4332-9ee0-99b1460971b4 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09dda13a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:48.835656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf052af9-b793-4332-9ee0-99b1460971b4 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:48.835946 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf052af9-b793-4332-9ee0-99b1460971b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:48.836232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf052af9-b793-4332-9ee0-99b1460971b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:48.853667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf052af9-b793-4332-9ee0-99b1460971b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:48.855406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf052af9-b793-4332-9ee0-99b1460971b4 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:48.876108 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1093/2161] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:04:48 2022] GET /identity/v3/auth/tokens => generated 3737 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:04:49.152551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b45cc9-1053-42ec-928c-8cd8f15c7258 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:49.161930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b45cc9-1053-42ec-928c-8cd8f15c7258 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:49.165461 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdda9a-6072-4d40-a26b-e9b92ae27aa0 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e8faa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:49.166051 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdda9a-6072-4d40-a26b-e9b92ae27aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:49.166336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdda9a-6072-4d40-a26b-e9b92ae27aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:49.166620 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdda9a-6072-4d40-a26b-e9b92ae27aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:49.238323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdda9a-6072-4d40-a26b-e9b92ae27aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:49.240129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdda9a-6072-4d40-a26b-e9b92ae27aa0 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:49.250759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1069/2162] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:04:49 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:04:53.449872 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf052af9-b793-4332-9ee0-99b1460971b4 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:53.517534 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf052af9-b793-4332-9ee0-99b1460971b4 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:53.522039 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09e4efb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:53.522832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:53.523173 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:53.523457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] PATH_INFO: `/v3/users/67858568552c4f83b572c2fceef91fff` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:53.524611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67858568552c4f83b572c2fceef91fff)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:53.526520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:53.786026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67858568552c4f83b572c2fceef91fff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:53.798684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67858568552c4f83b572c2fceef91fff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:53.799377 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67858568552c4f83b572c2fceef91fff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:53.800002 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67858568552c4f83b572c2fceef91fff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:53.915435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67858568552c4f83b572c2fceef91fff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:53.929716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1094/2163] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:04:53 2022] DELETE /identity/v3/users/67858568552c4f83b572c2fceef91fff => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:53.935534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc65d5-a5c1-46b3-90e1-90d594a0004c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:53.936287 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc65d5-a5c1-46b3-90e1-90d594a0004c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:53.936496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc65d5-a5c1-46b3-90e1-90d594a0004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:53.958445 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-fafc65d5-a5c1-46b3-90e1-90d594a0004c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:53.959736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-fafc65d5-a5c1-46b3-90e1-90d594a0004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:54.025615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1070/2164] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:54.035865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:54.037240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:54.100188 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9435d6e-b984-4751-b687-1f5e91cbd739 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:54.104364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9cc66-c452-4188-a8e2-8309ee82efa0 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e8c6250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:54.104950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9cc66-c452-4188-a8e2-8309ee82efa0 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:54.105245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9cc66-c452-4188-a8e2-8309ee82efa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:54.105529 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9cc66-c452-4188-a8e2-8309ee82efa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:54.114557 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9cc66-c452-4188-a8e2-8309ee82efa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:54.116014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9cc66-c452-4188-a8e2-8309ee82efa0 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:54.125921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1095/2165] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:04:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:04:54.624940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc65d5-a5c1-46b3-90e1-90d594a0004c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:54.626826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-fafc65d5-a5c1-46b3-90e1-90d594a0004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:54.639823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc65d5-a5c1-46b3-90e1-90d594a0004c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:54.644921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09e15bdf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:54.645811 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:54.646170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:54.646462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] PATH_INFO: `/v3/projects/3b92df90400d485b981f9ecc9d6522c3` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:54.647657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b92df90400d485b981f9ecc9d6522c3)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:54.650250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:54.768126 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b92df90400d485b981f9ecc9d6522c3', 'request_id': 'req-72954527-8b6a-40f4-a3e1-10bd04d46284'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:54.780342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b92df90400d485b981f9ecc9d6522c3', 'request_id': 'req-72954527-8b6a-40f4-a3e1-10bd04d46284'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:54.903807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b92df90400d485b981f9ecc9d6522c3', 'request_id': 'req-72954527-8b6a-40f4-a3e1-10bd04d46284'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:54.914868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] The token cache is being invalidate because project 3b92df90400d485b981f9ecc9d6522c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:04:54.915336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:54.916037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:54.917751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1071/2166] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:04:54 2022] DELETE /identity/v3/projects/3b92df90400d485b981f9ecc9d6522c3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:54.921770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9cc66-c452-4188-a8e2-8309ee82efa0 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:54.931658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9cc66-c452-4188-a8e2-8309ee82efa0 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:55.001667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108471b-e34c-4499-9245-7861c7e23c9f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09e196af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:55.002475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108471b-e34c-4499-9245-7861c7e23c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:55.002769 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108471b-e34c-4499-9245-7861c7e23c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:55.003053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108471b-e34c-4499-9245-7861c7e23c9f admin admin] PATH_INFO: `/v3/users/8c124c05ac3f4e87ba8f4e8b834127c0` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:55.004205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108471b-e34c-4499-9245-7861c7e23c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c124c05ac3f4e87ba8f4e8b834127c0)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:55.006129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108471b-e34c-4499-9245-7861c7e23c9f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:55.250284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d108471b-e34c-4499-9245-7861c7e23c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c124c05ac3f4e87ba8f4e8b834127c0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:55.260781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d108471b-e34c-4499-9245-7861c7e23c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c124c05ac3f4e87ba8f4e8b834127c0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:55.261439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d108471b-e34c-4499-9245-7861c7e23c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c124c05ac3f4e87ba8f4e8b834127c0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:55.262042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d108471b-e34c-4499-9245-7861c7e23c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c124c05ac3f4e87ba8f4e8b834127c0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:55.424108 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d108471b-e34c-4499-9245-7861c7e23c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c124c05ac3f4e87ba8f4e8b834127c0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:55.438717 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1096/2167] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:04:54 2022] DELETE /identity/v3/users/8c124c05ac3f4e87ba8f4e8b834127c0 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:56.038747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:56.041494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:56.055784 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72954527-8b6a-40f4-a3e1-10bd04d46284 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:56.121536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uT6WxOvnR8qYu2xEbf5xPQ, audit_chain_id=['uT6WxOvnR8qYu2xEbf5xPQ']) at 0x7fe09de54790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:56.122340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:56.123948 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:56.123948 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] PATH_INFO: `/v3/projects/f64f137aa2214e4d9764490dea5d04f8` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:56.124105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64f137aa2214e4d9764490dea5d04f8)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:56.126057 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:56.266047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64f137aa2214e4d9764490dea5d04f8', 'request_id': 'req-f0f0686a-bd39-4643-9338-40c8ba38bf7c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:56.278594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64f137aa2214e4d9764490dea5d04f8', 'request_id': 'req-f0f0686a-bd39-4643-9338-40c8ba38bf7c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:56.389200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64f137aa2214e4d9764490dea5d04f8', 'request_id': 'req-f0f0686a-bd39-4643-9338-40c8ba38bf7c'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:56.400505 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] The token cache is being invalidate because project f64f137aa2214e4d9764490dea5d04f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:04:56.400794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:56.401452 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f0f0686a-bd39-4643-9338-40c8ba38bf7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:04:56.402945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1072/2168] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:04:56 2022] DELETE /identity/v3/projects/f64f137aa2214e4d9764490dea5d04f8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:56.407726 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e3996-d829-41d2-ba8f-589f8047f749 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:56.408192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e3996-d829-41d2-ba8f-589f8047f749 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:56.408324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e3996-d829-41d2-ba8f-589f8047f749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:56.431377 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a17e3996-d829-41d2-ba8f-589f8047f749 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:56.432570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a17e3996-d829-41d2-ba8f-589f8047f749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:56.498243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1097/2169] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:56.507578 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ece71-c30a-4d68-835e-f5f465c21409 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:56.507899 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ece71-c30a-4d68-835e-f5f465c21409 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:56.508189 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ece71-c30a-4d68-835e-f5f465c21409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:56.532540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-350ece71-c30a-4d68-835e-f5f465c21409 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:56.533733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-350ece71-c30a-4d68-835e-f5f465c21409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:56.541422 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1073/2170] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:56.547352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e3996-d829-41d2-ba8f-589f8047f749 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:56.557134 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e3996-d829-41d2-ba8f-589f8047f749 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:56.561357 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f31be-316b-4c15-9022-ebec2c5cda25 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09df3b7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:56.561968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f31be-316b-4c15-9022-ebec2c5cda25 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:56.562256 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f31be-316b-4c15-9022-ebec2c5cda25 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:56.562534 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f31be-316b-4c15-9022-ebec2c5cda25 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:56.563256 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f31be-316b-4c15-9022-ebec2c5cda25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:04:56.563556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f31be-316b-4c15-9022-ebec2c5cda25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:56.565136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f31be-316b-4c15-9022-ebec2c5cda25 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:56.578727 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1098/2171] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:04:56.583032 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ece71-c30a-4d68-835e-f5f465c21409 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:56.592143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ece71-c30a-4d68-835e-f5f465c21409 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:56.596745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab6669-c1cd-44d4-8d8a-1d1c99a62465 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09dec9b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:56.597326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab6669-c1cd-44d4-8d8a-1d1c99a62465 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:56.597616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab6669-c1cd-44d4-8d8a-1d1c99a62465 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:56.597903 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab6669-c1cd-44d4-8d8a-1d1c99a62465 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:56.598544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab6669-c1cd-44d4-8d8a-1d1c99a62465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:56.600559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab6669-c1cd-44d4-8d8a-1d1c99a62465 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:56.728309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1074/2172] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:04:56 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:04:56.732685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f31be-316b-4c15-9022-ebec2c5cda25 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:56.742658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f31be-316b-4c15-9022-ebec2c5cda25 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:56.807323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447dd72-54d2-4789-b392-d766add8f5cd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09e155d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:56.807867 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447dd72-54d2-4789-b392-d766add8f5cd admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:56.808158 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447dd72-54d2-4789-b392-d766add8f5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:56.808440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447dd72-54d2-4789-b392-d766add8f5cd admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:56.809088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447dd72-54d2-4789-b392-d766add8f5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:56.810988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447dd72-54d2-4789-b392-d766add8f5cd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:56.965128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1099/2173] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:04:56 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:04:56.970832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab6669-c1cd-44d4-8d8a-1d1c99a62465 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:56.976396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab6669-c1cd-44d4-8d8a-1d1c99a62465 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:56.981547 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e236a42-a46e-4251-ac1f-e59cca119b2f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09de1e6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:56.982142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236a42-a46e-4251-ac1f-e59cca119b2f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:56.982459 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236a42-a46e-4251-ac1f-e59cca119b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:56.982746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236a42-a46e-4251-ac1f-e59cca119b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:56.983476 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e236a42-a46e-4251-ac1f-e59cca119b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:56.985096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e236a42-a46e-4251-ac1f-e59cca119b2f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:56.996424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1075/2174] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:04:57.000526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447dd72-54d2-4789-b392-d766add8f5cd admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:57.010654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447dd72-54d2-4789-b392-d766add8f5cd admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:57.015435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b7b54-e0b6-4cb7-b1ca-9567e39c2b35 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09defea90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:57.016099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b7b54-e0b6-4cb7-b1ca-9567e39c2b35 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:57.016397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b7b54-e0b6-4cb7-b1ca-9567e39c2b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:57.016783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b7b54-e0b6-4cb7-b1ca-9567e39c2b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:57.017591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b7b54-e0b6-4cb7-b1ca-9567e39c2b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:57.019268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b7b54-e0b6-4cb7-b1ca-9567e39c2b35 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:57.042812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e236a42-a46e-4251-ac1f-e59cca119b2f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:57.043910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1100/2175] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:04:57.062458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e236a42-a46e-4251-ac1f-e59cca119b2f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:57.065076 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a585504-b4a9-4262-9b91-4f55d81bb05f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09de43fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:57.066747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a585504-b4a9-4262-9b91-4f55d81bb05f admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:57.067038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a585504-b4a9-4262-9b91-4f55d81bb05f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:57.067375 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a585504-b4a9-4262-9b91-4f55d81bb05f admin admin] PATH_INFO: `/v3/projects/ed5d0fcfcae64fe8b5a0f6d8ced4730e/users/92aa4cb2203d49688040e6a5d9d918b4/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:57.091718 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a585504-b4a9-4262-9b91-4f55d81bb05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed5d0fcfcae64fe8b5a0f6d8ced4730e, user_id=92aa4cb2203d49688040e6a5d9d918b4, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:57.094349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a585504-b4a9-4262-9b91-4f55d81bb05f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:57.195644 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1076/2176] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:04:57 2022] PUT /identity/v3/projects/ed5d0fcfcae64fe8b5a0f6d8ced4730e/users/92aa4cb2203d49688040e6a5d9d918b4/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:57.206194 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d4de7-163a-4f44-9454-8e868cd16fdb None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:57.206489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d4de7-163a-4f44-9454-8e868cd16fdb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:57.206775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d4de7-163a-4f44-9454-8e868cd16fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:57.242964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-d85d4de7-163a-4f44-9454-8e868cd16fdb None None] MFA Rules not processed for user `92aa4cb2203d49688040e6a5d9d918b4`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:57.244078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d85d4de7-163a-4f44-9454-8e868cd16fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:57.316221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1101/2177] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:57 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:04:57.320608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a585504-b4a9-4262-9b91-4f55d81bb05f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:57.390087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a585504-b4a9-4262-9b91-4f55d81bb05f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:57.394507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356f406-a041-4a11-901f-f040162ef92a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09e3de4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:57.395097 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356f406-a041-4a11-901f-f040162ef92a admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:57.395480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356f406-a041-4a11-901f-f040162ef92a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:57.395703 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356f406-a041-4a11-901f-f040162ef92a admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:57.396350 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356f406-a041-4a11-901f-f040162ef92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:57.398256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356f406-a041-4a11-901f-f040162ef92a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:57.560472 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1077/2178] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:04:57 2022] POST /identity/v3/projects => generated 369 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:04:57.564812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d4de7-163a-4f44-9454-8e868cd16fdb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:57.577623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d4de7-163a-4f44-9454-8e868cd16fdb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:57.642666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025349f-3e57-4b03-837a-722c22a72f51 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09e480910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:57.643345 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025349f-3e57-4b03-837a-722c22a72f51 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:57.643631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025349f-3e57-4b03-837a-722c22a72f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:57.643912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025349f-3e57-4b03-837a-722c22a72f51 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:57.644561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025349f-3e57-4b03-837a-722c22a72f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:57.646463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025349f-3e57-4b03-837a-722c22a72f51 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:57.759098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1102/2179] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:04:57 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:04:57.760650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356f406-a041-4a11-901f-f040162ef92a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:57.770814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356f406-a041-4a11-901f-f040162ef92a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:57.776516 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69274188-230b-47ef-a938-ae0359093343 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09deedac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:57.777117 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69274188-230b-47ef-a938-ae0359093343 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:57.777407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69274188-230b-47ef-a938-ae0359093343 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:57.777694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69274188-230b-47ef-a938-ae0359093343 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:57.778423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69274188-230b-47ef-a938-ae0359093343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:57.780055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69274188-230b-47ef-a938-ae0359093343 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:57.794580 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1078/2180] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:04:57.796054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025349f-3e57-4b03-837a-722c22a72f51 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:57.805801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025349f-3e57-4b03-837a-722c22a72f51 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:57.810228 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718c0e0-ede4-4c06-b017-915db0ff6dd9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09de0fca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:57.811049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718c0e0-ede4-4c06-b017-915db0ff6dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:57.811424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718c0e0-ede4-4c06-b017-915db0ff6dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:57.811766 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718c0e0-ede4-4c06-b017-915db0ff6dd9 admin admin] PATH_INFO: `/v3/projects/eb5706dcd260450b8d33d52759f16718/users/08bdaaeab19c4d3da5b39efea9d80d08/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:57.833113 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718c0e0-ede4-4c06-b017-915db0ff6dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5706dcd260450b8d33d52759f16718, user_id=08bdaaeab19c4d3da5b39efea9d80d08, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:57.838588 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718c0e0-ede4-4c06-b017-915db0ff6dd9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:57.926701 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1103/2181] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:04:57 2022] PUT /identity/v3/projects/eb5706dcd260450b8d33d52759f16718/users/08bdaaeab19c4d3da5b39efea9d80d08/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:04:57.931757 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69274188-230b-47ef-a938-ae0359093343 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:57.942203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69274188-230b-47ef-a938-ae0359093343 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:58.005116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dea26e-da5a-434a-b1f2-20d3b5e65e54 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09e3edbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:58.005720 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea26e-da5a-434a-b1f2-20d3b5e65e54 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:58.006010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea26e-da5a-434a-b1f2-20d3b5e65e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:58.006290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea26e-da5a-434a-b1f2-20d3b5e65e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:58.006982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dea26e-da5a-434a-b1f2-20d3b5e65e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:58.009313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dea26e-da5a-434a-b1f2-20d3b5e65e54 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:58.018955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1079/2182] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:04:58.023067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718c0e0-ede4-4c06-b017-915db0ff6dd9 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:58.033963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718c0e0-ede4-4c06-b017-915db0ff6dd9 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:58.038415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49a92d-0e7c-463e-8973-e1310558fa7d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09ebb9f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:58.039276 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49a92d-0e7c-463e-8973-e1310558fa7d admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:58.039568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49a92d-0e7c-463e-8973-e1310558fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:58.039965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49a92d-0e7c-463e-8973-e1310558fa7d admin admin] PATH_INFO: `/v3/projects/eb5706dcd260450b8d33d52759f16718/users/08bdaaeab19c4d3da5b39efea9d80d08/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:58.041935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49a92d-0e7c-463e-8973-e1310558fa7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5706dcd260450b8d33d52759f16718, user_id=08bdaaeab19c4d3da5b39efea9d80d08, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:58.044836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49a92d-0e7c-463e-8973-e1310558fa7d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:58.055042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1104/2183] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:04:58 2022] PUT /identity/v3/projects/eb5706dcd260450b8d33d52759f16718/users/08bdaaeab19c4d3da5b39efea9d80d08/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:04:58.066940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb3770-2b24-4eb1-a300-d1e23c14c469 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:58.067509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb3770-2b24-4eb1-a300-d1e23c14c469 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:58.067762 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb3770-2b24-4eb1-a300-d1e23c14c469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:58.104994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-66cb3770-2b24-4eb1-a300-d1e23c14c469 None None] MFA Rules not processed for user `08bdaaeab19c4d3da5b39efea9d80d08`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:04:58.106119 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-66cb3770-2b24-4eb1-a300-d1e23c14c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:58.189886 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1080/2184] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:04:58 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:04:58.201795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49a92d-0e7c-463e-8973-e1310558fa7d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:04:58.203439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9b49a92d-0e7c-463e-8973-e1310558fa7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:04:58.271195 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49a92d-0e7c-463e-8973-e1310558fa7d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:04:58.275315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd52eb-d68e-4f0a-87e6-a84338be43ea service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09ddad280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:04:58.275895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd52eb-d68e-4f0a-87e6-a84338be43ea service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:04:58.276189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd52eb-d68e-4f0a-87e6-a84338be43ea service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:04:58.276478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd52eb-d68e-4f0a-87e6-a84338be43ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:04:58.285582 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd52eb-d68e-4f0a-87e6-a84338be43ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:04:58.287004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd52eb-d68e-4f0a-87e6-a84338be43ea service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:04:58.297084 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1105/2185] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:04:58 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:02.194975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb3770-2b24-4eb1-a300-d1e23c14c469 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:02.271085 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb3770-2b24-4eb1-a300-d1e23c14c469 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:02.276551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09e94cdc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:02.277579 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:02.277865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:02.278151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] PATH_INFO: `/v3/users/92aa4cb2203d49688040e6a5d9d918b4` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:02.279389 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=92aa4cb2203d49688040e6a5d9d918b4)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:02.281309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:02.621001 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92aa4cb2203d49688040e6a5d9d918b4'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:02.747544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92aa4cb2203d49688040e6a5d9d918b4'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:02.765824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92aa4cb2203d49688040e6a5d9d918b4'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:02.766759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92aa4cb2203d49688040e6a5d9d918b4'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:02.767760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92aa4cb2203d49688040e6a5d9d918b4'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:02.792259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1081/2186] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:02 2022] DELETE /identity/v3/users/92aa4cb2203d49688040e6a5d9d918b4 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:02.792463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d100c9-627f-4b88-8663-1fbee960cf4d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:02.793074 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d100c9-627f-4b88-8663-1fbee960cf4d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:02.793371 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d100c9-627f-4b88-8663-1fbee960cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:02.821530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-33d100c9-627f-4b88-8663-1fbee960cf4d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:02.823369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-33d100c9-627f-4b88-8663-1fbee960cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:02.903153 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1106/2187] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:05:02.912869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:02.918502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:03.044846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6bfd0-1480-4ec0-92a1-9499f9573ebc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:03.048940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9040b20-dc7f-4d01-a5ac-2bf09e7a43e5 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09f4807c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:03.049504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9040b20-dc7f-4d01-a5ac-2bf09e7a43e5 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:03.049787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9040b20-dc7f-4d01-a5ac-2bf09e7a43e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:03.050071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9040b20-dc7f-4d01-a5ac-2bf09e7a43e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:03.061799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9040b20-dc7f-4d01-a5ac-2bf09e7a43e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:03.063316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9040b20-dc7f-4d01-a5ac-2bf09e7a43e5 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:03.073727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1082/2188] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:03.769973 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d100c9-627f-4b88-8663-1fbee960cf4d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:03.771293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-33d100c9-627f-4b88-8663-1fbee960cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:03.792716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d100c9-627f-4b88-8663-1fbee960cf4d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:03.797644 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09e58c700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:03.798446 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:03.798738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:03.799100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] PATH_INFO: `/v3/projects/ed5d0fcfcae64fe8b5a0f6d8ced4730e` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:03.800278 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed5d0fcfcae64fe8b5a0f6d8ced4730e)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:03.802159 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:04.037270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed5d0fcfcae64fe8b5a0f6d8ced4730e', 'request_id': 'req-0700c456-5e74-4439-9d75-b35b17a9285e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:04.136207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed5d0fcfcae64fe8b5a0f6d8ced4730e', 'request_id': 'req-0700c456-5e74-4439-9d75-b35b17a9285e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:04.148038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed5d0fcfcae64fe8b5a0f6d8ced4730e', 'request_id': 'req-0700c456-5e74-4439-9d75-b35b17a9285e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:04.160001 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] The token cache is being invalidate because project ed5d0fcfcae64fe8b5a0f6d8ced4730e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:04.160326 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:04.160964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:04.167510 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1107/2189] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:03 2022] DELETE /identity/v3/projects/ed5d0fcfcae64fe8b5a0f6d8ced4730e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:04.168976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9040b20-dc7f-4d01-a5ac-2bf09e7a43e5 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:04.179889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9040b20-dc7f-4d01-a5ac-2bf09e7a43e5 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:04.255366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d012d-8f13-49f0-b76f-8af820edd901 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09de1e7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:04.256340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d012d-8f13-49f0-b76f-8af820edd901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:04.256874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d012d-8f13-49f0-b76f-8af820edd901 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:04.257163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d012d-8f13-49f0-b76f-8af820edd901 admin admin] PATH_INFO: `/v3/users/08bdaaeab19c4d3da5b39efea9d80d08` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:04.258971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d012d-8f13-49f0-b76f-8af820edd901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08bdaaeab19c4d3da5b39efea9d80d08)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:04.261040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d012d-8f13-49f0-b76f-8af820edd901 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:04.507216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-805d012d-8f13-49f0-b76f-8af820edd901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08bdaaeab19c4d3da5b39efea9d80d08'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:04.606449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-805d012d-8f13-49f0-b76f-8af820edd901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08bdaaeab19c4d3da5b39efea9d80d08'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:04.620595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-805d012d-8f13-49f0-b76f-8af820edd901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08bdaaeab19c4d3da5b39efea9d80d08'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:04.621338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-805d012d-8f13-49f0-b76f-8af820edd901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08bdaaeab19c4d3da5b39efea9d80d08'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:04.621946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-805d012d-8f13-49f0-b76f-8af820edd901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08bdaaeab19c4d3da5b39efea9d80d08'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:04.635469 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1083/2190] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:04 2022] DELETE /identity/v3/users/08bdaaeab19c4d3da5b39efea9d80d08 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:05.170215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:05.171863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:05.186143 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700c456-5e74-4439-9d75-b35b17a9285e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:05.251231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2UCvCylQQEWarnAPHdxEbA, audit_chain_id=['2UCvCylQQEWarnAPHdxEbA']) at 0x7fe09ded1070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:05.252058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:05.252342 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:05.252619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] PATH_INFO: `/v3/projects/eb5706dcd260450b8d33d52759f16718` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:05.253719 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb5706dcd260450b8d33d52759f16718)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:05.255626 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:05.381825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5706dcd260450b8d33d52759f16718', 'request_id': 'req-c528cfb0-590b-4f6d-a270-b821f4553400'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:05.452210 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5706dcd260450b8d33d52759f16718', 'request_id': 'req-c528cfb0-590b-4f6d-a270-b821f4553400'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:05.464206 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5706dcd260450b8d33d52759f16718', 'request_id': 'req-c528cfb0-590b-4f6d-a270-b821f4553400'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:05.473887 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] The token cache is being invalidate because project eb5706dcd260450b8d33d52759f16718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:05.474168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:05.474798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c528cfb0-590b-4f6d-a270-b821f4553400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:05.476263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1108/2191] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:05 2022] DELETE /identity/v3/projects/eb5706dcd260450b8d33d52759f16718 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:05:05.481205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b3682-42a3-4169-9f47-c4a430038b6a None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:05.481683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b3682-42a3-4169-9f47-c4a430038b6a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:05.481786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b3682-42a3-4169-9f47-c4a430038b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:05.505308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-4f9b3682-42a3-4169-9f47-c4a430038b6a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:05.506473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4f9b3682-42a3-4169-9f47-c4a430038b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:05.581515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1084/2192] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:05.594442 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aabb7-acba-4a21-82a0-36a0b9d73efa None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:05.594786 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aabb7-acba-4a21-82a0-36a0b9d73efa None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:05.595078 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aabb7-acba-4a21-82a0-36a0b9d73efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:05.625567 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f49aabb7-acba-4a21-82a0-36a0b9d73efa None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:05.626778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f49aabb7-acba-4a21-82a0-36a0b9d73efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:05.636116 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1109/2193] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:05.640685 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b3682-42a3-4169-9f47-c4a430038b6a None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:05.653897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b3682-42a3-4169-9f47-c4a430038b6a None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:05.658438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a7213-6489-4d33-bfa1-e7944397311d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09e8faa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:05.659032 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a7213-6489-4d33-bfa1-e7944397311d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:05.659349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a7213-6489-4d33-bfa1-e7944397311d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:05.659662 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a7213-6489-4d33-bfa1-e7944397311d admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:05.660429 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a7213-6489-4d33-bfa1-e7944397311d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:05:05.660733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a7213-6489-4d33-bfa1-e7944397311d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:05.662348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a7213-6489-4d33-bfa1-e7944397311d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:05.676339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1085/2194] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:05:05.680743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aabb7-acba-4a21-82a0-36a0b9d73efa None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:05.689562 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aabb7-acba-4a21-82a0-36a0b9d73efa None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:05.694182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763609-d526-4300-b415-ed4ba63ce4f0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09de0e820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:05.694767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763609-d526-4300-b415-ed4ba63ce4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:05.695054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763609-d526-4300-b415-ed4ba63ce4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:05.695364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763609-d526-4300-b415-ed4ba63ce4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:05.696094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29763609-d526-4300-b415-ed4ba63ce4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:05.697948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29763609-d526-4300-b415-ed4ba63ce4f0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:05.792410 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1110/2195] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:05 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:05:05.796582 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a7213-6489-4d33-bfa1-e7944397311d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:05.807519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a7213-6489-4d33-bfa1-e7944397311d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:05.877758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bd4ee-2038-4f8e-8855-bebc68b0fb7f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09e3e21c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:05.878383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bd4ee-2038-4f8e-8855-bebc68b0fb7f admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:05.878669 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bd4ee-2038-4f8e-8855-bebc68b0fb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:05.878958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bd4ee-2038-4f8e-8855-bebc68b0fb7f admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:05.879638 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bd4ee-2038-4f8e-8855-bebc68b0fb7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:05.881637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bd4ee-2038-4f8e-8855-bebc68b0fb7f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:06.018528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1086/2196] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:05 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:06.025495 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763609-d526-4300-b415-ed4ba63ce4f0 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:06.036993 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763609-d526-4300-b415-ed4ba63ce4f0 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:06.042700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f9d2e-422a-4b17-8fc4-f195e94937b4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09de9dc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:06.043337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f9d2e-422a-4b17-8fc4-f195e94937b4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:06.043630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f9d2e-422a-4b17-8fc4-f195e94937b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:06.043914 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f9d2e-422a-4b17-8fc4-f195e94937b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:06.044621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f9d2e-422a-4b17-8fc4-f195e94937b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:06.046490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f9d2e-422a-4b17-8fc4-f195e94937b4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:06.058816 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1111/2197] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:06.062845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bd4ee-2038-4f8e-8855-bebc68b0fb7f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:06.073757 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bd4ee-2038-4f8e-8855-bebc68b0fb7f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:06.078236 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d1c5d-6079-403f-9a28-8711a1a32017 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09e1df370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:06.078826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d1c5d-6079-403f-9a28-8711a1a32017 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:06.079131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d1c5d-6079-403f-9a28-8711a1a32017 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:06.079493 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d1c5d-6079-403f-9a28-8711a1a32017 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:06.080188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d1c5d-6079-403f-9a28-8711a1a32017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:06.081796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d1c5d-6079-403f-9a28-8711a1a32017 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:06.092603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1087/2198] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:06.096812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f9d2e-422a-4b17-8fc4-f195e94937b4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:06.107044 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f9d2e-422a-4b17-8fc4-f195e94937b4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:06.111390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472feda3-db82-406e-bcb9-17178fa42f64 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09de8af40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:06.112209 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472feda3-db82-406e-bcb9-17178fa42f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:06.112502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472feda3-db82-406e-bcb9-17178fa42f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:06.112816 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472feda3-db82-406e-bcb9-17178fa42f64 admin admin] PATH_INFO: `/v3/projects/0e83bce6bf634b2a9dcbfc4ed4652293/users/87b698485906432494c9e61bc58176c4/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:06.132619 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472feda3-db82-406e-bcb9-17178fa42f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e83bce6bf634b2a9dcbfc4ed4652293, user_id=87b698485906432494c9e61bc58176c4, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:06.136413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472feda3-db82-406e-bcb9-17178fa42f64 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:06.247027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1112/2199] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:06 2022] PUT /identity/v3/projects/0e83bce6bf634b2a9dcbfc4ed4652293/users/87b698485906432494c9e61bc58176c4/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:06.257006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7ab14-8681-4e78-9df8-5000897c1104 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:06.257306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7ab14-8681-4e78-9df8-5000897c1104 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:06.257594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7ab14-8681-4e78-9df8-5000897c1104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:06.295262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-3de7ab14-8681-4e78-9df8-5000897c1104 None None] MFA Rules not processed for user `87b698485906432494c9e61bc58176c4`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:06.296422 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3de7ab14-8681-4e78-9df8-5000897c1104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:06.366782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1088/2200] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:06 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:06.371695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472feda3-db82-406e-bcb9-17178fa42f64 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:06.438584 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472feda3-db82-406e-bcb9-17178fa42f64 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:06.442913 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842dc45-1f2d-423a-8ac9-1bfb3b3d52f1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09df3b9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:06.443527 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842dc45-1f2d-423a-8ac9-1bfb3b3d52f1 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:06.443817 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842dc45-1f2d-423a-8ac9-1bfb3b3d52f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:06.444097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842dc45-1f2d-423a-8ac9-1bfb3b3d52f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:06.444735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842dc45-1f2d-423a-8ac9-1bfb3b3d52f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:06.447277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842dc45-1f2d-423a-8ac9-1bfb3b3d52f1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:06.571348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1113/2201] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:06 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:06.575077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7ab14-8681-4e78-9df8-5000897c1104 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:06.585464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7ab14-8681-4e78-9df8-5000897c1104 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:06.646790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbb9cb-783f-44c4-8ebe-1db3df76b7ad admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09e8faa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:06.647451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbb9cb-783f-44c4-8ebe-1db3df76b7ad admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:06.647740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbb9cb-783f-44c4-8ebe-1db3df76b7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:06.648023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbb9cb-783f-44c4-8ebe-1db3df76b7ad admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:06.648659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbb9cb-783f-44c4-8ebe-1db3df76b7ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:06.650653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbb9cb-783f-44c4-8ebe-1db3df76b7ad admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:06.756069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1089/2202] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:06 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:06.759648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842dc45-1f2d-423a-8ac9-1bfb3b3d52f1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:06.769764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842dc45-1f2d-423a-8ac9-1bfb3b3d52f1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:06.774186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efee78-0877-4358-b714-8e8506ee289d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09e105e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:06.774778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efee78-0877-4358-b714-8e8506ee289d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:06.775174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efee78-0877-4358-b714-8e8506ee289d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:06.775488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efee78-0877-4358-b714-8e8506ee289d admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:06.776179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efee78-0877-4358-b714-8e8506ee289d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:06.777794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efee78-0877-4358-b714-8e8506ee289d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:06.788366 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1114/2203] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:05:06.793735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbb9cb-783f-44c4-8ebe-1db3df76b7ad admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:06.803382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbb9cb-783f-44c4-8ebe-1db3df76b7ad admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:06.808419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c5c4d-d693-45ac-bae8-ff9a475b7955 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09de8e2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:06.809233 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c5c4d-d693-45ac-bae8-ff9a475b7955 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:06.809519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c5c4d-d693-45ac-bae8-ff9a475b7955 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:06.809798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c5c4d-d693-45ac-bae8-ff9a475b7955 admin admin] PATH_INFO: `/v3/projects/83b408d942774ab8ae6a5dcdf1d5a58d/users/c6adebd3819b4764a76cd01b44bcba53/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:06.829326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c5c4d-d693-45ac-bae8-ff9a475b7955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b408d942774ab8ae6a5dcdf1d5a58d, user_id=c6adebd3819b4764a76cd01b44bcba53, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:06.831944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c5c4d-d693-45ac-bae8-ff9a475b7955 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:06.938069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1090/2204] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:06 2022] PUT /identity/v3/projects/83b408d942774ab8ae6a5dcdf1d5a58d/users/c6adebd3819b4764a76cd01b44bcba53/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:06.942163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efee78-0877-4358-b714-8e8506ee289d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:06.951925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efee78-0877-4358-b714-8e8506ee289d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:07.018590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4124f4d-0d90-49c8-84c3-0d44045e619a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09dde6d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:07.019392 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4124f4d-0d90-49c8-84c3-0d44045e619a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:07.019693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4124f4d-0d90-49c8-84c3-0d44045e619a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:07.019984 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4124f4d-0d90-49c8-84c3-0d44045e619a admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:07.020812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4124f4d-0d90-49c8-84c3-0d44045e619a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:07.022401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4124f4d-0d90-49c8-84c3-0d44045e619a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:07.033681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1115/2205] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:07.037650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c5c4d-d693-45ac-bae8-ff9a475b7955 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:07.048895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c5c4d-d693-45ac-bae8-ff9a475b7955 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:07.053455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3933064-4af3-43ce-ad07-01f6419d4826 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09e47e040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:07.054279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3933064-4af3-43ce-ad07-01f6419d4826 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:07.054566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3933064-4af3-43ce-ad07-01f6419d4826 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:07.054846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3933064-4af3-43ce-ad07-01f6419d4826 admin admin] PATH_INFO: `/v3/projects/83b408d942774ab8ae6a5dcdf1d5a58d/users/c6adebd3819b4764a76cd01b44bcba53/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:07.056793 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3933064-4af3-43ce-ad07-01f6419d4826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b408d942774ab8ae6a5dcdf1d5a58d, user_id=c6adebd3819b4764a76cd01b44bcba53, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:07.059518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3933064-4af3-43ce-ad07-01f6419d4826 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:07.069796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1091/2206] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:07 2022] PUT /identity/v3/projects/83b408d942774ab8ae6a5dcdf1d5a58d/users/c6adebd3819b4764a76cd01b44bcba53/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:07.080876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94392fd9-4e12-41f2-8d3f-5e7f3db537cb None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:07.081118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94392fd9-4e12-41f2-8d3f-5e7f3db537cb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:07.081405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94392fd9-4e12-41f2-8d3f-5e7f3db537cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:07.119699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-94392fd9-4e12-41f2-8d3f-5e7f3db537cb None None] MFA Rules not processed for user `c6adebd3819b4764a76cd01b44bcba53`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:07.120884 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-94392fd9-4e12-41f2-8d3f-5e7f3db537cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:07.197796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1116/2207] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:07 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:07.207042 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3933064-4af3-43ce-ad07-01f6419d4826 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:07.208794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b3933064-4af3-43ce-ad07-01f6419d4826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:07.272864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3933064-4af3-43ce-ad07-01f6419d4826 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:07.277030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336a46c-9d85-45fd-b751-07d6203222f9 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09de6d580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:07.277605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336a46c-9d85-45fd-b751-07d6203222f9 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:07.277893 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336a46c-9d85-45fd-b751-07d6203222f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:07.278175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336a46c-9d85-45fd-b751-07d6203222f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:07.286949 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336a46c-9d85-45fd-b751-07d6203222f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:07.288409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336a46c-9d85-45fd-b751-07d6203222f9 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:07.298297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1092/2208] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:07 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:08.038651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94392fd9-4e12-41f2-8d3f-5e7f3db537cb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:08.110219 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94392fd9-4e12-41f2-8d3f-5e7f3db537cb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:08.114504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09dd906a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:08.115356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:08.115666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:08.115948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] PATH_INFO: `/v3/users/87b698485906432494c9e61bc58176c4` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:08.121625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b698485906432494c9e61bc58176c4)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:08.121625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:08.300145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b698485906432494c9e61bc58176c4'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:08.312705 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b698485906432494c9e61bc58176c4'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:08.313469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b698485906432494c9e61bc58176c4'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:08.314089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b698485906432494c9e61bc58176c4'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:08.383103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b698485906432494c9e61bc58176c4'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:08.396720 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1117/2209] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:08 2022] DELETE /identity/v3/users/87b698485906432494c9e61bc58176c4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:08.401860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42237b-40e6-49d2-98c1-341c00c61cb9 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:08.402342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42237b-40e6-49d2-98c1-341c00c61cb9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:08.402587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42237b-40e6-49d2-98c1-341c00c61cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:08.426493 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-4d42237b-40e6-49d2-98c1-341c00c61cb9 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:08.427690 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4d42237b-40e6-49d2-98c1-341c00c61cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:08.494754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1093/2210] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:08.504926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:08.506300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:08.570009 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71c65c-7018-4008-b9ef-40f6fda3b909 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:08.573652 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250f419-cd7e-4f39-964b-457f1f400ebf service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e212a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:08.574234 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250f419-cd7e-4f39-964b-457f1f400ebf service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:08.574524 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250f419-cd7e-4f39-964b-457f1f400ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:08.574809 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250f419-cd7e-4f39-964b-457f1f400ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:08.583636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250f419-cd7e-4f39-964b-457f1f400ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:08.585058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250f419-cd7e-4f39-964b-457f1f400ebf service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:08.594662 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1118/2211] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:09.091075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42237b-40e6-49d2-98c1-341c00c61cb9 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:09.095794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4d42237b-40e6-49d2-98c1-341c00c61cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:09.104697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42237b-40e6-49d2-98c1-341c00c61cb9 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:09.109708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09e8faa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:09.110492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:09.110776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:09.111051 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] PATH_INFO: `/v3/projects/0e83bce6bf634b2a9dcbfc4ed4652293` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:09.112167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e83bce6bf634b2a9dcbfc4ed4652293)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:09.114085 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:09.260728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e83bce6bf634b2a9dcbfc4ed4652293', 'request_id': 'req-fea4a502-f52a-4170-a602-2603a0172d40'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:09.271932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e83bce6bf634b2a9dcbfc4ed4652293', 'request_id': 'req-fea4a502-f52a-4170-a602-2603a0172d40'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:09.349042 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e83bce6bf634b2a9dcbfc4ed4652293', 'request_id': 'req-fea4a502-f52a-4170-a602-2603a0172d40'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:09.359188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] The token cache is being invalidate because project 0e83bce6bf634b2a9dcbfc4ed4652293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:09.359588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:09.360207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:09.361759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1094/2212] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:09 2022] DELETE /identity/v3/projects/0e83bce6bf634b2a9dcbfc4ed4652293 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:09.365727 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250f419-cd7e-4f39-964b-457f1f400ebf service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:09.375466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250f419-cd7e-4f39-964b-457f1f400ebf service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:09.437434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cbbc1-aa7e-41eb-a30d-bb09a001e9c7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09de984c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:09.438238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cbbc1-aa7e-41eb-a30d-bb09a001e9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:09.438537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cbbc1-aa7e-41eb-a30d-bb09a001e9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:09.438824 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cbbc1-aa7e-41eb-a30d-bb09a001e9c7 admin admin] PATH_INFO: `/v3/users/c6adebd3819b4764a76cd01b44bcba53` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:09.440322 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cbbc1-aa7e-41eb-a30d-bb09a001e9c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6adebd3819b4764a76cd01b44bcba53)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:09.442221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cbbc1-aa7e-41eb-a30d-bb09a001e9c7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:09.652374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-936cbbc1-aa7e-41eb-a30d-bb09a001e9c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6adebd3819b4764a76cd01b44bcba53'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:09.665266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-936cbbc1-aa7e-41eb-a30d-bb09a001e9c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6adebd3819b4764a76cd01b44bcba53'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:09.665962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-936cbbc1-aa7e-41eb-a30d-bb09a001e9c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6adebd3819b4764a76cd01b44bcba53'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:09.666556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-936cbbc1-aa7e-41eb-a30d-bb09a001e9c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6adebd3819b4764a76cd01b44bcba53'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:09.737139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-936cbbc1-aa7e-41eb-a30d-bb09a001e9c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6adebd3819b4764a76cd01b44bcba53'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:09.751038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1119/2213] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:09 2022] DELETE /identity/v3/users/c6adebd3819b4764a76cd01b44bcba53 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:10.338315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:10.339840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:10.354154 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4a502-f52a-4170-a602-2603a0172d40 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:10.420428 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BExzg01zQdSF5azjf83krA, audit_chain_id=['BExzg01zQdSF5azjf83krA']) at 0x7fe09df26220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:10.421220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:10.421509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:10.421792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] PATH_INFO: `/v3/projects/83b408d942774ab8ae6a5dcdf1d5a58d` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:10.422890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b408d942774ab8ae6a5dcdf1d5a58d)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:10.424824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:10.572303 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b408d942774ab8ae6a5dcdf1d5a58d', 'request_id': 'req-b8abf995-04a7-43a0-992d-56e95e5bdbbe'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:10.584111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b408d942774ab8ae6a5dcdf1d5a58d', 'request_id': 'req-b8abf995-04a7-43a0-992d-56e95e5bdbbe'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:10.678836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b408d942774ab8ae6a5dcdf1d5a58d', 'request_id': 'req-b8abf995-04a7-43a0-992d-56e95e5bdbbe'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:10.690644 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] The token cache is being invalidate because project 83b408d942774ab8ae6a5dcdf1d5a58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:10.691036 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:10.691741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b8abf995-04a7-43a0-992d-56e95e5bdbbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:10.693258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1095/2214] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:10 2022] DELETE /identity/v3/projects/83b408d942774ab8ae6a5dcdf1d5a58d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:10.698254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d976c43-8c92-4d88-af48-a6863aa88c17 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:10.698716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d976c43-8c92-4d88-af48-a6863aa88c17 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:10.698818 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d976c43-8c92-4d88-af48-a6863aa88c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:10.721405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4d976c43-8c92-4d88-af48-a6863aa88c17 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:10.722567 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4d976c43-8c92-4d88-af48-a6863aa88c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:10.792886 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1120/2215] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:10.800680 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d9be4-d2b7-42e8-9db6-af4acd0ea41f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:10.808673 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d9be4-d2b7-42e8-9db6-af4acd0ea41f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:10.808673 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d9be4-d2b7-42e8-9db6-af4acd0ea41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:10.825104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-ac3d9be4-d2b7-42e8-9db6-af4acd0ea41f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:10.826362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ac3d9be4-d2b7-42e8-9db6-af4acd0ea41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:10.834293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1096/2216] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:10.839098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d976c43-8c92-4d88-af48-a6863aa88c17 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:10.848574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d976c43-8c92-4d88-af48-a6863aa88c17 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:10.854370 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb156-948c-4a2a-88a6-4546feb5cb83 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Rb0bo4YvT9epIFgp5rFG0g, audit_chain_id=['Rb0bo4YvT9epIFgp5rFG0g']) at 0x7fe09df24b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:10.854985 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb156-948c-4a2a-88a6-4546feb5cb83 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:10.855310 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb156-948c-4a2a-88a6-4546feb5cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:10.855597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb156-948c-4a2a-88a6-4546feb5cb83 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:10.856291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb156-948c-4a2a-88a6-4546feb5cb83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:05:10.856592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb156-948c-4a2a-88a6-4546feb5cb83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:10.858467 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb156-948c-4a2a-88a6-4546feb5cb83 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:10.872290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1121/2217] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:05:10.876540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d9be4-d2b7-42e8-9db6-af4acd0ea41f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:10.886869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d9be4-d2b7-42e8-9db6-af4acd0ea41f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:10.892605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167317e7-9463-4378-9593-b1c861363957 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Rb0bo4YvT9epIFgp5rFG0g, audit_chain_id=['Rb0bo4YvT9epIFgp5rFG0g']) at 0x7fe09e94cdc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:10.894190 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167317e7-9463-4378-9593-b1c861363957 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:10.894190 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167317e7-9463-4378-9593-b1c861363957 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:10.894190 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167317e7-9463-4378-9593-b1c861363957 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:10.894985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167317e7-9463-4378-9593-b1c861363957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:10.896947 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167317e7-9463-4378-9593-b1c861363957 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:11.088746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1097/2218] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:10 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:11.092771 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb156-948c-4a2a-88a6-4546feb5cb83 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:11.103003 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb156-948c-4a2a-88a6-4546feb5cb83 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:11.292162 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01910162-616d-441b-aa06-c2362c96ac36 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Rb0bo4YvT9epIFgp5rFG0g, audit_chain_id=['Rb0bo4YvT9epIFgp5rFG0g']) at 0x7fe09e970ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:11.292762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910162-616d-441b-aa06-c2362c96ac36 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:11.293048 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910162-616d-441b-aa06-c2362c96ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:11.293325 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910162-616d-441b-aa06-c2362c96ac36 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:11.293962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01910162-616d-441b-aa06-c2362c96ac36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:11.295896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01910162-616d-441b-aa06-c2362c96ac36 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:11.348827 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d97a5-cac5-4a95-929f-8c1cb55d0b3b None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:11.349358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d97a5-cac5-4a95-929f-8c1cb55d0b3b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:11.349477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d97a5-cac5-4a95-929f-8c1cb55d0b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:11.390514 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1122/2219] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:11 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:05:11.394273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01910162-616d-441b-aa06-c2362c96ac36 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:11.404472 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01910162-616d-441b-aa06-c2362c96ac36 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:11.409157 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485f655-4389-49f1-81fd-ad53a7f84bef admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Rb0bo4YvT9epIFgp5rFG0g, audit_chain_id=['Rb0bo4YvT9epIFgp5rFG0g']) at 0x7fe09ddaa460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:11.409777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485f655-4389-49f1-81fd-ad53a7f84bef admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:11.410485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485f655-4389-49f1-81fd-ad53a7f84bef admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:11.410485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485f655-4389-49f1-81fd-ad53a7f84bef admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:11.411303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485f655-4389-49f1-81fd-ad53a7f84bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:11.412898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485f655-4389-49f1-81fd-ad53a7f84bef admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:11.422823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a09d97a5-cac5-4a95-929f-8c1cb55d0b3b None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:11.423186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1123/2220] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:11.424024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a09d97a5-cac5-4a95-929f-8c1cb55d0b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:11.426999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485f655-4389-49f1-81fd-ad53a7f84bef admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:11.436812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485f655-4389-49f1-81fd-ad53a7f84bef admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:11.441034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae234a-cc69-4c9e-91a6-cbf38d065f70 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Rb0bo4YvT9epIFgp5rFG0g, audit_chain_id=['Rb0bo4YvT9epIFgp5rFG0g']) at 0x7fe09ddaaf10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:11.441620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae234a-cc69-4c9e-91a6-cbf38d065f70 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:11.441904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae234a-cc69-4c9e-91a6-cbf38d065f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:11.442183 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae234a-cc69-4c9e-91a6-cbf38d065f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:11.442867 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae234a-cc69-4c9e-91a6-cbf38d065f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:11.444461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae234a-cc69-4c9e-91a6-cbf38d065f70 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:11.455756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1124/2221] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:11.459726 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae234a-cc69-4c9e-91a6-cbf38d065f70 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:11.468894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae234a-cc69-4c9e-91a6-cbf38d065f70 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:11.473226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d5460-78ae-45bd-8564-d1367f2a39b6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Rb0bo4YvT9epIFgp5rFG0g, audit_chain_id=['Rb0bo4YvT9epIFgp5rFG0g']) at 0x7fe09dd901f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:11.474012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d5460-78ae-45bd-8564-d1367f2a39b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:11.474296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d5460-78ae-45bd-8564-d1367f2a39b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:11.474591 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d5460-78ae-45bd-8564-d1367f2a39b6 admin admin] PATH_INFO: `/v3/projects/0fd84922b8aa4f2189bc6a3af7bba6c7/users/b5d512bbe93b480d87ac35aa365f38a5/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:11.495554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d5460-78ae-45bd-8564-d1367f2a39b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd84922b8aa4f2189bc6a3af7bba6c7, user_id=b5d512bbe93b480d87ac35aa365f38a5, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:11.498182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d5460-78ae-45bd-8564-d1367f2a39b6 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:11.505370 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1098/2222] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:05:11 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:11.546680 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d97a5-cac5-4a95-929f-8c1cb55d0b3b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:11.548044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a09d97a5-cac5-4a95-929f-8c1cb55d0b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:11.622777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1125/2223] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:11 2022] PUT /identity/v3/projects/0fd84922b8aa4f2189bc6a3af7bba6c7/users/b5d512bbe93b480d87ac35aa365f38a5/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:05:11.632578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085b25-4fc2-4a19-957f-a17a7f4b288d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:11.636632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085b25-4fc2-4a19-957f-a17a7f4b288d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:11.636632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085b25-4fc2-4a19-957f-a17a7f4b288d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:11.651971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d97a5-cac5-4a95-929f-8c1cb55d0b3b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:11.669846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-ad085b25-4fc2-4a19-957f-a17a7f4b288d None None] MFA Rules not processed for user `b5d512bbe93b480d87ac35aa365f38a5`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:11.671014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ad085b25-4fc2-4a19-957f-a17a7f4b288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:11.720065 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ed3c1-df7d-4683-9d8d-21d3382780ec service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e1622b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:11.720651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ed3c1-df7d-4683-9d8d-21d3382780ec service swift] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:11.720942 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ed3c1-df7d-4683-9d8d-21d3382780ec service swift] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:11.721224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ed3c1-df7d-4683-9d8d-21d3382780ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:11.743719 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1126/2224] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:11 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:05:11.753994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085b25-4fc2-4a19-957f-a17a7f4b288d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:11.755407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ad085b25-4fc2-4a19-957f-a17a7f4b288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:11.784888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ed3c1-df7d-4683-9d8d-21d3382780ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:11.786726 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ed3c1-df7d-4683-9d8d-21d3382780ec service swift] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:11.795486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1099/2225] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:05:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 28 19:05:11.822038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085b25-4fc2-4a19-957f-a17a7f4b288d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:11.825663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286e38f-9cec-4545-a69d-e2c9f3465f3c service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09eafdac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:11.826235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e38f-9cec-4545-a69d-e2c9f3465f3c service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:11.826522 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e38f-9cec-4545-a69d-e2c9f3465f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:11.826809 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e38f-9cec-4545-a69d-e2c9f3465f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:11.836491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286e38f-9cec-4545-a69d-e2c9f3465f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:11.838091 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286e38f-9cec-4545-a69d-e2c9f3465f3c service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:11.847518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1127/2226] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:11 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:05:11.873085 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ed3c1-df7d-4683-9d8d-21d3382780ec service swift] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:12.004111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ed3c1-df7d-4683-9d8d-21d3382780ec service swift] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:12.009944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Rb0bo4YvT9epIFgp5rFG0g, audit_chain_id=['Rb0bo4YvT9epIFgp5rFG0g']) at 0x7fe09e8dfaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:12.010758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:12.011047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:12.011373 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] PATH_INFO: `/v3/users/b5d512bbe93b480d87ac35aa365f38a5` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:12.012862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d512bbe93b480d87ac35aa365f38a5)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:12.015211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:12.295286 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d512bbe93b480d87ac35aa365f38a5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:12.368073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d512bbe93b480d87ac35aa365f38a5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:12.385743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d512bbe93b480d87ac35aa365f38a5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:12.386442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d512bbe93b480d87ac35aa365f38a5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:12.389348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d512bbe93b480d87ac35aa365f38a5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:12.410274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1100/2227] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:11 2022] DELETE /identity/v3/users/b5d512bbe93b480d87ac35aa365f38a5 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:12.415781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df4821-9375-4bca-93be-b53c4b0f7654 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:12.416077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df4821-9375-4bca-93be-b53c4b0f7654 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:12.416339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df4821-9375-4bca-93be-b53c4b0f7654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:12.444651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-04df4821-9375-4bca-93be-b53c4b0f7654 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:12.446611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-04df4821-9375-4bca-93be-b53c4b0f7654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:12.521819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1128/2228] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:12.534286 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:12.535943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:12.761312 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4d6af-dc0b-403f-9d90-1bfd35912d3d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:12.765034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81adfe3-7ae9-48a2-b272-c5265f3372d6 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e3eb550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:12.765814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81adfe3-7ae9-48a2-b272-c5265f3372d6 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:12.766300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81adfe3-7ae9-48a2-b272-c5265f3372d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:12.766756 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81adfe3-7ae9-48a2-b272-c5265f3372d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:12.777429 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81adfe3-7ae9-48a2-b272-c5265f3372d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:12.778862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81adfe3-7ae9-48a2-b272-c5265f3372d6 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:12.789352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1101/2229] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:12 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:13.672051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df4821-9375-4bca-93be-b53c4b0f7654 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:13.672051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-04df4821-9375-4bca-93be-b53c4b0f7654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:13.683795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df4821-9375-4bca-93be-b53c4b0f7654 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:13.689670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Rb0bo4YvT9epIFgp5rFG0g, audit_chain_id=['Rb0bo4YvT9epIFgp5rFG0g']) at 0x7fe09e9d1730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:13.691074 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:13.691933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:13.692394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] PATH_INFO: `/v3/projects/0fd84922b8aa4f2189bc6a3af7bba6c7` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:13.697607 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd84922b8aa4f2189bc6a3af7bba6c7)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:13.700133 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:13.985664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd84922b8aa4f2189bc6a3af7bba6c7', 'request_id': 'req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:14.136330 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd84922b8aa4f2189bc6a3af7bba6c7', 'request_id': 'req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:14.149922 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd84922b8aa4f2189bc6a3af7bba6c7', 'request_id': 'req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:14.164968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] The token cache is being invalidate because project 0fd84922b8aa4f2189bc6a3af7bba6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:14.165273 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:14.165966 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7b161c9e-79da-4a09-9f5e-aa0ff0e6499d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:14.168373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1129/2230] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:13 2022] DELETE /identity/v3/projects/0fd84922b8aa4f2189bc6a3af7bba6c7 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:05:14.173603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86ee1-e264-4692-bff8-289787d2cd3d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:14.174150 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86ee1-e264-4692-bff8-289787d2cd3d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:14.174253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86ee1-e264-4692-bff8-289787d2cd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:14.197759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-80d86ee1-e264-4692-bff8-289787d2cd3d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:14.199065 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-80d86ee1-e264-4692-bff8-289787d2cd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:14.280571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1102/2231] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:14.291036 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead125e-214e-453b-a820-22dd957fea72 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:14.291036 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead125e-214e-453b-a820-22dd957fea72 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:14.291036 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead125e-214e-453b-a820-22dd957fea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:14.317904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-0ead125e-214e-453b-a820-22dd957fea72 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:14.319154 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0ead125e-214e-453b-a820-22dd957fea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:14.334940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1130/2232] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:14.341129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d86ee1-e264-4692-bff8-289787d2cd3d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:14.354935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d86ee1-e264-4692-bff8-289787d2cd3d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:14.362014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e4e79-6941-41dd-9625-7f73e13409f0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0PgxTAGiSwyBP5hoxNZbxg, audit_chain_id=['0PgxTAGiSwyBP5hoxNZbxg']) at 0x7fe09dda4eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:14.362014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4e79-6941-41dd-9625-7f73e13409f0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:14.362014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4e79-6941-41dd-9625-7f73e13409f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:14.362014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4e79-6941-41dd-9625-7f73e13409f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:14.362544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e4e79-6941-41dd-9625-7f73e13409f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:05:14.362757 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e4e79-6941-41dd-9625-7f73e13409f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:14.364421 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e4e79-6941-41dd-9625-7f73e13409f0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:14.379363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1103/2233] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:05:14.384911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead125e-214e-453b-a820-22dd957fea72 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:14.402178 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead125e-214e-453b-a820-22dd957fea72 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:14.405699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8f361-c9c0-4b22-ae7e-9b587a08af37 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0PgxTAGiSwyBP5hoxNZbxg, audit_chain_id=['0PgxTAGiSwyBP5hoxNZbxg']) at 0x7fe09e4ff430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:14.405699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f361-c9c0-4b22-ae7e-9b587a08af37 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:14.405699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f361-c9c0-4b22-ae7e-9b587a08af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:14.405699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f361-c9c0-4b22-ae7e-9b587a08af37 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:14.406117 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8f361-c9c0-4b22-ae7e-9b587a08af37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:14.407606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8f361-c9c0-4b22-ae7e-9b587a08af37 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:14.690348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1131/2234] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:14 2022] POST /identity/v3/projects => generated 373 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:14.694601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e4e79-6941-41dd-9625-7f73e13409f0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:14.709581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e4e79-6941-41dd-9625-7f73e13409f0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:14.816253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeb003-081c-4395-8419-8d7a9605662c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0PgxTAGiSwyBP5hoxNZbxg, audit_chain_id=['0PgxTAGiSwyBP5hoxNZbxg']) at 0x7fe09e3d58b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:14.816958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeb003-081c-4395-8419-8d7a9605662c admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:14.817269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeb003-081c-4395-8419-8d7a9605662c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:14.817593 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeb003-081c-4395-8419-8d7a9605662c admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:14.818291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceeb003-081c-4395-8419-8d7a9605662c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:14.821028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceeb003-081c-4395-8419-8d7a9605662c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:15.030027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1104/2235] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:14 2022] POST /identity/v3/users => generated 287 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:15.033744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8f361-c9c0-4b22-ae7e-9b587a08af37 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:15.044487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8f361-c9c0-4b22-ae7e-9b587a08af37 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:15.050111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e902d2-b1c6-43a1-bf80-d7b12b60befd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0PgxTAGiSwyBP5hoxNZbxg, audit_chain_id=['0PgxTAGiSwyBP5hoxNZbxg']) at 0x7fe09e4ff610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:15.050727 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e902d2-b1c6-43a1-bf80-d7b12b60befd admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:15.051020 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e902d2-b1c6-43a1-bf80-d7b12b60befd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:15.051338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e902d2-b1c6-43a1-bf80-d7b12b60befd admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:15.052041 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e902d2-b1c6-43a1-bf80-d7b12b60befd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:15.053838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e902d2-b1c6-43a1-bf80-d7b12b60befd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:15.068608 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1132/2236] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:15.073408 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeb003-081c-4395-8419-8d7a9605662c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:15.084767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeb003-081c-4395-8419-8d7a9605662c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:15.090892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d47cf-958a-424d-a53f-685f0877703c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0PgxTAGiSwyBP5hoxNZbxg, audit_chain_id=['0PgxTAGiSwyBP5hoxNZbxg']) at 0x7fe09e94cd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:15.091571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d47cf-958a-424d-a53f-685f0877703c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:15.095674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d47cf-958a-424d-a53f-685f0877703c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:15.095674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d47cf-958a-424d-a53f-685f0877703c admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:15.095674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d47cf-958a-424d-a53f-685f0877703c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:15.095674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d47cf-958a-424d-a53f-685f0877703c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:15.116629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1105/2237] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:15.118149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e902d2-b1c6-43a1-bf80-d7b12b60befd admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:15.130149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e902d2-b1c6-43a1-bf80-d7b12b60befd admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:15.146379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575af72-113a-4567-a6b0-4b932605d72d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0PgxTAGiSwyBP5hoxNZbxg, audit_chain_id=['0PgxTAGiSwyBP5hoxNZbxg']) at 0x7fe09de50e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:15.147467 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575af72-113a-4567-a6b0-4b932605d72d admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:15.148379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575af72-113a-4567-a6b0-4b932605d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:15.149536 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575af72-113a-4567-a6b0-4b932605d72d admin admin] PATH_INFO: `/v3/projects/7f266cbde75e46c4982327da408bb5e2/users/12853fb61dcf4945b7182538ee49d8a6/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:15.180557 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575af72-113a-4567-a6b0-4b932605d72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f266cbde75e46c4982327da408bb5e2, user_id=12853fb61dcf4945b7182538ee49d8a6, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:15.184231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575af72-113a-4567-a6b0-4b932605d72d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:15.306570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1133/2238] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:15 2022] PUT /identity/v3/projects/7f266cbde75e46c4982327da408bb5e2/users/12853fb61dcf4945b7182538ee49d8a6/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:15.317300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32158-1443-46fd-b346-b866085751cd None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:15.317818 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32158-1443-46fd-b346-b866085751cd None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:15.317907 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32158-1443-46fd-b346-b866085751cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:15.369319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-23b32158-1443-46fd-b346-b866085751cd None None] MFA Rules not processed for user `12853fb61dcf4945b7182538ee49d8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:15.370801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-23b32158-1443-46fd-b346-b866085751cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:15.450851 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1106/2239] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:15 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:15.460497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575af72-113a-4567-a6b0-4b932605d72d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:15.464213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-5575af72-113a-4567-a6b0-4b932605d72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:15.589843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575af72-113a-4567-a6b0-4b932605d72d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:15.594695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcc41d-2234-4ad1-a49b-3834100b1a57 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e9d10a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:15.598055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc41d-2234-4ad1-a49b-3834100b1a57 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:15.598055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc41d-2234-4ad1-a49b-3834100b1a57 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:15.598055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc41d-2234-4ad1-a49b-3834100b1a57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:15.622145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcc41d-2234-4ad1-a49b-3834100b1a57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:15.624326 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcc41d-2234-4ad1-a49b-3834100b1a57 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:15.638058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1134/2240] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:15 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:15.658358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b32158-1443-46fd-b346-b866085751cd None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:15.759358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b32158-1443-46fd-b346-b866085751cd None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:15.764760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0PgxTAGiSwyBP5hoxNZbxg, audit_chain_id=['0PgxTAGiSwyBP5hoxNZbxg']) at 0x7fe09e439730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:15.765720 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:15.766031 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:15.766344 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] PATH_INFO: `/v3/users/12853fb61dcf4945b7182538ee49d8a6` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:15.767540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12853fb61dcf4945b7182538ee49d8a6)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:15.771134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:16.088427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12853fb61dcf4945b7182538ee49d8a6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:16.212976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12853fb61dcf4945b7182538ee49d8a6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:16.240347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12853fb61dcf4945b7182538ee49d8a6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:16.246695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12853fb61dcf4945b7182538ee49d8a6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:16.248221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12853fb61dcf4945b7182538ee49d8a6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:16.285525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1107/2241] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:15 2022] DELETE /identity/v3/users/12853fb61dcf4945b7182538ee49d8a6 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:16.291176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94862-e3c8-4eb5-8e32-5ae930d183a3 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:16.292219 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94862-e3c8-4eb5-8e32-5ae930d183a3 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:16.292371 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94862-e3c8-4eb5-8e32-5ae930d183a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:16.330696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-85d94862-e3c8-4eb5-8e32-5ae930d183a3 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:16.332085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-85d94862-e3c8-4eb5-8e32-5ae930d183a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:16.430789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1135/2242] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:16.451766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:16.453347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:16.563667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6cb62-ce5c-45af-bd83-ffc313868ed4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:16.588687 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96a52b-571c-49d9-b4e7-5b39ad6d159f service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e8a0670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:16.589586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96a52b-571c-49d9-b4e7-5b39ad6d159f service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:16.590053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96a52b-571c-49d9-b4e7-5b39ad6d159f service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:16.590508 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96a52b-571c-49d9-b4e7-5b39ad6d159f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:16.608133 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96a52b-571c-49d9-b4e7-5b39ad6d159f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:16.610105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96a52b-571c-49d9-b4e7-5b39ad6d159f service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:16.634047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1108/2243] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:16 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:17.493777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d94862-e3c8-4eb5-8e32-5ae930d183a3 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:17.495822 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-85d94862-e3c8-4eb5-8e32-5ae930d183a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:17.525452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d94862-e3c8-4eb5-8e32-5ae930d183a3 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:17.530593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0PgxTAGiSwyBP5hoxNZbxg, audit_chain_id=['0PgxTAGiSwyBP5hoxNZbxg']) at 0x7fe09e45d430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:17.531741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:17.532114 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:17.532623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] PATH_INFO: `/v3/projects/7f266cbde75e46c4982327da408bb5e2` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:17.534332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f266cbde75e46c4982327da408bb5e2)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:17.537111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:17.714144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f266cbde75e46c4982327da408bb5e2', 'request_id': 'req-7a9ac08d-9af9-49e3-82b2-773a06ffef40'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:17.798697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f266cbde75e46c4982327da408bb5e2', 'request_id': 'req-7a9ac08d-9af9-49e3-82b2-773a06ffef40'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:17.818435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f266cbde75e46c4982327da408bb5e2', 'request_id': 'req-7a9ac08d-9af9-49e3-82b2-773a06ffef40'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:17.842988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] The token cache is being invalidate because project 7f266cbde75e46c4982327da408bb5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:17.848559 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:17.849721 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7a9ac08d-9af9-49e3-82b2-773a06ffef40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:17.855104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1136/2244] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:17 2022] DELETE /identity/v3/projects/7f266cbde75e46c4982327da408bb5e2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:17.866504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a14f9-f9fa-4ed2-a659-6248a9277ea7 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:17.867044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a14f9-f9fa-4ed2-a659-6248a9277ea7 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:17.867044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a14f9-f9fa-4ed2-a659-6248a9277ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:17.908453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-fd2a14f9-f9fa-4ed2-a659-6248a9277ea7 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:17.910224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-fd2a14f9-f9fa-4ed2-a659-6248a9277ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:18.122608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1109/2245] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:18.130676 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd0541-00bd-460a-a0a2-f779e698a09d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:18.130988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd0541-00bd-460a-a0a2-f779e698a09d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:18.133719 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd0541-00bd-460a-a0a2-f779e698a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:18.164774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-08cd0541-00bd-460a-a0a2-f779e698a09d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:18.166211 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-08cd0541-00bd-460a-a0a2-f779e698a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:18.175262 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1137/2246] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:18.179145 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a14f9-f9fa-4ed2-a659-6248a9277ea7 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:18.192062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a14f9-f9fa-4ed2-a659-6248a9277ea7 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:18.197854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a00f6-b241-42ca-b168-f368b8ce4a33 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ssm7VzDT9edw-HueWInDg, audit_chain_id=['5ssm7VzDT9edw-HueWInDg']) at 0x7fe09e3ed850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:18.198462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a00f6-b241-42ca-b168-f368b8ce4a33 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:18.198763 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a00f6-b241-42ca-b168-f368b8ce4a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:18.199037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a00f6-b241-42ca-b168-f368b8ce4a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:18.199831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a00f6-b241-42ca-b168-f368b8ce4a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:05:18.200174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a00f6-b241-42ca-b168-f368b8ce4a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:18.202125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a00f6-b241-42ca-b168-f368b8ce4a33 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:18.221983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1110/2247] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:05:18.226465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd0541-00bd-460a-a0a2-f779e698a09d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:18.237432 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd0541-00bd-460a-a0a2-f779e698a09d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:18.242825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7e8c-5f15-4acb-b214-19784d731f33 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ssm7VzDT9edw-HueWInDg, audit_chain_id=['5ssm7VzDT9edw-HueWInDg']) at 0x7fe09e212610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:18.243460 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7e8c-5f15-4acb-b214-19784d731f33 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:18.243807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7e8c-5f15-4acb-b214-19784d731f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:18.244086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7e8c-5f15-4acb-b214-19784d731f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:18.244758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d7e8c-5f15-4acb-b214-19784d731f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:18.246689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d7e8c-5f15-4acb-b214-19784d731f33 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:18.411161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1138/2248] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:18 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:18.417454 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a00f6-b241-42ca-b168-f368b8ce4a33 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:18.429389 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a00f6-b241-42ca-b168-f368b8ce4a33 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:18.535769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b48e82-ada2-423b-bde0-4b22f0f72909 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ssm7VzDT9edw-HueWInDg, audit_chain_id=['5ssm7VzDT9edw-HueWInDg']) at 0x7fe09e3e0280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:18.536479 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48e82-ada2-423b-bde0-4b22f0f72909 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:18.536898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48e82-ada2-423b-bde0-4b22f0f72909 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:18.537017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48e82-ada2-423b-bde0-4b22f0f72909 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:18.537714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b48e82-ada2-423b-bde0-4b22f0f72909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:18.540521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b48e82-ada2-423b-bde0-4b22f0f72909 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:18.676366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1111/2249] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:18 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:05:18.680291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7e8c-5f15-4acb-b214-19784d731f33 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:18.697496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7e8c-5f15-4acb-b214-19784d731f33 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:18.712503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3194a-3d1e-4b56-a0e7-29cdc206681e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ssm7VzDT9edw-HueWInDg, audit_chain_id=['5ssm7VzDT9edw-HueWInDg']) at 0x7fe09e196fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:18.713180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3194a-3d1e-4b56-a0e7-29cdc206681e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:18.713475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3194a-3d1e-4b56-a0e7-29cdc206681e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:18.713755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3194a-3d1e-4b56-a0e7-29cdc206681e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:18.714470 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3194a-3d1e-4b56-a0e7-29cdc206681e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:18.719185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3194a-3d1e-4b56-a0e7-29cdc206681e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:18.746782 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1139/2250] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:18.751455 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b48e82-ada2-423b-bde0-4b22f0f72909 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:18.762926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b48e82-ada2-423b-bde0-4b22f0f72909 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:18.767700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369fcf8-0cce-4471-99bf-712fd3ac56b7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ssm7VzDT9edw-HueWInDg, audit_chain_id=['5ssm7VzDT9edw-HueWInDg']) at 0x7fe09df25340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:18.768300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fcf8-0cce-4471-99bf-712fd3ac56b7 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:18.768584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fcf8-0cce-4471-99bf-712fd3ac56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:18.768868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fcf8-0cce-4471-99bf-712fd3ac56b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:18.769568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369fcf8-0cce-4471-99bf-712fd3ac56b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:18.771332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369fcf8-0cce-4471-99bf-712fd3ac56b7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:18.786601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1112/2251] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:18.787795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3194a-3d1e-4b56-a0e7-29cdc206681e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:18.799523 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3194a-3d1e-4b56-a0e7-29cdc206681e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:18.808237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdfa26-006d-414c-ad21-12e340012312 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ssm7VzDT9edw-HueWInDg, audit_chain_id=['5ssm7VzDT9edw-HueWInDg']) at 0x7fe09e196730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:18.809098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdfa26-006d-414c-ad21-12e340012312 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:18.809393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdfa26-006d-414c-ad21-12e340012312 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:18.809680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdfa26-006d-414c-ad21-12e340012312 admin admin] PATH_INFO: `/v3/projects/7ac6f31da7034994a1845c66cd600b6b/users/aed9d826a114442aad8317db0baf763f/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:18.844686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdfa26-006d-414c-ad21-12e340012312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac6f31da7034994a1845c66cd600b6b, user_id=aed9d826a114442aad8317db0baf763f, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:18.847788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdfa26-006d-414c-ad21-12e340012312 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:18.957921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1140/2252] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:18 2022] PUT /identity/v3/projects/7ac6f31da7034994a1845c66cd600b6b/users/aed9d826a114442aad8317db0baf763f/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:18.971279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf08eb2-9d2f-497e-ac19-d86c25390052 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:18.971880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf08eb2-9d2f-497e-ac19-d86c25390052 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:18.971974 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf08eb2-9d2f-497e-ac19-d86c25390052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:19.099084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-5bf08eb2-9d2f-497e-ac19-d86c25390052 None None] MFA Rules not processed for user `aed9d826a114442aad8317db0baf763f`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:19.101069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5bf08eb2-9d2f-497e-ac19-d86c25390052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:19.197691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1113/2253] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:18 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:19.210900 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdfa26-006d-414c-ad21-12e340012312 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:19.212675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0ccdfa26-006d-414c-ad21-12e340012312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:19.352424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdfa26-006d-414c-ad21-12e340012312 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:19.356003 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfd4a6-9978-4062-b04e-d050c675ca75 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=IAdTf7zmRlS7ZAE69VgzOQ, audit_chain_id=['IAdTf7zmRlS7ZAE69VgzOQ']) at 0x7fe09e4ffc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e956656659004428b3aaf23ae962f001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:19.356597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfd4a6-9978-4062-b04e-d050c675ca75 service glance] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:19.356893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfd4a6-9978-4062-b04e-d050c675ca75 service glance] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:19.357180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfd4a6-9978-4062-b04e-d050c675ca75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:19.366104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfd4a6-9978-4062-b04e-d050c675ca75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:19.368313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfd4a6-9978-4062-b04e-d050c675ca75 service glance] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:19.389245 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1141/2254] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:19 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:27.863271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf08eb2-9d2f-497e-ac19-d86c25390052 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:27.866352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5bf08eb2-9d2f-497e-ac19-d86c25390052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:28.011674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf08eb2-9d2f-497e-ac19-d86c25390052 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:28.022728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b00b2-2065-4f34-8950-b46c41b38a57 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mRWjwkslTrGvKArrwz4jSA, audit_chain_id=['mRWjwkslTrGvKArrwz4jSA']) at 0x7fe09e8a0700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:28.026357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b00b2-2065-4f34-8950-b46c41b38a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:28.032230 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b00b2-2065-4f34-8950-b46c41b38a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:28.032230 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b00b2-2065-4f34-8950-b46c41b38a57 admin admin] PATH_INFO: `/v3/users/b929b39cef7546a59987075cdef32d3b` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:28.032230 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b00b2-2065-4f34-8950-b46c41b38a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b929b39cef7546a59987075cdef32d3b)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:28.034264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b00b2-2065-4f34-8950-b46c41b38a57 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:28.278143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-589b00b2-2065-4f34-8950-b46c41b38a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b929b39cef7546a59987075cdef32d3b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:28.411330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-589b00b2-2065-4f34-8950-b46c41b38a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b929b39cef7546a59987075cdef32d3b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:28.424582 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-589b00b2-2065-4f34-8950-b46c41b38a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b929b39cef7546a59987075cdef32d3b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:28.425247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-589b00b2-2065-4f34-8950-b46c41b38a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b929b39cef7546a59987075cdef32d3b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:28.425874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-589b00b2-2065-4f34-8950-b46c41b38a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b929b39cef7546a59987075cdef32d3b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:28.440474 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1114/2255] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:27 2022] DELETE /identity/v3/users/b929b39cef7546a59987075cdef32d3b => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:05:28.884569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfd4a6-9978-4062-b04e-d050c675ca75 service glance] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:28.909063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfd4a6-9978-4062-b04e-d050c675ca75 service glance] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:29.003901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mRWjwkslTrGvKArrwz4jSA, audit_chain_id=['mRWjwkslTrGvKArrwz4jSA']) at 0x7fe09e4442e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:29.004970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:29.005337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:29.005748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] PATH_INFO: `/v3/projects/e8d685b5629d4a8185474969249dbc6e` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:29.007004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d685b5629d4a8185474969249dbc6e)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:29.010192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:29.186957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d685b5629d4a8185474969249dbc6e', 'request_id': 'req-976f497f-3349-41cb-8940-0231312ab8ff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:29.251442 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d685b5629d4a8185474969249dbc6e', 'request_id': 'req-976f497f-3349-41cb-8940-0231312ab8ff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:29.265358 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d685b5629d4a8185474969249dbc6e', 'request_id': 'req-976f497f-3349-41cb-8940-0231312ab8ff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:29.278098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] The token cache is being invalidate because project e8d685b5629d4a8185474969249dbc6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:29.281243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:29.281243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-976f497f-3349-41cb-8940-0231312ab8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:29.285465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1142/2256] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:28 2022] DELETE /identity/v3/projects/e8d685b5629d4a8185474969249dbc6e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:29.286966 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868f39-b28c-407d-b5f4-f89a29d6a9cf None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:29.287505 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868f39-b28c-407d-b5f4-f89a29d6a9cf None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:29.287624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b868f39-b28c-407d-b5f4-f89a29d6a9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:29.318984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-1b868f39-b28c-407d-b5f4-f89a29d6a9cf None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:29.321300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1b868f39-b28c-407d-b5f4-f89a29d6a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:29.402305 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1115/2257] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:29.410193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cae87-07af-4426-a7f8-209b0aeaa7eb None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:29.410512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cae87-07af-4426-a7f8-209b0aeaa7eb None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:29.410800 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cae87-07af-4426-a7f8-209b0aeaa7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:29.452201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-ae4cae87-07af-4426-a7f8-209b0aeaa7eb None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:29.453751 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ae4cae87-07af-4426-a7f8-209b0aeaa7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:29.469792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1143/2258] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:29.473852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b868f39-b28c-407d-b5f4-f89a29d6a9cf None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:29.486317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b868f39-b28c-407d-b5f4-f89a29d6a9cf None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:29.494089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5dd2e-9395-4223-9e25-e18d59317af6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z9OL6l_KT2aeP4Bmm7nq2g, audit_chain_id=['Z9OL6l_KT2aeP4Bmm7nq2g']) at 0x7fe09e37f6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:29.496469 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5dd2e-9395-4223-9e25-e18d59317af6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:29.496469 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5dd2e-9395-4223-9e25-e18d59317af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:29.496469 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5dd2e-9395-4223-9e25-e18d59317af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:29.496469 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5dd2e-9395-4223-9e25-e18d59317af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:05:29.497044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5dd2e-9395-4223-9e25-e18d59317af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:29.498383 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5dd2e-9395-4223-9e25-e18d59317af6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:29.515532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1116/2259] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:05:29.520547 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cae87-07af-4426-a7f8-209b0aeaa7eb None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:29.540363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cae87-07af-4426-a7f8-209b0aeaa7eb None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:29.545302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1bbd-6365-474f-bbc8-20113f3b645f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z9OL6l_KT2aeP4Bmm7nq2g, audit_chain_id=['Z9OL6l_KT2aeP4Bmm7nq2g']) at 0x7fe09e123e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:29.545903 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1bbd-6365-474f-bbc8-20113f3b645f admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:29.546200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1bbd-6365-474f-bbc8-20113f3b645f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:29.546488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1bbd-6365-474f-bbc8-20113f3b645f admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:29.547189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d1bbd-6365-474f-bbc8-20113f3b645f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:29.549144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d1bbd-6365-474f-bbc8-20113f3b645f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:29.677726 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1144/2260] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:29 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:29.682284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5dd2e-9395-4223-9e25-e18d59317af6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:29.693682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5dd2e-9395-4223-9e25-e18d59317af6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:29.795995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97daac13-78f9-4b87-a1c2-f0ec2caf29c5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z9OL6l_KT2aeP4Bmm7nq2g, audit_chain_id=['Z9OL6l_KT2aeP4Bmm7nq2g']) at 0x7fe09e50f160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:29.797187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daac13-78f9-4b87-a1c2-f0ec2caf29c5 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:29.797803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daac13-78f9-4b87-a1c2-f0ec2caf29c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:29.798300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daac13-78f9-4b87-a1c2-f0ec2caf29c5 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:29.799387 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97daac13-78f9-4b87-a1c2-f0ec2caf29c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:29.802226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97daac13-78f9-4b87-a1c2-f0ec2caf29c5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:30.002794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1117/2261] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:29 2022] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:30.004665 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1bbd-6365-474f-bbc8-20113f3b645f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:30.018000 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1bbd-6365-474f-bbc8-20113f3b645f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:30.026067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e14b3-1115-446c-ba30-a36957198c1a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z9OL6l_KT2aeP4Bmm7nq2g, audit_chain_id=['Z9OL6l_KT2aeP4Bmm7nq2g']) at 0x7fe09e78ed30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:30.026839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e14b3-1115-446c-ba30-a36957198c1a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:30.027303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e14b3-1115-446c-ba30-a36957198c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:30.028851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e14b3-1115-446c-ba30-a36957198c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:30.029663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e14b3-1115-446c-ba30-a36957198c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:30.031500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e14b3-1115-446c-ba30-a36957198c1a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:30.043477 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1145/2262] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:30.051710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97daac13-78f9-4b87-a1c2-f0ec2caf29c5 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:30.063533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97daac13-78f9-4b87-a1c2-f0ec2caf29c5 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:30.069430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e7a02-df1f-4e29-93c6-a6be11b50640 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z9OL6l_KT2aeP4Bmm7nq2g, audit_chain_id=['Z9OL6l_KT2aeP4Bmm7nq2g']) at 0x7fe09e3f3bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:30.074969 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e7a02-df1f-4e29-93c6-a6be11b50640 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:30.075263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e7a02-df1f-4e29-93c6-a6be11b50640 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:30.075580 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e7a02-df1f-4e29-93c6-a6be11b50640 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:30.076520 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e7a02-df1f-4e29-93c6-a6be11b50640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:30.078158 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e7a02-df1f-4e29-93c6-a6be11b50640 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:30.142628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1118/2263] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:05:30.144222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e14b3-1115-446c-ba30-a36957198c1a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:30.158620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e14b3-1115-446c-ba30-a36957198c1a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:30.170916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0df27-4d56-430d-8871-43572975dea4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z9OL6l_KT2aeP4Bmm7nq2g, audit_chain_id=['Z9OL6l_KT2aeP4Bmm7nq2g']) at 0x7fe09e1ae190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:30.171858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0df27-4d56-430d-8871-43572975dea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:30.172205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0df27-4d56-430d-8871-43572975dea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:30.172585 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0df27-4d56-430d-8871-43572975dea4 admin admin] PATH_INFO: `/v3/projects/387fb70b22a849758123829d4d94880d/users/6ecfd8301fdf4badaa13540d5f2ffa9f/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:30.212594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0df27-4d56-430d-8871-43572975dea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=387fb70b22a849758123829d4d94880d, user_id=6ecfd8301fdf4badaa13540d5f2ffa9f, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:30.215938 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0df27-4d56-430d-8871-43572975dea4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:30.303537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1146/2264] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:30 2022] PUT /identity/v3/projects/387fb70b22a849758123829d4d94880d/users/6ecfd8301fdf4badaa13540d5f2ffa9f/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:30.313524 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcfc7-673e-439e-a6e6-d1cf4eff1d6b None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:30.314122 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcfc7-673e-439e-a6e6-d1cf4eff1d6b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:30.314122 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcfc7-673e-439e-a6e6-d1cf4eff1d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:30.368739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-b15bcfc7-673e-439e-a6e6-d1cf4eff1d6b None None] MFA Rules not processed for user `6ecfd8301fdf4badaa13540d5f2ffa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:30.369999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b15bcfc7-673e-439e-a6e6-d1cf4eff1d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:30.450607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1119/2265] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:30 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:30.461933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0df27-4d56-430d-8871-43572975dea4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:30.463791 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2ab0df27-4d56-430d-8871-43572975dea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:30.611569 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0df27-4d56-430d-8871-43572975dea4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:30.618602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e542a3-4277-4f8c-9e68-39933533511d service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=wTjUJdAdSkmocIsusTZBDA, audit_chain_id=['wTjUJdAdSkmocIsusTZBDA']) at 0x7fe09e78e4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:30.619654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e542a3-4277-4f8c-9e68-39933533511d service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:30.619654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e542a3-4277-4f8c-9e68-39933533511d service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:30.619891 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e542a3-4277-4f8c-9e68-39933533511d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:30.641510 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e542a3-4277-4f8c-9e68-39933533511d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:30.645387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e542a3-4277-4f8c-9e68-39933533511d service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:30.658872 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1147/2266] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:30 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:31.319355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bcfc7-673e-439e-a6e6-d1cf4eff1d6b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:31.404420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bcfc7-673e-439e-a6e6-d1cf4eff1d6b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:31.410929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z9OL6l_KT2aeP4Bmm7nq2g, audit_chain_id=['Z9OL6l_KT2aeP4Bmm7nq2g']) at 0x7fe09e439cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:31.411793 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:31.412082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:31.412361 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] PATH_INFO: `/v3/users/6ecfd8301fdf4badaa13540d5f2ffa9f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:31.413572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ecfd8301fdf4badaa13540d5f2ffa9f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:31.415703 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:31.649458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ecfd8301fdf4badaa13540d5f2ffa9f'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:31.769917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ecfd8301fdf4badaa13540d5f2ffa9f'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:31.795935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ecfd8301fdf4badaa13540d5f2ffa9f'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:31.799883 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ecfd8301fdf4badaa13540d5f2ffa9f'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:31.799883 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ecfd8301fdf4badaa13540d5f2ffa9f'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:31.819298 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1120/2267] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:31 2022] DELETE /identity/v3/users/6ecfd8301fdf4badaa13540d5f2ffa9f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:31.824753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bebbbc-901b-481d-bc32-b6892da989c5 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:31.828620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bebbbc-901b-481d-bc32-b6892da989c5 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:31.828620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bebbbc-901b-481d-bc32-b6892da989c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:31.848456 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-62bebbbc-901b-481d-bc32-b6892da989c5 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:31.849830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-62bebbbc-901b-481d-bc32-b6892da989c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:31.927501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1148/2268] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:31.942762 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:31.945475 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:32.057129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b803f-e27c-46c6-9da0-ee2dedcb4ff8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:32.063335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676535ac-55bb-479f-a609-8beb51b9bfba service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e50f160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:32.063335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676535ac-55bb-479f-a609-8beb51b9bfba service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:32.063335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676535ac-55bb-479f-a609-8beb51b9bfba service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:32.063335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676535ac-55bb-479f-a609-8beb51b9bfba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:32.073827 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676535ac-55bb-479f-a609-8beb51b9bfba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:32.075511 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676535ac-55bb-479f-a609-8beb51b9bfba service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:32.086533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1121/2269] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:33.479814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bebbbc-901b-481d-bc32-b6892da989c5 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:33.481755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-62bebbbc-901b-481d-bc32-b6892da989c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:33.496402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bebbbc-901b-481d-bc32-b6892da989c5 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:33.503261 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z9OL6l_KT2aeP4Bmm7nq2g, audit_chain_id=['Z9OL6l_KT2aeP4Bmm7nq2g']) at 0x7fe09ebb9f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:33.504870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:33.504870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:33.505248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] PATH_INFO: `/v3/projects/387fb70b22a849758123829d4d94880d` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:33.506634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=387fb70b22a849758123829d4d94880d)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:33.509625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:33.640085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387fb70b22a849758123829d4d94880d', 'request_id': 'req-7ac7e47b-574b-4add-83cf-e44b1679e2c0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:33.736435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387fb70b22a849758123829d4d94880d', 'request_id': 'req-7ac7e47b-574b-4add-83cf-e44b1679e2c0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:33.751464 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387fb70b22a849758123829d4d94880d', 'request_id': 'req-7ac7e47b-574b-4add-83cf-e44b1679e2c0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:33.766418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] The token cache is being invalidate because project 387fb70b22a849758123829d4d94880d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:33.766657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:33.767397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7ac7e47b-574b-4add-83cf-e44b1679e2c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:33.775501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1149/2270] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:33 2022] DELETE /identity/v3/projects/387fb70b22a849758123829d4d94880d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:33.775802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ad4e-9fa7-4364-84bf-3e7cb7d12738 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:33.776302 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ad4e-9fa7-4364-84bf-3e7cb7d12738 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:33.777030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ad4e-9fa7-4364-84bf-3e7cb7d12738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:33.825847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-cd58ad4e-9fa7-4364-84bf-3e7cb7d12738 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:33.825847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-cd58ad4e-9fa7-4364-84bf-3e7cb7d12738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:33.943792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78315e51-b4c2-44c5-bda3-f2822a49a55a None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:33.944626 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78315e51-b4c2-44c5-bda3-f2822a49a55a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:33.945346 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78315e51-b4c2-44c5-bda3-f2822a49a55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:33.955443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1122/2271] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:34.008189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-78315e51-b4c2-44c5-bda3-f2822a49a55a None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:34.012542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-78315e51-b4c2-44c5-bda3-f2822a49a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:34.027490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1150/2272] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:34.028442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58ad4e-9fa7-4364-84bf-3e7cb7d12738 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:34.038136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58ad4e-9fa7-4364-84bf-3e7cb7d12738 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:34.052535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24d4c4-76f2-4584-b115-81630dfa329b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09dda4bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:34.053149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24d4c4-76f2-4584-b115-81630dfa329b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:34.053493 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24d4c4-76f2-4584-b115-81630dfa329b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:34.053975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24d4c4-76f2-4584-b115-81630dfa329b admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:34.054705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24d4c4-76f2-4584-b115-81630dfa329b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:05:34.055078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24d4c4-76f2-4584-b115-81630dfa329b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:34.064962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24d4c4-76f2-4584-b115-81630dfa329b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:34.079170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1123/2273] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:05:34.098927 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78315e51-b4c2-44c5-bda3-f2822a49a55a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:34.120864 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78315e51-b4c2-44c5-bda3-f2822a49a55a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:34.140474 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab1e74-ae87-480c-8b37-06b733b0c7a0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09e8e0b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:34.148804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab1e74-ae87-480c-8b37-06b733b0c7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:34.148804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab1e74-ae87-480c-8b37-06b733b0c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:34.148804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab1e74-ae87-480c-8b37-06b733b0c7a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:34.148804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab1e74-ae87-480c-8b37-06b733b0c7a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:34.148804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab1e74-ae87-480c-8b37-06b733b0c7a0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:34.405135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1151/2274] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:34 2022] POST /identity/v3/projects => generated 405 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:34.409256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24d4c4-76f2-4584-b115-81630dfa329b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:34.425105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24d4c4-76f2-4584-b115-81630dfa329b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:34.511920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b618df-6409-4d95-b820-9b39a773ad5a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09e3d1190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:34.512528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b618df-6409-4d95-b820-9b39a773ad5a admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:34.512822 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b618df-6409-4d95-b820-9b39a773ad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:34.513104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b618df-6409-4d95-b820-9b39a773ad5a admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:34.513747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b618df-6409-4d95-b820-9b39a773ad5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:34.515707 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b618df-6409-4d95-b820-9b39a773ad5a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:34.657969 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1124/2275] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:34 2022] POST /identity/v3/users => generated 303 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:34.661969 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab1e74-ae87-480c-8b37-06b733b0c7a0 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:34.673547 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab1e74-ae87-480c-8b37-06b733b0c7a0 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:34.678682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ece58a-3f03-4c63-9e63-4c59f93dfbb4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09e212f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:34.680705 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece58a-3f03-4c63-9e63-4c59f93dfbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:34.681016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece58a-3f03-4c63-9e63-4c59f93dfbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:34.681366 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece58a-3f03-4c63-9e63-4c59f93dfbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:34.682137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ece58a-3f03-4c63-9e63-4c59f93dfbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:34.684006 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ece58a-3f03-4c63-9e63-4c59f93dfbb4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:34.696675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1152/2276] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:34.700710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b618df-6409-4d95-b820-9b39a773ad5a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:34.710708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b618df-6409-4d95-b820-9b39a773ad5a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:34.717183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefd6c8-e3ce-4a06-ac61-1bbb891b372e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09df25d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:34.717843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd6c8-e3ce-4a06-ac61-1bbb891b372e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:34.718223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd6c8-e3ce-4a06-ac61-1bbb891b372e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:34.718509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd6c8-e3ce-4a06-ac61-1bbb891b372e admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:34.719507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefd6c8-e3ce-4a06-ac61-1bbb891b372e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:34.721164 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefd6c8-e3ce-4a06-ac61-1bbb891b372e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:34.732674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1125/2277] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:05:34.736742 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ece58a-3f03-4c63-9e63-4c59f93dfbb4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:34.754409 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ece58a-3f03-4c63-9e63-4c59f93dfbb4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:34.762314 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17536ab-ae4b-46a9-a98c-b1e97efecd54 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09e7057f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:34.763175 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17536ab-ae4b-46a9-a98c-b1e97efecd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:34.763468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17536ab-ae4b-46a9-a98c-b1e97efecd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:34.763750 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17536ab-ae4b-46a9-a98c-b1e97efecd54 admin admin] PATH_INFO: `/v3/projects/6a1b95f18f4846d1a6a758503fd3fc7f/users/78dce6aeaf3a4278a6cbf716262b3c5f/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:34.811501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17536ab-ae4b-46a9-a98c-b1e97efecd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1b95f18f4846d1a6a758503fd3fc7f, user_id=78dce6aeaf3a4278a6cbf716262b3c5f, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:34.819022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17536ab-ae4b-46a9-a98c-b1e97efecd54 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:34.918896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1153/2278] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:34 2022] PUT /identity/v3/projects/6a1b95f18f4846d1a6a758503fd3fc7f/users/78dce6aeaf3a4278a6cbf716262b3c5f/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:34.920728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bde5a2-4abf-452e-af15-3667e0a84de4 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:34.921289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bde5a2-4abf-452e-af15-3667e0a84de4 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:34.921289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bde5a2-4abf-452e-af15-3667e0a84de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:34.952654 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c6bde5a2-4abf-452e-af15-3667e0a84de4 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:34.954009 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c6bde5a2-4abf-452e-af15-3667e0a84de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:35.047531 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1126/2279] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:35.056288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17536ab-ae4b-46a9-a98c-b1e97efecd54 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:35.058089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a17536ab-ae4b-46a9-a98c-b1e97efecd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:35.133943 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17536ab-ae4b-46a9-a98c-b1e97efecd54 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:35.138200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0560c-b474-4800-81d2-9056a4729a03 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e9d1730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:35.138803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0560c-b474-4800-81d2-9056a4729a03 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:35.139566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0560c-b474-4800-81d2-9056a4729a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:35.139566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0560c-b474-4800-81d2-9056a4729a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:35.152807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0560c-b474-4800-81d2-9056a4729a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:35.155149 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0560c-b474-4800-81d2-9056a4729a03 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:35.168031 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1154/2280] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:36.194167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767b33-14aa-4f66-9257-f78f4b90a516 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:36.194167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767b33-14aa-4f66-9257-f78f4b90a516 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:36.194167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767b33-14aa-4f66-9257-f78f4b90a516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:36.216301 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-21767b33-14aa-4f66-9257-f78f4b90a516 None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:36.217467 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-21767b33-14aa-4f66-9257-f78f4b90a516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:36.280609 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1127/2281] 10.222.0.21 () {58 vars in 967 bytes} [Mon Feb 28 19:05:36 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:05:36.293725 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0560c-b474-4800-81d2-9056a4729a03 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:36.295198 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-25e0560c-b474-4800-81d2-9056a4729a03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:36.437398 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0560c-b474-4800-81d2-9056a4729a03 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:36.445186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1a5fd-cb33-4ede-bd0a-9d3b47bc63b3 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e45d700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:36.445988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1a5fd-cb33-4ede-bd0a-9d3b47bc63b3 service swift] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:36.446518 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1a5fd-cb33-4ede-bd0a-9d3b47bc63b3 service swift] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:36.447005 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1a5fd-cb33-4ede-bd0a-9d3b47bc63b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:36.459725 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1a5fd-cb33-4ede-bd0a-9d3b47bc63b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:36.462197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1a5fd-cb33-4ede-bd0a-9d3b47bc63b3 service swift] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:36.490034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1155/2282] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:05:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 19:05:37.782793 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba708d78-2534-4dd7-ba0a-fba637b9f191 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:37.783492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba708d78-2534-4dd7-ba0a-fba637b9f191 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:37.783492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba708d78-2534-4dd7-ba0a-fba637b9f191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:37.829218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-ba708d78-2534-4dd7-ba0a-fba637b9f191 None None] MFA Rules not processed for user `78dce6aeaf3a4278a6cbf716262b3c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:37.829218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ba708d78-2534-4dd7-ba0a-fba637b9f191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:37.910322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1128/2283] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:37 2022] POST /identity/v3/auth/tokens => generated 3712 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:37.915457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1a5fd-cb33-4ede-bd0a-9d3b47bc63b3 service swift] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:37.925895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1a5fd-cb33-4ede-bd0a-9d3b47bc63b3 service swift] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:37.931288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b96a8-1fa1-4043-8ed3-3d46fda60b8f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09e7b72e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:37.932027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b96a8-1fa1-4043-8ed3-3d46fda60b8f admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:37.932503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b96a8-1fa1-4043-8ed3-3d46fda60b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:37.932852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b96a8-1fa1-4043-8ed3-3d46fda60b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:37.933554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b96a8-1fa1-4043-8ed3-3d46fda60b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:37.935571 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b96a8-1fa1-4043-8ed3-3d46fda60b8f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:38.137739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1156/2284] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:37 2022] POST /identity/v3/projects => generated 403 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:38.141555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba708d78-2534-4dd7-ba0a-fba637b9f191 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:38.152689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba708d78-2534-4dd7-ba0a-fba637b9f191 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:38.220482 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e90d9-7f13-42fb-b7ec-de96de5bb30e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09e716130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:38.221218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e90d9-7f13-42fb-b7ec-de96de5bb30e admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:38.221512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e90d9-7f13-42fb-b7ec-de96de5bb30e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:38.221794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e90d9-7f13-42fb-b7ec-de96de5bb30e admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:38.222478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e90d9-7f13-42fb-b7ec-de96de5bb30e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:38.224427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e90d9-7f13-42fb-b7ec-de96de5bb30e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:38.411174 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1129/2285] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:38 2022] POST /identity/v3/users => generated 308 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:05:38.415827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b96a8-1fa1-4043-8ed3-3d46fda60b8f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:38.425797 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b96a8-1fa1-4043-8ed3-3d46fda60b8f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:38.430025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53591b5-c409-4bcf-8204-891b040c5d3e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09e212ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:38.430614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53591b5-c409-4bcf-8204-891b040c5d3e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:38.430899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53591b5-c409-4bcf-8204-891b040c5d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:38.431240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53591b5-c409-4bcf-8204-891b040c5d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:38.431929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53591b5-c409-4bcf-8204-891b040c5d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:38.433493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53591b5-c409-4bcf-8204-891b040c5d3e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:38.443926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1157/2286] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:38.457082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e90d9-7f13-42fb-b7ec-de96de5bb30e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:38.467534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e90d9-7f13-42fb-b7ec-de96de5bb30e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:38.471846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f9e9-e845-4b6d-80dd-8fd847ec46f0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09e1c8fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:38.472704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f9e9-e845-4b6d-80dd-8fd847ec46f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:38.472991 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f9e9-e845-4b6d-80dd-8fd847ec46f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:38.473273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f9e9-e845-4b6d-80dd-8fd847ec46f0 admin admin] PATH_INFO: `/v3/projects/9b37d1bf6660449c85b76104d709182f/users/b601cbb1fd1242af868a6f1db61f6493/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:38.492594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6f9e9-e845-4b6d-80dd-8fd847ec46f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b37d1bf6660449c85b76104d709182f, user_id=b601cbb1fd1242af868a6f1db61f6493, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:38.495323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6f9e9-e845-4b6d-80dd-8fd847ec46f0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:38.611459 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1130/2287] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:38 2022] PUT /identity/v3/projects/9b37d1bf6660449c85b76104d709182f/users/b601cbb1fd1242af868a6f1db61f6493/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:38.615698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53591b5-c409-4bcf-8204-891b040c5d3e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:38.625316 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53591b5-c409-4bcf-8204-891b040c5d3e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:38.691490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f33fdb-6235-476c-9781-ba70f976b9b7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09ddaa5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:38.692284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f33fdb-6235-476c-9781-ba70f976b9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:38.692578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f33fdb-6235-476c-9781-ba70f976b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:38.692859 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f33fdb-6235-476c-9781-ba70f976b9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:38.693558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f33fdb-6235-476c-9781-ba70f976b9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:38.696452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f33fdb-6235-476c-9781-ba70f976b9b7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:38.706901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1158/2288] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:38.711973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f9e9-e845-4b6d-80dd-8fd847ec46f0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:38.722228 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f9e9-e845-4b6d-80dd-8fd847ec46f0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:38.727341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a339ed8-b8ab-4c3a-8df6-47554c634b13 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09e716130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:38.728167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339ed8-b8ab-4c3a-8df6-47554c634b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:38.728490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339ed8-b8ab-4c3a-8df6-47554c634b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:38.728885 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339ed8-b8ab-4c3a-8df6-47554c634b13 admin admin] PATH_INFO: `/v3/projects/9b37d1bf6660449c85b76104d709182f/users/b601cbb1fd1242af868a6f1db61f6493/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:38.730674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a339ed8-b8ab-4c3a-8df6-47554c634b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b37d1bf6660449c85b76104d709182f, user_id=b601cbb1fd1242af868a6f1db61f6493, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:38.733359 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a339ed8-b8ab-4c3a-8df6-47554c634b13 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:38.743982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1131/2289] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:38 2022] PUT /identity/v3/projects/9b37d1bf6660449c85b76104d709182f/users/b601cbb1fd1242af868a6f1db61f6493/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:05:40.629815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964094ab-b436-40df-a42f-9388b0b7c4f0 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:40.631657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964094ab-b436-40df-a42f-9388b0b7c4f0 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:40.632101 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964094ab-b436-40df-a42f-9388b0b7c4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:40.717147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-964094ab-b436-40df-a42f-9388b0b7c4f0 None None] MFA Rules not processed for user `b601cbb1fd1242af868a6f1db61f6493`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:40.718685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-964094ab-b436-40df-a42f-9388b0b7c4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:40.875616 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1159/2290] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:40 2022] POST /identity/v3/auth/tokens => generated 3777 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:05:41.435971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694860e6-09eb-4c0f-9f6f-c83e7454c83f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:41.436492 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694860e6-09eb-4c0f-9f6f-c83e7454c83f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:41.436700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694860e6-09eb-4c0f-9f6f-c83e7454c83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:41.463096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-694860e6-09eb-4c0f-9f6f-c83e7454c83f None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:41.464404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-694860e6-09eb-4c0f-9f6f-c83e7454c83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:41.555091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1132/2291] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:05:41 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:41.568604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964094ab-b436-40df-a42f-9388b0b7c4f0 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:41.648029 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964094ab-b436-40df-a42f-9388b0b7c4f0 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:41.653172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bf79-e31a-4c8d-83b5-ce6c49567cc5 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e45d340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:41.653770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bf79-e31a-4c8d-83b5-ce6c49567cc5 service swift] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:41.654064 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bf79-e31a-4c8d-83b5-ce6c49567cc5 service swift] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:41.654350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bf79-e31a-4c8d-83b5-ce6c49567cc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:41.663210 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7bf79-e31a-4c8d-83b5-ce6c49567cc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:41.667579 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7bf79-e31a-4c8d-83b5-ce6c49567cc5 service swift] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:41.675701 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1160/2292] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:05:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 19:05:42.029999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694860e6-09eb-4c0f-9f6f-c83e7454c83f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:42.031396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-694860e6-09eb-4c0f-9f6f-c83e7454c83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:42.157049 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694860e6-09eb-4c0f-9f6f-c83e7454c83f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:42.162709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AcDh_yoSRoiiebOEqES7YA, audit_chain_id=['AcDh_yoSRoiiebOEqES7YA']) at 0x7fe09e472550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:42.163782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:42.164902 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:42.165480 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] PATH_INFO: `/v3/users/3484bc7ebe7d4ddd972788b2ce5434ff` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:42.167822 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3484bc7ebe7d4ddd972788b2ce5434ff)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:42.170051 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:42.474915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3484bc7ebe7d4ddd972788b2ce5434ff'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:42.644603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3484bc7ebe7d4ddd972788b2ce5434ff'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:42.669523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3484bc7ebe7d4ddd972788b2ce5434ff'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:42.670559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3484bc7ebe7d4ddd972788b2ce5434ff'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:42.671415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3484bc7ebe7d4ddd972788b2ce5434ff'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:42.699488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1133/2293] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:42 2022] DELETE /identity/v3/users/3484bc7ebe7d4ddd972788b2ce5434ff => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:43.369825 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bf79-e31a-4c8d-83b5-ce6c49567cc5 service swift] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:43.386713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bf79-e31a-4c8d-83b5-ce6c49567cc5 service swift] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:43.517546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AcDh_yoSRoiiebOEqES7YA, audit_chain_id=['AcDh_yoSRoiiebOEqES7YA']) at 0x7fe09e9d16d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:43.518458 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:43.519021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:43.520671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] PATH_INFO: `/v3/projects/1bdeeae6a56d4607962f8b0a1490547a` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:43.521669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bdeeae6a56d4607962f8b0a1490547a)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:43.523932 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:43.718713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdeeae6a56d4607962f8b0a1490547a', 'request_id': 'req-763ac53c-9556-4c9d-92ef-6bead520c9c8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:43.908826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdeeae6a56d4607962f8b0a1490547a', 'request_id': 'req-763ac53c-9556-4c9d-92ef-6bead520c9c8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:43.941093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdeeae6a56d4607962f8b0a1490547a', 'request_id': 'req-763ac53c-9556-4c9d-92ef-6bead520c9c8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:43.956257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] The token cache is being invalidate because project 1bdeeae6a56d4607962f8b0a1490547a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:43.957506 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:43.958537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:43.960832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1161/2294] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:43 2022] DELETE /identity/v3/projects/1bdeeae6a56d4607962f8b0a1490547a => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:44.556055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:44.558227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:44.598286 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359ce59-d9e0-47f8-abe4-2d82928dde31 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:44.774177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09e15b070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:44.774999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:44.775320 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:44.775611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] PATH_INFO: `/v3/users/78dce6aeaf3a4278a6cbf716262b3c5f` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:44.776759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78dce6aeaf3a4278a6cbf716262b3c5f)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:44.778725 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:45.099296 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78dce6aeaf3a4278a6cbf716262b3c5f'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:45.233781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78dce6aeaf3a4278a6cbf716262b3c5f'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:45.247061 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78dce6aeaf3a4278a6cbf716262b3c5f'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:45.247784 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78dce6aeaf3a4278a6cbf716262b3c5f'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:45.248387 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78dce6aeaf3a4278a6cbf716262b3c5f'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:45.265630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1134/2295] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:44 2022] DELETE /identity/v3/users/78dce6aeaf3a4278a6cbf716262b3c5f => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:45.712832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:45.714596 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:45.730737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ac53c-9556-4c9d-92ef-6bead520c9c8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:45.807475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09e978790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:45.808289 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:45.808581 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:45.808866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] PATH_INFO: `/v3/projects/6a1b95f18f4846d1a6a758503fd3fc7f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:45.809972 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1b95f18f4846d1a6a758503fd3fc7f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:45.811915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:46.218244 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1b95f18f4846d1a6a758503fd3fc7f', 'request_id': 'req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:46.375146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1b95f18f4846d1a6a758503fd3fc7f', 'request_id': 'req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:46.387224 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1b95f18f4846d1a6a758503fd3fc7f', 'request_id': 'req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:46.396846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] The token cache is being invalidate because project 6a1b95f18f4846d1a6a758503fd3fc7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:46.397137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:46.397764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:46.400037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1162/2296] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:45 2022] DELETE /identity/v3/projects/6a1b95f18f4846d1a6a758503fd3fc7f => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:46.404095 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:46.405581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:46.419025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a7e1d-cb51-47dc-b98c-e5a7b98681a6 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:46.484071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea80fa-c068-46ae-836a-2f0e6886579e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09dda4cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:46.484792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea80fa-c068-46ae-836a-2f0e6886579e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:46.485080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea80fa-c068-46ae-836a-2f0e6886579e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:46.485360 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea80fa-c068-46ae-836a-2f0e6886579e admin admin] PATH_INFO: `/v3/users/b601cbb1fd1242af868a6f1db61f6493` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:46.486471 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea80fa-c068-46ae-836a-2f0e6886579e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b601cbb1fd1242af868a6f1db61f6493)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:46.488418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea80fa-c068-46ae-836a-2f0e6886579e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:46.787822 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7eea80fa-c068-46ae-836a-2f0e6886579e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b601cbb1fd1242af868a6f1db61f6493'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:46.908294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7eea80fa-c068-46ae-836a-2f0e6886579e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b601cbb1fd1242af868a6f1db61f6493'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:46.922855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7eea80fa-c068-46ae-836a-2f0e6886579e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b601cbb1fd1242af868a6f1db61f6493'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:46.923697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7eea80fa-c068-46ae-836a-2f0e6886579e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b601cbb1fd1242af868a6f1db61f6493'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:46.924369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-7eea80fa-c068-46ae-836a-2f0e6886579e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b601cbb1fd1242af868a6f1db61f6493'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:46.938799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1135/2297] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:46 2022] DELETE /identity/v3/users/b601cbb1fd1242af868a6f1db61f6493 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:47.405244 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:47.407270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:47.445663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66105f9e-ea6f-49b4-ba9f-c5dd3c199cc9 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:47.579748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qOLahyOpQ-Shtc_DgvUEMw, audit_chain_id=['qOLahyOpQ-Shtc_DgvUEMw']) at 0x7fe09eba9a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:47.581076 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:47.581380 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:47.581669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] PATH_INFO: `/v3/projects/9b37d1bf6660449c85b76104d709182f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:47.583009 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b37d1bf6660449c85b76104d709182f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:47.584953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:47.768208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b37d1bf6660449c85b76104d709182f', 'request_id': 'req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:47.889688 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b37d1bf6660449c85b76104d709182f', 'request_id': 'req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:47.909306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b37d1bf6660449c85b76104d709182f', 'request_id': 'req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:47.922429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] The token cache is being invalidate because project 9b37d1bf6660449c85b76104d709182f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:47.922851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:47.923453 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-c7745c0f-2c4e-4067-a0fd-e3f8dee6e933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:47.942840 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1163/2298] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:47 2022] DELETE /identity/v3/projects/9b37d1bf6660449c85b76104d709182f => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:47.943002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc7d41-c1d8-469b-8d79-2855f77f9084 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:47.943002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc7d41-c1d8-469b-8d79-2855f77f9084 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:47.943002 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc7d41-c1d8-469b-8d79-2855f77f9084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:47.960446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-fcbc7d41-c1d8-469b-8d79-2855f77f9084 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:47.962475 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-fcbc7d41-c1d8-469b-8d79-2855f77f9084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:48.040109 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1136/2299] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:48.048673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688b806-12fd-40b4-8d9a-1899c74572ca None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:48.049022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688b806-12fd-40b4-8d9a-1899c74572ca None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:48.049393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688b806-12fd-40b4-8d9a-1899c74572ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:48.074494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3688b806-12fd-40b4-8d9a-1899c74572ca None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:48.076246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3688b806-12fd-40b4-8d9a-1899c74572ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:48.085454 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1164/2300] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:48.090769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc7d41-c1d8-469b-8d79-2855f77f9084 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:48.102175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc7d41-c1d8-469b-8d79-2855f77f9084 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:48.107267 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b3dba-8791-4280-ad96-3c2377028730 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e8faa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:48.114566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b3dba-8791-4280-ad96-3c2377028730 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:48.114566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b3dba-8791-4280-ad96-3c2377028730 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:48.114566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b3dba-8791-4280-ad96-3c2377028730 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:48.114566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b3dba-8791-4280-ad96-3c2377028730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:05:48.114566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b3dba-8791-4280-ad96-3c2377028730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:48.114566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b3dba-8791-4280-ad96-3c2377028730 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:48.126727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1137/2301] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:05:48.132021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688b806-12fd-40b4-8d9a-1899c74572ca None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:48.141418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688b806-12fd-40b4-8d9a-1899c74572ca None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:48.146300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e0e7f-d65a-468a-9074-623040cd1ebf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09ea39d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:48.147201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0e7f-d65a-468a-9074-623040cd1ebf admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:48.147574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0e7f-d65a-468a-9074-623040cd1ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:48.147930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0e7f-d65a-468a-9074-623040cd1ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:48.149128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e0e7f-d65a-468a-9074-623040cd1ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:48.151202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e0e7f-d65a-468a-9074-623040cd1ebf admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:48.291625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1165/2302] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:48 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:48.292803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b3dba-8791-4280-ad96-3c2377028730 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:48.302581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b3dba-8791-4280-ad96-3c2377028730 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:48.379437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5e1ac-e03d-4f8c-8a99-21f617eed09b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e162070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:48.379437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5e1ac-e03d-4f8c-8a99-21f617eed09b admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:48.379437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5e1ac-e03d-4f8c-8a99-21f617eed09b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:48.379437 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5e1ac-e03d-4f8c-8a99-21f617eed09b admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:48.379981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5e1ac-e03d-4f8c-8a99-21f617eed09b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:48.381125 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e0e7f-d65a-468a-9074-623040cd1ebf admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:48.381770 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5e1ac-e03d-4f8c-8a99-21f617eed09b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:48.385053 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a47e0e7f-d65a-468a-9074-623040cd1ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:48.397359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e0e7f-d65a-468a-9074-623040cd1ebf admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:48.402951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gU-NNndDTn-_6n0xbdaVQA, audit_chain_id=['gU-NNndDTn-_6n0xbdaVQA']) at 0x7fe09e118400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:48.403783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:48.404060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:48.404478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] PATH_INFO: `/v3/users/46e767d2e3624a3fa799c8c1b20b0516` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:48.405594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e767d2e3624a3fa799c8c1b20b0516)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:48.407525 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:48.549227 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1138/2303] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:48 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:48.553398 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5e1ac-e03d-4f8c-8a99-21f617eed09b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:48.565857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5e1ac-e03d-4f8c-8a99-21f617eed09b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:48.570781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b6146-57da-4cfb-be0a-beaa0f8e3441 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e3fa070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:48.571444 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b6146-57da-4cfb-be0a-beaa0f8e3441 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:48.572438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b6146-57da-4cfb-be0a-beaa0f8e3441 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:48.572438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b6146-57da-4cfb-be0a-beaa0f8e3441 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:48.576557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b6146-57da-4cfb-be0a-beaa0f8e3441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:48.578243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b6146-57da-4cfb-be0a-beaa0f8e3441 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:48.593967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1139/2304] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:05:48.594924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b6146-57da-4cfb-be0a-beaa0f8e3441 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:48.605980 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b6146-57da-4cfb-be0a-beaa0f8e3441 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:48.611064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e45189-0054-42a3-b209-87a1b0e00e5a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09df25850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:48.611692 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45189-0054-42a3-b209-87a1b0e00e5a admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:48.611981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45189-0054-42a3-b209-87a1b0e00e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:48.612265 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45189-0054-42a3-b209-87a1b0e00e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:48.613017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e45189-0054-42a3-b209-87a1b0e00e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:48.614665 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e45189-0054-42a3-b209-87a1b0e00e5a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:48.627944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1140/2305] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:48.632198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e45189-0054-42a3-b209-87a1b0e00e5a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:48.642491 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e45189-0054-42a3-b209-87a1b0e00e5a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:48.647622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e0e8b-9685-4ec1-bbfa-ac90f74c75f4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e15b8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:48.649020 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e0e8b-9685-4ec1-bbfa-ac90f74c75f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:48.649273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e0e8b-9685-4ec1-bbfa-ac90f74c75f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:48.650068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e0e8b-9685-4ec1-bbfa-ac90f74c75f4 admin admin] PATH_INFO: `/v3/projects/bf975eaa2fc94e2d86edc79de21a4f89/users/41231a9e754b41db8f6891bb8c466802/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:48.673003 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e0e8b-9685-4ec1-bbfa-ac90f74c75f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf975eaa2fc94e2d86edc79de21a4f89, user_id=41231a9e754b41db8f6891bb8c466802, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:48.675793 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e0e8b-9685-4ec1-bbfa-ac90f74c75f4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:48.724291 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e767d2e3624a3fa799c8c1b20b0516'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:48.739528 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e767d2e3624a3fa799c8c1b20b0516'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:48.741484 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e767d2e3624a3fa799c8c1b20b0516'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:48.741788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e767d2e3624a3fa799c8c1b20b0516'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:48.822618 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1141/2306] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:48 2022] PUT /identity/v3/projects/bf975eaa2fc94e2d86edc79de21a4f89/users/41231a9e754b41db8f6891bb8c466802/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:05:48.833441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85981466-6b3c-4836-ae20-6866e1fe8bc4 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:48.833731 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85981466-6b3c-4836-ae20-6866e1fe8bc4 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:48.834009 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85981466-6b3c-4836-ae20-6866e1fe8bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:48.850686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e767d2e3624a3fa799c8c1b20b0516'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:48.874158 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1166/2307] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:48 2022] DELETE /identity/v3/users/46e767d2e3624a3fa799c8c1b20b0516 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:48.888599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-85981466-6b3c-4836-ae20-6866e1fe8bc4 None None] MFA Rules not processed for user `41231a9e754b41db8f6891bb8c466802`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:48.890019 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-85981466-6b3c-4836-ae20-6866e1fe8bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:49.012289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1142/2308] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:48 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:05:49.016906 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:49.019044 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:49.115570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5c29-5ca9-4d93-be99-bc3085dc3945 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:49.120824 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff79c4b-dddd-4f29-ac4b-54ef951511eb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e9d16d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:49.129359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff79c4b-dddd-4f29-ac4b-54ef951511eb admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:49.129359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff79c4b-dddd-4f29-ac4b-54ef951511eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:49.129359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff79c4b-dddd-4f29-ac4b-54ef951511eb admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:49.129359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff79c4b-dddd-4f29-ac4b-54ef951511eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:49.129359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff79c4b-dddd-4f29-ac4b-54ef951511eb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:49.278242 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1167/2309] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:49 2022] POST /identity/v3/projects => generated 363 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:05:49.279464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85981466-6b3c-4836-ae20-6866e1fe8bc4 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:49.301504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85981466-6b3c-4836-ae20-6866e1fe8bc4 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:49.380640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fe93b-9736-46bb-af1e-1f1ef68ac183 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e8a0880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:49.381182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fe93b-9736-46bb-af1e-1f1ef68ac183 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:49.381478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fe93b-9736-46bb-af1e-1f1ef68ac183 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:49.381789 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fe93b-9736-46bb-af1e-1f1ef68ac183 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:49.382486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fe93b-9736-46bb-af1e-1f1ef68ac183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:49.385700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fe93b-9736-46bb-af1e-1f1ef68ac183 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:49.431748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff79c4b-dddd-4f29-ac4b-54ef951511eb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:49.433429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0ff79c4b-dddd-4f29-ac4b-54ef951511eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:49.449839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff79c4b-dddd-4f29-ac4b-54ef951511eb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:49.454539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gU-NNndDTn-_6n0xbdaVQA, audit_chain_id=['gU-NNndDTn-_6n0xbdaVQA']) at 0x7fe09e21ea60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:49.455671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:49.460625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:49.460625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] PATH_INFO: `/v3/projects/498eaf5c78e54296ac5cdeef3489e3ef` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:49.460625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498eaf5c78e54296ac5cdeef3489e3ef)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:49.460625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:49.489677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1143/2310] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:49 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:05:49.490869 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fe93b-9736-46bb-af1e-1f1ef68ac183 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:49.504068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fe93b-9736-46bb-af1e-1f1ef68ac183 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:49.510811 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c8afc-2740-462d-8c4c-30d0330fdc09 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e3e21c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:49.511501 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c8afc-2740-462d-8c4c-30d0330fdc09 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:49.511817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c8afc-2740-462d-8c4c-30d0330fdc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:49.512129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c8afc-2740-462d-8c4c-30d0330fdc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:49.512871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c8afc-2740-462d-8c4c-30d0330fdc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:49.514697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c8afc-2740-462d-8c4c-30d0330fdc09 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:49.532035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1144/2311] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:49.533173 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c8afc-2740-462d-8c4c-30d0330fdc09 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:49.545572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c8afc-2740-462d-8c4c-30d0330fdc09 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:49.551317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af39e2-b713-4590-a0ed-6befc6fef5e2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e716460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:49.553278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af39e2-b713-4590-a0ed-6befc6fef5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:49.553278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af39e2-b713-4590-a0ed-6befc6fef5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:49.553278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af39e2-b713-4590-a0ed-6befc6fef5e2 admin admin] PATH_INFO: `/v3/projects/277db3fde8b745d7aae8e88c2ecd5ebb/users/0513ff442ea04232998541c8bd3cd6fd/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:49.578163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af39e2-b713-4590-a0ed-6befc6fef5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277db3fde8b745d7aae8e88c2ecd5ebb, user_id=0513ff442ea04232998541c8bd3cd6fd, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:49.580639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af39e2-b713-4590-a0ed-6befc6fef5e2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:49.714877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1145/2312] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:49 2022] PUT /identity/v3/projects/277db3fde8b745d7aae8e88c2ecd5ebb/users/0513ff442ea04232998541c8bd3cd6fd/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:49.718697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af39e2-b713-4590-a0ed-6befc6fef5e2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:49.731203 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498eaf5c78e54296ac5cdeef3489e3ef', 'request_id': 'req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:49.814423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af39e2-b713-4590-a0ed-6befc6fef5e2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:49.873815 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498eaf5c78e54296ac5cdeef3489e3ef', 'request_id': 'req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:49.887906 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acb4b0-ce5e-47d4-8a52-8302dc2e9ab4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e922fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:49.889264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb4b0-ce5e-47d4-8a52-8302dc2e9ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:49.889708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb4b0-ce5e-47d4-8a52-8302dc2e9ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:49.890139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acb4b0-ce5e-47d4-8a52-8302dc2e9ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:49.890992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acb4b0-ce5e-47d4-8a52-8302dc2e9ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:49.895736 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acb4b0-ce5e-47d4-8a52-8302dc2e9ab4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:49.901179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498eaf5c78e54296ac5cdeef3489e3ef', 'request_id': 'req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:49.912689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1146/2313] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:49.927018 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acb4b0-ce5e-47d4-8a52-8302dc2e9ab4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:49.927805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] The token cache is being invalidate because project 498eaf5c78e54296ac5cdeef3489e3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:49.928102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:49.928971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-4f97cd08-0851-4ac6-84e1-6ded6e2578e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:49.932541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1168/2314] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:49 2022] DELETE /identity/v3/projects/498eaf5c78e54296ac5cdeef3489e3ef => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:05:49.939521 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a286a1-cd59-4d8c-b926-a2ab1763b106 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:49.939976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a286a1-cd59-4d8c-b926-a2ab1763b106 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:49.940367 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a286a1-cd59-4d8c-b926-a2ab1763b106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:49.962837 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acb4b0-ce5e-47d4-8a52-8302dc2e9ab4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:49.969787 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-d4a286a1-cd59-4d8c-b926-a2ab1763b106 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:49.971063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d4a286a1-cd59-4d8c-b926-a2ab1763b106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:49.980534 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1169/2315] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:49.990755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19c34b-44c2-4c17-a8d3-704cf2fd46c7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e94cdc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:49.992524 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19c34b-44c2-4c17-a8d3-704cf2fd46c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:49.992998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19c34b-44c2-4c17-a8d3-704cf2fd46c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:49.993449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19c34b-44c2-4c17-a8d3-704cf2fd46c7 admin admin] PATH_INFO: `/v3/projects/277db3fde8b745d7aae8e88c2ecd5ebb/users/0513ff442ea04232998541c8bd3cd6fd/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:49.995328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a74663-9f05-4e0f-9036-3ce5a6bc9700 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:49.995630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a74663-9f05-4e0f-9036-3ce5a6bc9700 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:49.995921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a74663-9f05-4e0f-9036-3ce5a6bc9700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:50.001137 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19c34b-44c2-4c17-a8d3-704cf2fd46c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277db3fde8b745d7aae8e88c2ecd5ebb, user_id=0513ff442ea04232998541c8bd3cd6fd, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:50.003887 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19c34b-44c2-4c17-a8d3-704cf2fd46c7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:50.037580 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1147/2316] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:49 2022] PUT /identity/v3/projects/277db3fde8b745d7aae8e88c2ecd5ebb/users/0513ff442ea04232998541c8bd3cd6fd/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:50.044442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bba6a-6c5e-4cf4-ade6-8ec7e75e85d3 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:50.044791 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bba6a-6c5e-4cf4-ade6-8ec7e75e85d3 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:50.045079 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bba6a-6c5e-4cf4-ade6-8ec7e75e85d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:50.060283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-26a74663-9f05-4e0f-9036-3ce5a6bc9700 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:50.061490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-26a74663-9f05-4e0f-9036-3ce5a6bc9700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:50.117739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-890bba6a-6c5e-4cf4-ade6-8ec7e75e85d3 None None] MFA Rules not processed for user `0513ff442ea04232998541c8bd3cd6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:50.119908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-890bba6a-6c5e-4cf4-ade6-8ec7e75e85d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:50.157264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1170/2317] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:50.161731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a74663-9f05-4e0f-9036-3ce5a6bc9700 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:50.171456 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a74663-9f05-4e0f-9036-3ce5a6bc9700 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:50.175787 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75952fc-1965-41d3-b95b-bb8c56a2e977 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mO489CYPSoqlyneKL0ZMTw, audit_chain_id=['mO489CYPSoqlyneKL0ZMTw']) at 0x7fe09e444430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:50.176551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75952fc-1965-41d3-b95b-bb8c56a2e977 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:50.176847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75952fc-1965-41d3-b95b-bb8c56a2e977 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:50.177129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75952fc-1965-41d3-b95b-bb8c56a2e977 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:50.177838 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75952fc-1965-41d3-b95b-bb8c56a2e977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:05:50.178465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75952fc-1965-41d3-b95b-bb8c56a2e977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:50.181882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75952fc-1965-41d3-b95b-bb8c56a2e977 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:50.195854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1171/2318] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:05:50.200590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75952fc-1965-41d3-b95b-bb8c56a2e977 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:50.210013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75952fc-1965-41d3-b95b-bb8c56a2e977 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:50.215090 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cb2c7-403c-4b66-95c1-a839e4d6b97b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mO489CYPSoqlyneKL0ZMTw, audit_chain_id=['mO489CYPSoqlyneKL0ZMTw']) at 0x7fe09defe3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:50.215715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cb2c7-403c-4b66-95c1-a839e4d6b97b admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:50.216004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cb2c7-403c-4b66-95c1-a839e4d6b97b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:50.216285 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cb2c7-403c-4b66-95c1-a839e4d6b97b admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:50.216914 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cb2c7-403c-4b66-95c1-a839e4d6b97b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:50.218896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cb2c7-403c-4b66-95c1-a839e4d6b97b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:50.230138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1148/2319] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:50 2022] POST /identity/v3/auth/tokens => generated 3737 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:50.250637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bba6a-6c5e-4cf4-ade6-8ec7e75e85d3 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:50.252045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-890bba6a-6c5e-4cf4-ade6-8ec7e75e85d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:50.322650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bba6a-6c5e-4cf4-ade6-8ec7e75e85d3 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:50.369764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d062bb-49e1-4c82-99ec-ec32547d2adf service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e8dfaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:50.369764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d062bb-49e1-4c82-99ec-ec32547d2adf service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:50.369764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d062bb-49e1-4c82-99ec-ec32547d2adf service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:50.369764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d062bb-49e1-4c82-99ec-ec32547d2adf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:50.370608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d062bb-49e1-4c82-99ec-ec32547d2adf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:50.370608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d062bb-49e1-4c82-99ec-ec32547d2adf service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:50.370608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1149/2320] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:50 2022] GET /identity/v3/auth/tokens => generated 3737 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:05:50.579230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1172/2321] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:50 2022] POST /identity/v3/projects => generated 385 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:05:50.584154 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d062bb-49e1-4c82-99ec-ec32547d2adf service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:50.594842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d062bb-49e1-4c82-99ec-ec32547d2adf service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:50.659205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcf4f7-4d5b-4d42-b854-86d62dee4685 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mO489CYPSoqlyneKL0ZMTw, audit_chain_id=['mO489CYPSoqlyneKL0ZMTw']) at 0x7fe09e1cc070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:50.659815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcf4f7-4d5b-4d42-b854-86d62dee4685 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:50.660106 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcf4f7-4d5b-4d42-b854-86d62dee4685 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:50.660396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcf4f7-4d5b-4d42-b854-86d62dee4685 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:50.661038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcf4f7-4d5b-4d42-b854-86d62dee4685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:50.662930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcf4f7-4d5b-4d42-b854-86d62dee4685 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:50.811854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1150/2322] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:50 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:50.819925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cb2c7-403c-4b66-95c1-a839e4d6b97b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:50.838179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cb2c7-403c-4b66-95c1-a839e4d6b97b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:50.853495 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f1546-8bb7-4140-8e14-517b29577a4e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mO489CYPSoqlyneKL0ZMTw, audit_chain_id=['mO489CYPSoqlyneKL0ZMTw']) at 0x7fe09e183df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:50.854110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f1546-8bb7-4140-8e14-517b29577a4e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:50.854406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f1546-8bb7-4140-8e14-517b29577a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:50.854686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f1546-8bb7-4140-8e14-517b29577a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:50.855429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f1546-8bb7-4140-8e14-517b29577a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:50.857072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f1546-8bb7-4140-8e14-517b29577a4e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:50.871667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1173/2323] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:50.875892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcf4f7-4d5b-4d42-b854-86d62dee4685 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:50.887463 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcf4f7-4d5b-4d42-b854-86d62dee4685 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:50.893070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8550c11-88fc-40a2-8739-ae1cdb3f3ff5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mO489CYPSoqlyneKL0ZMTw, audit_chain_id=['mO489CYPSoqlyneKL0ZMTw']) at 0x7fe09e411790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:50.893737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8550c11-88fc-40a2-8739-ae1cdb3f3ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:50.894092 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8550c11-88fc-40a2-8739-ae1cdb3f3ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:50.894444 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8550c11-88fc-40a2-8739-ae1cdb3f3ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:50.895832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8550c11-88fc-40a2-8739-ae1cdb3f3ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:50.898765 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8550c11-88fc-40a2-8739-ae1cdb3f3ff5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:50.910387 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1151/2324] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:50.916487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f1546-8bb7-4140-8e14-517b29577a4e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:50.933097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f1546-8bb7-4140-8e14-517b29577a4e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:50.940454 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a91a1-ddd8-48a3-a72c-a67e3a082433 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mO489CYPSoqlyneKL0ZMTw, audit_chain_id=['mO489CYPSoqlyneKL0ZMTw']) at 0x7fe09e183790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:50.941633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a91a1-ddd8-48a3-a72c-a67e3a082433 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:50.942230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a91a1-ddd8-48a3-a72c-a67e3a082433 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:50.942668 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a91a1-ddd8-48a3-a72c-a67e3a082433 admin admin] PATH_INFO: `/v3/projects/ed3431e3511e454e862f3a373ad0b5f0/users/56639281fd2748af8c8641afd706dac2/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:50.996240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a91a1-ddd8-48a3-a72c-a67e3a082433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3431e3511e454e862f3a373ad0b5f0, user_id=56639281fd2748af8c8641afd706dac2, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:51.008323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8550c11-88fc-40a2-8739-ae1cdb3f3ff5 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:51.010112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b8550c11-88fc-40a2-8739-ae1cdb3f3ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:51.013338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a91a1-ddd8-48a3-a72c-a67e3a082433 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:51.024537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8550c11-88fc-40a2-8739-ae1cdb3f3ff5 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:51.030368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d211d88-159a-44a4-a04a-e942980f286f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e90fd00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:51.030368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d211d88-159a-44a4-a04a-e942980f286f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:51.030368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d211d88-159a-44a4-a04a-e942980f286f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:51.030867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d211d88-159a-44a4-a04a-e942980f286f admin admin] PATH_INFO: `/v3/users/41231a9e754b41db8f6891bb8c466802` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:51.031698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d211d88-159a-44a4-a04a-e942980f286f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41231a9e754b41db8f6891bb8c466802)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:51.033626 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d211d88-159a-44a4-a04a-e942980f286f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:51.121573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1174/2325] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:50 2022] PUT /identity/v3/projects/ed3431e3511e454e862f3a373ad0b5f0/users/56639281fd2748af8c8641afd706dac2/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:51.132693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d7210-3ff0-4fa7-b9ca-b17f5f2da28a None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:51.133111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d7210-3ff0-4fa7-b9ca-b17f5f2da28a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:51.133465 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d7210-3ff0-4fa7-b9ca-b17f5f2da28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:51.184377 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-597d7210-3ff0-4fa7-b9ca-b17f5f2da28a None None] MFA Rules not processed for user `56639281fd2748af8c8641afd706dac2`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:51.186099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-597d7210-3ff0-4fa7-b9ca-b17f5f2da28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:51.262917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-1d211d88-159a-44a4-a04a-e942980f286f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41231a9e754b41db8f6891bb8c466802'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:51.306952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1175/2326] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:51 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:51.317383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d7210-3ff0-4fa7-b9ca-b17f5f2da28a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:51.319066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-597d7210-3ff0-4fa7-b9ca-b17f5f2da28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:51.326343 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-1d211d88-159a-44a4-a04a-e942980f286f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41231a9e754b41db8f6891bb8c466802'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:51.351309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-1d211d88-159a-44a4-a04a-e942980f286f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41231a9e754b41db8f6891bb8c466802'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:51.352175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-1d211d88-159a-44a4-a04a-e942980f286f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41231a9e754b41db8f6891bb8c466802'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:51.353868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-1d211d88-159a-44a4-a04a-e942980f286f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41231a9e754b41db8f6891bb8c466802'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:51.378673 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1152/2327] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:51 2022] DELETE /identity/v3/users/41231a9e754b41db8f6891bb8c466802 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:51.390315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1589-b084-4f3f-a034-1849402e3309 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:51.390614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1589-b084-4f3f-a034-1849402e3309 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:51.390898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1589-b084-4f3f-a034-1849402e3309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:51.440995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-547a1589-b084-4f3f-a034-1849402e3309 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:51.445590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-547a1589-b084-4f3f-a034-1849402e3309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:51.469680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d7210-3ff0-4fa7-b9ca-b17f5f2da28a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:51.584096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1153/2328] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:51.592997 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdd413-7e3f-455a-a8b5-eeb87d7e1aad service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=wTjUJdAdSkmocIsusTZBDA, audit_chain_id=['wTjUJdAdSkmocIsusTZBDA']) at 0x7fe09e50e0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:51.593600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdd413-7e3f-455a-a8b5-eeb87d7e1aad service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:51.593893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdd413-7e3f-455a-a8b5-eeb87d7e1aad service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:51.594174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdd413-7e3f-455a-a8b5-eeb87d7e1aad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:51.595964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6bbdd413-7e3f-455a-a8b5-eeb87d7e1aad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:51.602407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a1589-b084-4f3f-a034-1849402e3309 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:51.603995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-547a1589-b084-4f3f-a034-1849402e3309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:51.666960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdd413-7e3f-455a-a8b5-eeb87d7e1aad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:51.668599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdd413-7e3f-455a-a8b5-eeb87d7e1aad service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:51.678059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1176/2329] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:51 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:05:51.684385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a1589-b084-4f3f-a034-1849402e3309 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:51.701024 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20819606-e4ef-45ca-af41-29afd971fafe service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e3fa370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:51.701718 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20819606-e4ef-45ca-af41-29afd971fafe service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:51.702256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20819606-e4ef-45ca-af41-29afd971fafe service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:51.702641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20819606-e4ef-45ca-af41-29afd971fafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:51.721103 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20819606-e4ef-45ca-af41-29afd971fafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:51.722583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20819606-e4ef-45ca-af41-29afd971fafe service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:51.733097 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1154/2330] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:05:52.356780 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdd413-7e3f-455a-a8b5-eeb87d7e1aad service nova] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:52.358236 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6bbdd413-7e3f-455a-a8b5-eeb87d7e1aad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:52.384587 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdd413-7e3f-455a-a8b5-eeb87d7e1aad service nova] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:52.393840 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e21ea60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:52.406281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:52.406281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:52.406281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] PATH_INFO: `/v3/projects/bf975eaa2fc94e2d86edc79de21a4f89` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:52.406281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf975eaa2fc94e2d86edc79de21a4f89)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:52.406281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:52.599049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf975eaa2fc94e2d86edc79de21a4f89', 'request_id': 'req-cab28f27-8051-4ddc-9c75-e5f47a9025cd'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:52.681426 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf975eaa2fc94e2d86edc79de21a4f89', 'request_id': 'req-cab28f27-8051-4ddc-9c75-e5f47a9025cd'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:52.718112 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf975eaa2fc94e2d86edc79de21a4f89', 'request_id': 'req-cab28f27-8051-4ddc-9c75-e5f47a9025cd'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:52.731082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] The token cache is being invalidate because project bf975eaa2fc94e2d86edc79de21a4f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:52.731412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:52.736469 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:52.738017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1177/2331] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:52 2022] DELETE /identity/v3/projects/bf975eaa2fc94e2d86edc79de21a4f89 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:52.742845 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20819606-e4ef-45ca-af41-29afd971fafe service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:52.757796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20819606-e4ef-45ca-af41-29afd971fafe service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:52.839589 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09df0b790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:52.841472 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:52.843984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:52.844507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] PATH_INFO: `/v3/users/0513ff442ea04232998541c8bd3cd6fd` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:52.847240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0513ff442ea04232998541c8bd3cd6fd)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:52.849817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:53.125608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0513ff442ea04232998541c8bd3cd6fd'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:53.232716 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0513ff442ea04232998541c8bd3cd6fd'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:53.252649 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0513ff442ea04232998541c8bd3cd6fd'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:53.265701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0513ff442ea04232998541c8bd3cd6fd'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:53.266741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0513ff442ea04232998541c8bd3cd6fd'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:53.294240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1155/2332] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:52 2022] DELETE /identity/v3/users/0513ff442ea04232998541c8bd3cd6fd => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:53.849232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:53.851686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:53.914063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:53.919811 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:53.996308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab28f27-8051-4ddc-9c75-e5f47a9025cd admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:54.029073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05943f18-c422-4779-b5e9-4fca25768271 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:54.033402 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3ozRfJ5TQLqns3Lmq0fb0A, audit_chain_id=['3ozRfJ5TQLqns3Lmq0fb0A']) at 0x7fe09e15bc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:54.034220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:54.034503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:54.034781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] PATH_INFO: `/v3/projects/277db3fde8b745d7aae8e88c2ecd5ebb` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:54.035914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=277db3fde8b745d7aae8e88c2ecd5ebb)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:54.037832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:54.074707 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43527f-29cf-401b-8f76-0b0e3806cd39 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ssm7VzDT9edw-HueWInDg, audit_chain_id=['5ssm7VzDT9edw-HueWInDg']) at 0x7fe09e4442e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:54.075832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43527f-29cf-401b-8f76-0b0e3806cd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:54.076202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43527f-29cf-401b-8f76-0b0e3806cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:54.076580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43527f-29cf-401b-8f76-0b0e3806cd39 admin admin] PATH_INFO: `/v3/users/aed9d826a114442aad8317db0baf763f` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:54.077796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43527f-29cf-401b-8f76-0b0e3806cd39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed9d826a114442aad8317db0baf763f)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:54.079812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43527f-29cf-401b-8f76-0b0e3806cd39 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:54.394269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0b43527f-29cf-401b-8f76-0b0e3806cd39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed9d826a114442aad8317db0baf763f'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:54.395203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277db3fde8b745d7aae8e88c2ecd5ebb', 'request_id': 'req-5720a580-e45b-48aa-8ec4-24fc0bd286ea'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:54.407812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277db3fde8b745d7aae8e88c2ecd5ebb', 'request_id': 'req-5720a580-e45b-48aa-8ec4-24fc0bd286ea'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:54.408743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0b43527f-29cf-401b-8f76-0b0e3806cd39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed9d826a114442aad8317db0baf763f'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:54.409448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0b43527f-29cf-401b-8f76-0b0e3806cd39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed9d826a114442aad8317db0baf763f'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:54.410050 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0b43527f-29cf-401b-8f76-0b0e3806cd39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed9d826a114442aad8317db0baf763f'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:54.523459 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277db3fde8b745d7aae8e88c2ecd5ebb', 'request_id': 'req-5720a580-e45b-48aa-8ec4-24fc0bd286ea'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:54.533936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] The token cache is being invalidate because project 277db3fde8b745d7aae8e88c2ecd5ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:54.538263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:54.538263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5720a580-e45b-48aa-8ec4-24fc0bd286ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:54.538263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1156/2333] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:53 2022] DELETE /identity/v3/projects/277db3fde8b745d7aae8e88c2ecd5ebb => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:05:54.541791 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5f27-3c1b-4d49-b30a-57ee68ba3bcc None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:54.542090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5f27-3c1b-4d49-b30a-57ee68ba3bcc None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:54.542378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5f27-3c1b-4d49-b30a-57ee68ba3bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:54.565616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e26b5f27-3c1b-4d49-b30a-57ee68ba3bcc None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:54.566819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e26b5f27-3c1b-4d49-b30a-57ee68ba3bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:54.626745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0b43527f-29cf-401b-8f76-0b0e3806cd39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed9d826a114442aad8317db0baf763f'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:54.631639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1157/2334] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:05:54.640304 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7787ca4-37a0-4d28-837c-ff238aac1347 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:54.640594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7787ca4-37a0-4d28-837c-ff238aac1347 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:54.640882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7787ca4-37a0-4d28-837c-ff238aac1347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:54.644174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1178/2335] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:05:53 2022] DELETE /identity/v3/users/aed9d826a114442aad8317db0baf763f => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:54.645590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9a9e9-8a1c-450d-838f-a0cbfc477723 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:54.645891 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9a9e9-8a1c-450d-838f-a0cbfc477723 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:54.646180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9a9e9-8a1c-450d-838f-a0cbfc477723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:54.666853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d7787ca4-37a0-4d28-837c-ff238aac1347 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:54.668090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d7787ca4-37a0-4d28-837c-ff238aac1347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:54.677910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-24c9a9e9-8a1c-450d-838f-a0cbfc477723 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:54.678933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-24c9a9e9-8a1c-450d-838f-a0cbfc477723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:54.768909 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1158/2336] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:05:54.775980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1179/2337] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:54.785424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7787ca4-37a0-4d28-837c-ff238aac1347 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:54.792003 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9a9e9-8a1c-450d-838f-a0cbfc477723 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:54.793487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-24c9a9e9-8a1c-450d-838f-a0cbfc477723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:54.795855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7787ca4-37a0-4d28-837c-ff238aac1347 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:54.800835 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7998b0-5e13-4b4e-9a0b-5e664113338b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09e8fa340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:54.801565 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7998b0-5e13-4b4e-9a0b-5e664113338b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:54.801946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7998b0-5e13-4b4e-9a0b-5e664113338b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:54.802327 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7998b0-5e13-4b4e-9a0b-5e664113338b admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:54.803347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7998b0-5e13-4b4e-9a0b-5e664113338b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:05:54.809252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7998b0-5e13-4b4e-9a0b-5e664113338b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:54.809252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7998b0-5e13-4b4e-9a0b-5e664113338b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:54.819953 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1159/2338] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:05:54.827280 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7998b0-5e13-4b4e-9a0b-5e664113338b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:54.838386 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7998b0-5e13-4b4e-9a0b-5e664113338b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:54.842910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25ac0a-8a3e-48b0-a20a-00d1b8bc3435 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09e716250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:54.843467 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25ac0a-8a3e-48b0-a20a-00d1b8bc3435 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:54.843752 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25ac0a-8a3e-48b0-a20a-00d1b8bc3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:54.849058 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25ac0a-8a3e-48b0-a20a-00d1b8bc3435 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:54.849058 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25ac0a-8a3e-48b0-a20a-00d1b8bc3435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:54.849058 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25ac0a-8a3e-48b0-a20a-00d1b8bc3435 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:54.910024 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9a9e9-8a1c-450d-838f-a0cbfc477723 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:54.914537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b46544-35d8-4c0d-ba86-826b1b7c3592 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09de50910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:54.915265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b46544-35d8-4c0d-ba86-826b1b7c3592 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:54.915882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b46544-35d8-4c0d-ba86-826b1b7c3592 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:54.916241 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b46544-35d8-4c0d-ba86-826b1b7c3592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:54.926692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b46544-35d8-4c0d-ba86-826b1b7c3592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:54.928363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b46544-35d8-4c0d-ba86-826b1b7c3592 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:54.939647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1180/2339] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:54.972630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1160/2340] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:54 2022] POST /identity/v3/projects => generated 391 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:54.978542 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b46544-35d8-4c0d-ba86-826b1b7c3592 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:54.988500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b46544-35d8-4c0d-ba86-826b1b7c3592 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:55.084971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821bd11-c88d-4b53-922d-bf3844e08993 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09defe460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:55.086341 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821bd11-c88d-4b53-922d-bf3844e08993 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:55.086640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821bd11-c88d-4b53-922d-bf3844e08993 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:55.086925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821bd11-c88d-4b53-922d-bf3844e08993 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:55.087647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821bd11-c88d-4b53-922d-bf3844e08993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:55.089795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821bd11-c88d-4b53-922d-bf3844e08993 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:55.188675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1181/2341] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:54 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:55.190109 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25ac0a-8a3e-48b0-a20a-00d1b8bc3435 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:55.201761 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25ac0a-8a3e-48b0-a20a-00d1b8bc3435 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:55.206855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f239c-ff9f-4057-9687-3b529f0d8512 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09e8a0700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:55.207597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f239c-ff9f-4057-9687-3b529f0d8512 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:55.208128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f239c-ff9f-4057-9687-3b529f0d8512 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:55.208491 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f239c-ff9f-4057-9687-3b529f0d8512 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:55.209288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f239c-ff9f-4057-9687-3b529f0d8512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:55.211001 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f239c-ff9f-4057-9687-3b529f0d8512 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:55.222250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1161/2342] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:55.228048 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821bd11-c88d-4b53-922d-bf3844e08993 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:55.255408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821bd11-c88d-4b53-922d-bf3844e08993 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:55.263966 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e30d9-4c57-43ea-9e33-52f3f2f92144 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09df24130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:55.264828 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e30d9-4c57-43ea-9e33-52f3f2f92144 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:55.265301 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e30d9-4c57-43ea-9e33-52f3f2f92144 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:55.265846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e30d9-4c57-43ea-9e33-52f3f2f92144 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:55.266885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e30d9-4c57-43ea-9e33-52f3f2f92144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:55.269343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e30d9-4c57-43ea-9e33-52f3f2f92144 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:55.296528 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1182/2343] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:55.297463 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f239c-ff9f-4057-9687-3b529f0d8512 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:55.334484 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f239c-ff9f-4057-9687-3b529f0d8512 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:55.341107 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110b43a-e995-4c23-8c1c-892bbc0af58b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09e1622e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:55.341962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110b43a-e995-4c23-8c1c-892bbc0af58b admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:55.342247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110b43a-e995-4c23-8c1c-892bbc0af58b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:55.342530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110b43a-e995-4c23-8c1c-892bbc0af58b admin admin] PATH_INFO: `/v3/projects/a6814a93605646409c18dd6dcb0482fe/users/88fa938bb86344d6a4110581921f6e56/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:55.363675 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110b43a-e995-4c23-8c1c-892bbc0af58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6814a93605646409c18dd6dcb0482fe, user_id=88fa938bb86344d6a4110581921f6e56, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:55.366338 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110b43a-e995-4c23-8c1c-892bbc0af58b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:55.449717 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1162/2344] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:55 2022] PUT /identity/v3/projects/a6814a93605646409c18dd6dcb0482fe/users/88fa938bb86344d6a4110581921f6e56/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:55.453752 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27a770-e017-4300-88cb-7d6e0f30df3d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:55.454047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27a770-e017-4300-88cb-7d6e0f30df3d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:55.454951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27a770-e017-4300-88cb-7d6e0f30df3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:55.498410 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-0b27a770-e017-4300-88cb-7d6e0f30df3d None None] MFA Rules not processed for user `88fa938bb86344d6a4110581921f6e56`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:55.499632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0b27a770-e017-4300-88cb-7d6e0f30df3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:55.579175 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1183/2345] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:55 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:55.584351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110b43a-e995-4c23-8c1c-892bbc0af58b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:55.659861 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110b43a-e995-4c23-8c1c-892bbc0af58b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:55.665904 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907cb7c-b7b1-4e79-b54e-dde99d81d4cd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09e424400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:55.666512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907cb7c-b7b1-4e79-b54e-dde99d81d4cd admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:55.666810 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907cb7c-b7b1-4e79-b54e-dde99d81d4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:55.667136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907cb7c-b7b1-4e79-b54e-dde99d81d4cd admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:55.667917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907cb7c-b7b1-4e79-b54e-dde99d81d4cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:55.669849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907cb7c-b7b1-4e79-b54e-dde99d81d4cd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:55.694043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27a770-e017-4300-88cb-7d6e0f30df3d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:55.696903 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0b27a770-e017-4300-88cb-7d6e0f30df3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:55.711879 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27a770-e017-4300-88cb-7d6e0f30df3d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:55.716429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5ssm7VzDT9edw-HueWInDg, audit_chain_id=['5ssm7VzDT9edw-HueWInDg']) at 0x7fe09e444430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:55.717336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:55.717621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:55.717902 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] PATH_INFO: `/v3/projects/7ac6f31da7034994a1845c66cd600b6b` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:55.719042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac6f31da7034994a1845c66cd600b6b)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:55.721090 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:55.749518 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1163/2346] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:05:55 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:05:55.753477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907cb7c-b7b1-4e79-b54e-dde99d81d4cd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:55.825679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907cb7c-b7b1-4e79-b54e-dde99d81d4cd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:55.830752 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d32e7-7345-4203-8eb9-506a31885958 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09e3dcd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:55.831696 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d32e7-7345-4203-8eb9-506a31885958 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:55.832354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d32e7-7345-4203-8eb9-506a31885958 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:55.832673 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d32e7-7345-4203-8eb9-506a31885958 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:55.833713 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d32e7-7345-4203-8eb9-506a31885958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:55.836494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d32e7-7345-4203-8eb9-506a31885958 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:55.842344 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac6f31da7034994a1845c66cd600b6b', 'request_id': 'req-0570e745-a674-475d-a8e4-6107c12c7c3d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:55.938888 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac6f31da7034994a1845c66cd600b6b', 'request_id': 'req-0570e745-a674-475d-a8e4-6107c12c7c3d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:55.949668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1164/2347] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:05:55 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:05:55.950746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d32e7-7345-4203-8eb9-506a31885958 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:55.952885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac6f31da7034994a1845c66cd600b6b', 'request_id': 'req-0570e745-a674-475d-a8e4-6107c12c7c3d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:55.963662 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] The token cache is being invalidate because project 7ac6f31da7034994a1845c66cd600b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:05:55.965142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:55.965142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:05:55.966407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1184/2348] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:05:55 2022] DELETE /identity/v3/projects/7ac6f31da7034994a1845c66cd600b6b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:55.969153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d32e7-7345-4203-8eb9-506a31885958 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:56.050039 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2592cd-0181-42a2-83f4-bcff4c6ee871 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09e8873d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:56.050760 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2592cd-0181-42a2-83f4-bcff4c6ee871 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:56.050944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2592cd-0181-42a2-83f4-bcff4c6ee871 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:56.051261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2592cd-0181-42a2-83f4-bcff4c6ee871 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:56.051983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2592cd-0181-42a2-83f4-bcff4c6ee871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:56.053612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2592cd-0181-42a2-83f4-bcff4c6ee871 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:56.065603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1165/2349] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:05:56.070209 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:56.071679 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:56.084382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e745-a674-475d-a8e4-6107c12c7c3d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:56.089488 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61febc2c-1149-4360-96bb-51156c2dc49f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09e21e070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:56.090336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61febc2c-1149-4360-96bb-51156c2dc49f admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:56.090627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61febc2c-1149-4360-96bb-51156c2dc49f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:56.090910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61febc2c-1149-4360-96bb-51156c2dc49f admin admin] PATH_INFO: `/v3/projects/0724b73b968f4184816cb049eb6b0e63/users/3d73789df35d45f5beb6b1227edd1051/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:56.112397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61febc2c-1149-4360-96bb-51156c2dc49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0724b73b968f4184816cb049eb6b0e63, user_id=3d73789df35d45f5beb6b1227edd1051, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:56.115087 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61febc2c-1149-4360-96bb-51156c2dc49f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:56.187495 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1185/2350] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:56 2022] PUT /identity/v3/projects/0724b73b968f4184816cb049eb6b0e63/users/3d73789df35d45f5beb6b1227edd1051/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:05:56.191458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2592cd-0181-42a2-83f4-bcff4c6ee871 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:56.201363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2592cd-0181-42a2-83f4-bcff4c6ee871 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:56.264381 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571de545-24e7-48ac-9548-b90954669256 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09de8eee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:56.264973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571de545-24e7-48ac-9548-b90954669256 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:56.265258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571de545-24e7-48ac-9548-b90954669256 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:56.265542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571de545-24e7-48ac-9548-b90954669256 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:56.266363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571de545-24e7-48ac-9548-b90954669256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:56.267968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571de545-24e7-48ac-9548-b90954669256 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:56.278427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1166/2351] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:05:56.282660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61febc2c-1149-4360-96bb-51156c2dc49f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:56.293905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61febc2c-1149-4360-96bb-51156c2dc49f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:56.298265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805bdab-8b3c-4440-b9bb-219776578279 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09df24070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:56.299086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805bdab-8b3c-4440-b9bb-219776578279 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:56.299409 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805bdab-8b3c-4440-b9bb-219776578279 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:56.299696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805bdab-8b3c-4440-b9bb-219776578279 admin admin] PATH_INFO: `/v3/projects/0724b73b968f4184816cb049eb6b0e63/users/3d73789df35d45f5beb6b1227edd1051/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:56.301552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805bdab-8b3c-4440-b9bb-219776578279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0724b73b968f4184816cb049eb6b0e63, user_id=3d73789df35d45f5beb6b1227edd1051, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:56.304551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805bdab-8b3c-4440-b9bb-219776578279 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:56.314555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1186/2352] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:05:56 2022] PUT /identity/v3/projects/0724b73b968f4184816cb049eb6b0e63/users/3d73789df35d45f5beb6b1227edd1051/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:56.324626 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8b35a-fae4-41e8-85a5-a34c942dc08d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:56.324920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8b35a-fae4-41e8-85a5-a34c942dc08d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:56.325203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8b35a-fae4-41e8-85a5-a34c942dc08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:56.361209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-65b8b35a-fae4-41e8-85a5-a34c942dc08d None None] MFA Rules not processed for user `3d73789df35d45f5beb6b1227edd1051`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:05:56.362351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-65b8b35a-fae4-41e8-85a5-a34c942dc08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:56.435555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1167/2353] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:05:56 2022] POST /identity/v3/auth/tokens => generated 3763 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:05:56.445551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805bdab-8b3c-4440-b9bb-219776578279 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:56.447309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7805bdab-8b3c-4440-b9bb-219776578279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:56.511268 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805bdab-8b3c-4440-b9bb-219776578279 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:56.514897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694c2fe-aced-44a0-ae21-211d1e892fc5 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09dec3910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:56.515512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c2fe-aced-44a0-ae21-211d1e892fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:56.515803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c2fe-aced-44a0-ae21-211d1e892fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:56.516086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c2fe-aced-44a0-ae21-211d1e892fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:56.525388 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694c2fe-aced-44a0-ae21-211d1e892fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:56.526807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694c2fe-aced-44a0-ae21-211d1e892fc5 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:56.535731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1187/2354] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:56 2022] GET /identity/v3/auth/tokens => generated 3763 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:05:56.581041 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8b35a-fae4-41e8-85a5-a34c942dc08d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:56.582407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-65b8b35a-fae4-41e8-85a5-a34c942dc08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:56.595060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8b35a-fae4-41e8-85a5-a34c942dc08d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:56.598510 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edbb54-85f8-480e-b7cd-7ef47035d709 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e922fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:56.599076 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edbb54-85f8-480e-b7cd-7ef47035d709 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:56.599390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edbb54-85f8-480e-b7cd-7ef47035d709 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:56.599671 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edbb54-85f8-480e-b7cd-7ef47035d709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:56.601481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c6edbb54-85f8-480e-b7cd-7ef47035d709 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:56.669129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edbb54-85f8-480e-b7cd-7ef47035d709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:56.670562 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edbb54-85f8-480e-b7cd-7ef47035d709 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:05:56.679458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1168/2355] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:56 2022] GET /identity/v3/auth/tokens => generated 3698 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:06:03.066163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694c2fe-aced-44a0-ae21-211d1e892fc5 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:03.067702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-5694c2fe-aced-44a0-ae21-211d1e892fc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:03.142783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694c2fe-aced-44a0-ae21-211d1e892fc5 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:03.147182 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mO489CYPSoqlyneKL0ZMTw, audit_chain_id=['mO489CYPSoqlyneKL0ZMTw']) at 0x7fe09e108ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:03.148545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:03.148814 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:03.149095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] PATH_INFO: `/v3/users/56639281fd2748af8c8641afd706dac2` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:03.150191 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=56639281fd2748af8c8641afd706dac2)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:03.152137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:03.315859 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56639281fd2748af8c8641afd706dac2'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:03.329711 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56639281fd2748af8c8641afd706dac2'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:03.330418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56639281fd2748af8c8641afd706dac2'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:03.331026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56639281fd2748af8c8641afd706dac2'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:03.409578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56639281fd2748af8c8641afd706dac2'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:03.426497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1188/2356] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:03 2022] DELETE /identity/v3/users/56639281fd2748af8c8641afd706dac2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:03.428525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1f2e3-8ac9-4048-96eb-40443d34da60 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:03.429040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1f2e3-8ac9-4048-96eb-40443d34da60 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:03.429285 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1f2e3-8ac9-4048-96eb-40443d34da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:03.452983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-9dd1f2e3-8ac9-4048-96eb-40443d34da60 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:03.454146 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9dd1f2e3-8ac9-4048-96eb-40443d34da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:03.523361 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1169/2357] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:03.533936 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:03.535397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:03.603709 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4f95-b05d-4a25-8182-34aa1e304fbb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:03.607215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4549853-e8a5-4cc5-96df-2a5b59bf35be service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e4ff880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:03.607828 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4549853-e8a5-4cc5-96df-2a5b59bf35be service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:03.608119 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4549853-e8a5-4cc5-96df-2a5b59bf35be service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:03.608408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4549853-e8a5-4cc5-96df-2a5b59bf35be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:03.618333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4549853-e8a5-4cc5-96df-2a5b59bf35be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:03.619801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4549853-e8a5-4cc5-96df-2a5b59bf35be service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:03.629586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1189/2358] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:04.107168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1f2e3-8ac9-4048-96eb-40443d34da60 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:04.117678 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9dd1f2e3-8ac9-4048-96eb-40443d34da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:04.119781 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1f2e3-8ac9-4048-96eb-40443d34da60 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:04.124206 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626defcc-658c-4f02-86c5-26b32de91af4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09ea9b550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:04.125004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626defcc-658c-4f02-86c5-26b32de91af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:04.125292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626defcc-658c-4f02-86c5-26b32de91af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:04.125575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626defcc-658c-4f02-86c5-26b32de91af4 admin admin] PATH_INFO: `/v3/users/88fa938bb86344d6a4110581921f6e56` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:04.126691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626defcc-658c-4f02-86c5-26b32de91af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88fa938bb86344d6a4110581921f6e56)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:04.128709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626defcc-658c-4f02-86c5-26b32de91af4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:04.305071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4549853-e8a5-4cc5-96df-2a5b59bf35be service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:04.306622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e4549853-e8a5-4cc5-96df-2a5b59bf35be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:04.320163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4549853-e8a5-4cc5-96df-2a5b59bf35be service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:04.325006 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mO489CYPSoqlyneKL0ZMTw, audit_chain_id=['mO489CYPSoqlyneKL0ZMTw']) at 0x7fe09e8e06a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:04.325793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:04.326081 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:04.326363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] PATH_INFO: `/v3/projects/ed3431e3511e454e862f3a373ad0b5f0` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:04.327503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3431e3511e454e862f3a373ad0b5f0)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:04.329423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:04.334913 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-626defcc-658c-4f02-86c5-26b32de91af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88fa938bb86344d6a4110581921f6e56'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:04.410014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-626defcc-658c-4f02-86c5-26b32de91af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88fa938bb86344d6a4110581921f6e56'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:04.422663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-626defcc-658c-4f02-86c5-26b32de91af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88fa938bb86344d6a4110581921f6e56'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:04.423363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-626defcc-658c-4f02-86c5-26b32de91af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88fa938bb86344d6a4110581921f6e56'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:04.423980 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-626defcc-658c-4f02-86c5-26b32de91af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88fa938bb86344d6a4110581921f6e56'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:04.437318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1170/2359] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:04 2022] DELETE /identity/v3/users/88fa938bb86344d6a4110581921f6e56 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:04.441804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5fa94-9ccb-4842-9c60-2628b887f6d6 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:04.442106 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5fa94-9ccb-4842-9c60-2628b887f6d6 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:04.442419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5fa94-9ccb-4842-9c60-2628b887f6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:04.466223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-7cf5fa94-9ccb-4842-9c60-2628b887f6d6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:04.467506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7cf5fa94-9ccb-4842-9c60-2628b887f6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:04.496644 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3431e3511e454e862f3a373ad0b5f0', 'request_id': 'req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:04.535054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1171/2360] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:06:04.546088 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5fa94-9ccb-4842-9c60-2628b887f6d6 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:04.547458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7cf5fa94-9ccb-4842-9c60-2628b887f6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:04.614329 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5fa94-9ccb-4842-9c60-2628b887f6d6 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:04.622192 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3431e3511e454e862f3a373ad0b5f0', 'request_id': 'req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:04.629592 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3431e3511e454e862f3a373ad0b5f0', 'request_id': 'req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:04.641589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] The token cache is being invalidate because project ed3431e3511e454e862f3a373ad0b5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:04.641932 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:04.642694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-47e27bc3-0acd-48d6-add9-e20a7f5b1dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:04.644408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1190/2361] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:04 2022] DELETE /identity/v3/projects/ed3431e3511e454e862f3a373ad0b5f0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:04.651356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21b4cd-3612-43e4-86bc-fdc9f6d09567 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:04.653457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21b4cd-3612-43e4-86bc-fdc9f6d09567 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:04.653457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21b4cd-3612-43e4-86bc-fdc9f6d09567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:04.675067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-0e21b4cd-3612-43e4-86bc-fdc9f6d09567 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:04.675544 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abdaad-2263-4096-98ce-cae91454fbe1 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e50f160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:04.676143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abdaad-2263-4096-98ce-cae91454fbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:04.676299 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0e21b4cd-3612-43e4-86bc-fdc9f6d09567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:04.676439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abdaad-2263-4096-98ce-cae91454fbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:04.676730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abdaad-2263-4096-98ce-cae91454fbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:04.678459 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-35abdaad-2263-4096-98ce-cae91454fbe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:04.743653 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1191/2362] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:04.750995 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4756eee-1d90-421b-aef2-62a33d7468ba None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:04.751325 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4756eee-1d90-421b-aef2-62a33d7468ba None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:04.751610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4756eee-1d90-421b-aef2-62a33d7468ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:04.759961 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abdaad-2263-4096-98ce-cae91454fbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:04.764049 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abdaad-2263-4096-98ce-cae91454fbe1 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:04.775219 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-b4756eee-1d90-421b-aef2-62a33d7468ba None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:04.776041 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b4756eee-1d90-421b-aef2-62a33d7468ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:04.776489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1172/2363] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:04.783939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1192/2364] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:06:04.788115 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abdaad-2263-4096-98ce-cae91454fbe1 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:04.798572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abdaad-2263-4096-98ce-cae91454fbe1 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:04.803107 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a017ec5-f1a5-458a-9cec-aa6912b6fdab admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09e3dc0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:04.804779 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017ec5-f1a5-458a-9cec-aa6912b6fdab admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:04.804779 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017ec5-f1a5-458a-9cec-aa6912b6fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:04.805041 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017ec5-f1a5-458a-9cec-aa6912b6fdab admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:04.805843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a017ec5-f1a5-458a-9cec-aa6912b6fdab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:06:04.806023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a017ec5-f1a5-458a-9cec-aa6912b6fdab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:04.807658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a017ec5-f1a5-458a-9cec-aa6912b6fdab admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:04.821955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1173/2365] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:06:04.826638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4756eee-1d90-421b-aef2-62a33d7468ba None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:04.836567 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4756eee-1d90-421b-aef2-62a33d7468ba None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:04.841374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e71bb-165e-4570-8f8d-ac081d54a917 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09e45d430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:04.842094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e71bb-165e-4570-8f8d-ac081d54a917 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:04.842393 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e71bb-165e-4570-8f8d-ac081d54a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:04.842799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e71bb-165e-4570-8f8d-ac081d54a917 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:04.843877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e71bb-165e-4570-8f8d-ac081d54a917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:04.845514 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e71bb-165e-4570-8f8d-ac081d54a917 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:04.949578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1193/2366] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:04 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:06:04.954589 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a017ec5-f1a5-458a-9cec-aa6912b6fdab admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:04.966336 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a017ec5-f1a5-458a-9cec-aa6912b6fdab admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:05.031399 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3ca8c-b0ef-45c3-9fb1-01bf6311a6dd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09e9224f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:05.032802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3ca8c-b0ef-45c3-9fb1-01bf6311a6dd admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:05.033198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3ca8c-b0ef-45c3-9fb1-01bf6311a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:05.034353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3ca8c-b0ef-45c3-9fb1-01bf6311a6dd admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:05.034945 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3ca8c-b0ef-45c3-9fb1-01bf6311a6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:05.036977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3ca8c-b0ef-45c3-9fb1-01bf6311a6dd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:05.108065 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1174/2367] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:04 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:05.112645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e71bb-165e-4570-8f8d-ac081d54a917 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:05.125308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e71bb-165e-4570-8f8d-ac081d54a917 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:05.130085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fee12-3aaa-4b87-80d8-b45d15ec9407 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09e9d16d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:05.130801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fee12-3aaa-4b87-80d8-b45d15ec9407 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:05.131226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fee12-3aaa-4b87-80d8-b45d15ec9407 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:05.131643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fee12-3aaa-4b87-80d8-b45d15ec9407 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:05.133711 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fee12-3aaa-4b87-80d8-b45d15ec9407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:05.135551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fee12-3aaa-4b87-80d8-b45d15ec9407 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:05.150471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1194/2368] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:05.151477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3ca8c-b0ef-45c3-9fb1-01bf6311a6dd admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:05.161762 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3ca8c-b0ef-45c3-9fb1-01bf6311a6dd admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:05.166889 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c092212-74c1-487a-8817-3fa597ecf500 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09e37fac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:05.167647 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c092212-74c1-487a-8817-3fa597ecf500 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:05.167939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c092212-74c1-487a-8817-3fa597ecf500 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:05.168830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c092212-74c1-487a-8817-3fa597ecf500 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:05.168962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c092212-74c1-487a-8817-3fa597ecf500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:05.170533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c092212-74c1-487a-8817-3fa597ecf500 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:05.181462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1175/2369] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:05.189757 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fee12-3aaa-4b87-80d8-b45d15ec9407 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:05.200939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fee12-3aaa-4b87-80d8-b45d15ec9407 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:05.205427 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b13ef7-ea03-42b8-97c0-57ec91854269 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09df24100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:05.206237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b13ef7-ea03-42b8-97c0-57ec91854269 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:05.215374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b13ef7-ea03-42b8-97c0-57ec91854269 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:05.215374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b13ef7-ea03-42b8-97c0-57ec91854269 admin admin] PATH_INFO: `/v3/projects/d8166b11a7f5496893f560152bde4e67/users/e928e7768e77425cbde213a6990c2078/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:05.226912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b13ef7-ea03-42b8-97c0-57ec91854269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8166b11a7f5496893f560152bde4e67, user_id=e928e7768e77425cbde213a6990c2078, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:05.229788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b13ef7-ea03-42b8-97c0-57ec91854269 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:05.328193 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c092212-74c1-487a-8817-3fa597ecf500 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:05.333091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9c092212-74c1-487a-8817-3fa597ecf500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:05.348166 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c092212-74c1-487a-8817-3fa597ecf500 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:05.354132 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09de6cbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:05.354939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:05.355257 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:05.355537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] PATH_INFO: `/v3/projects/a6814a93605646409c18dd6dcb0482fe` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:05.356745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6814a93605646409c18dd6dcb0482fe)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:05.358801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1195/2370] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:05 2022] PUT /identity/v3/projects/d8166b11a7f5496893f560152bde4e67/users/e928e7768e77425cbde213a6990c2078/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:05.361728 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:05.370580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23887688-682d-4315-9d1a-2c72e8e4c43d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:05.370900 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23887688-682d-4315-9d1a-2c72e8e4c43d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:05.371232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23887688-682d-4315-9d1a-2c72e8e4c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:05.412259 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-23887688-682d-4315-9d1a-2c72e8e4c43d None None] MFA Rules not processed for user `e928e7768e77425cbde213a6990c2078`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:05.414290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-23887688-682d-4315-9d1a-2c72e8e4c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:05.489129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1196/2371] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:05 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:06:05.494030 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23887688-682d-4315-9d1a-2c72e8e4c43d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:05.499424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6814a93605646409c18dd6dcb0482fe', 'request_id': 'req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:05.510612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6814a93605646409c18dd6dcb0482fe', 'request_id': 'req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:05.566497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23887688-682d-4315-9d1a-2c72e8e4c43d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:05.575426 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6814a93605646409c18dd6dcb0482fe', 'request_id': 'req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:05.587276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] The token cache is being invalidate because project a6814a93605646409c18dd6dcb0482fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:05.587616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:05.588203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0fed0dde-cbc2-41c0-80c6-6c3035ef10b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:05.592640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1176/2372] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:05 2022] DELETE /identity/v3/projects/a6814a93605646409c18dd6dcb0482fe => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:05.592640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877359a-f831-4b6d-bcc8-cd5be671edc9 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:05.592640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877359a-f831-4b6d-bcc8-cd5be671edc9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:05.592640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877359a-f831-4b6d-bcc8-cd5be671edc9 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:05.598824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1177/2373] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 19:06:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:06:05.599471 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877359a-f831-4b6d-bcc8-cd5be671edc9 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:05.601148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5877359a-f831-4b6d-bcc8-cd5be671edc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:05.634232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ffb2d-94ea-45c7-935e-b8608326cd5d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09e540b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:05.634983 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ffb2d-94ea-45c7-935e-b8608326cd5d admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:05.635463 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ffb2d-94ea-45c7-935e-b8608326cd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:05.639575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ffb2d-94ea-45c7-935e-b8608326cd5d admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:05.640307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ffb2d-94ea-45c7-935e-b8608326cd5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:05.642292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ffb2d-94ea-45c7-935e-b8608326cd5d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:05.677263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877359a-f831-4b6d-bcc8-cd5be671edc9 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:05.681744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe09e3e2820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:05.682567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:05.682856 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:05.683170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] PATH_INFO: `/v3/users/3d73789df35d45f5beb6b1227edd1051` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:05.684291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d73789df35d45f5beb6b1227edd1051)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:05.686194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:05.725121 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1197/2374] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:05 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:05.726543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e7c5-9295-4d24-9f22-39be25d7b625 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:05.726832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e7c5-9295-4d24-9f22-39be25d7b625 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:05.727197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e7c5-9295-4d24-9f22-39be25d7b625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:05.777667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-2b39e7c5-9295-4d24-9f22-39be25d7b625 None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:05.778837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2b39e7c5-9295-4d24-9f22-39be25d7b625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:05.853041 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1198/2375] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 19:06:05 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:05.853812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e7c5-9295-4d24-9f22-39be25d7b625 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:05.855022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2b39e7c5-9295-4d24-9f22-39be25d7b625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:05.914912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d73789df35d45f5beb6b1227edd1051'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:05.925214 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e7c5-9295-4d24-9f22-39be25d7b625 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:05.930202 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8db8-0bec-47f3-95d9-33649a629368 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09e7b72e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:05.930807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8db8-0bec-47f3-95d9-33649a629368 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:05.931097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8db8-0bec-47f3-95d9-33649a629368 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:05.931414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8db8-0bec-47f3-95d9-33649a629368 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:05.932049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8db8-0bec-47f3-95d9-33649a629368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:05.933951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8db8-0bec-47f3-95d9-33649a629368 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:06.009954 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d73789df35d45f5beb6b1227edd1051'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:06.022030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d73789df35d45f5beb6b1227edd1051'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:06.022853 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d73789df35d45f5beb6b1227edd1051'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:06.023495 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d73789df35d45f5beb6b1227edd1051'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:06.036628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1178/2376] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:05 2022] DELETE /identity/v3/users/3d73789df35d45f5beb6b1227edd1051 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:06.042046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:06.042046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:06.042406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1199/2377] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:05 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:06.046459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8db8-0bec-47f3-95d9-33649a629368 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:06.048057 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e3cb8db8-0bec-47f3-95d9-33649a629368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:06.060892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8db8-0bec-47f3-95d9-33649a629368 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:06.112994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46d27c-a687-4c94-bfd5-ebe6d0a7a699 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:06.117369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77f776-5db0-4e93-be50-babd9a369f99 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=IAdTf7zmRlS7ZAE69VgzOQ, audit_chain_id=['IAdTf7zmRlS7ZAE69VgzOQ']) at 0x7fe09e472550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e956656659004428b3aaf23ae962f001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:06.117964 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f776-5db0-4e93-be50-babd9a369f99 service glance] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.118256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f776-5db0-4e93-be50-babd9a369f99 service glance] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.118541 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f776-5db0-4e93-be50-babd9a369f99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.120434 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-bd77f776-5db0-4e93-be50-babd9a369f99 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:06.128286 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04065b1f-5685-4052-80b8-4f78afcef5df admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09e50e0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:06.128900 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065b1f-5685-4052-80b8-4f78afcef5df admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.129314 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065b1f-5685-4052-80b8-4f78afcef5df admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.129607 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065b1f-5685-4052-80b8-4f78afcef5df admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.130309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04065b1f-5685-4052-80b8-4f78afcef5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:06.132052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04065b1f-5685-4052-80b8-4f78afcef5df admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:06.143237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1200/2378] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:06.147101 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04065b1f-5685-4052-80b8-4f78afcef5df admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:06.156767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04065b1f-5685-4052-80b8-4f78afcef5df admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:06.161260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f022452-cfff-46d4-9faa-1b485bd51b45 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09eae0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:06.162077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022452-cfff-46d4-9faa-1b485bd51b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.162439 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022452-cfff-46d4-9faa-1b485bd51b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.162730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022452-cfff-46d4-9faa-1b485bd51b45 admin admin] PATH_INFO: `/v3/projects/3ab2c81f04b344ce9acd80c60cfe45bb/users/df38935f18f54095b0f9ca196975260d/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.183474 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f022452-cfff-46d4-9faa-1b485bd51b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab2c81f04b344ce9acd80c60cfe45bb, user_id=df38935f18f54095b0f9ca196975260d, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:06.186118 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f022452-cfff-46d4-9faa-1b485bd51b45 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:06.204419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77f776-5db0-4e93-be50-babd9a369f99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:06.205858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77f776-5db0-4e93-be50-babd9a369f99 service glance] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:06.216247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1179/2379] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:06 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:06.329400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1201/2380] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:06 2022] PUT /identity/v3/projects/3ab2c81f04b344ce9acd80c60cfe45bb/users/df38935f18f54095b0f9ca196975260d/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:06.331838 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77f776-5db0-4e93-be50-babd9a369f99 service glance] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:06.342685 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77f776-5db0-4e93-be50-babd9a369f99 service glance] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:06.406922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af01f79-39dc-4a65-af29-28d56e24fba6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09e8faa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:06.407613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01f79-39dc-4a65-af29-28d56e24fba6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.407910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01f79-39dc-4a65-af29-28d56e24fba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.408244 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01f79-39dc-4a65-af29-28d56e24fba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.408955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01f79-39dc-4a65-af29-28d56e24fba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:06.410827 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01f79-39dc-4a65-af29-28d56e24fba6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:06.421672 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1180/2381] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:06.426011 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f022452-cfff-46d4-9faa-1b485bd51b45 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:06.436279 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f022452-cfff-46d4-9faa-1b485bd51b45 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:06.441212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b4a34-7848-495a-849e-5d63ac05d10c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09e118190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:06.442032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b4a34-7848-495a-849e-5d63ac05d10c admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.442324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b4a34-7848-495a-849e-5d63ac05d10c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.442612 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b4a34-7848-495a-849e-5d63ac05d10c admin admin] PATH_INFO: `/v3/projects/3ab2c81f04b344ce9acd80c60cfe45bb/users/df38935f18f54095b0f9ca196975260d/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.444960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b4a34-7848-495a-849e-5d63ac05d10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab2c81f04b344ce9acd80c60cfe45bb, user_id=df38935f18f54095b0f9ca196975260d, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:06.447610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b4a34-7848-495a-849e-5d63ac05d10c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:06.458137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1202/2382] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:06 2022] PUT /identity/v3/projects/3ab2c81f04b344ce9acd80c60cfe45bb/users/df38935f18f54095b0f9ca196975260d/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:06.468297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92eb28-1151-445a-8317-0e7e99c66f93 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.468597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92eb28-1151-445a-8317-0e7e99c66f93 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.468921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92eb28-1151-445a-8317-0e7e99c66f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.484850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8140e-250f-4cc1-b5a4-86136e115971 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.486337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8140e-250f-4cc1-b5a4-86136e115971 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.486337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8140e-250f-4cc1-b5a4-86136e115971 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.487179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1203/2383] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 19:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 19:06:06.492472 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac283a-1342-488a-9737-a1ea6571862a None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.492783 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac283a-1342-488a-9737-a1ea6571862a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.493066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac283a-1342-488a-9737-a1ea6571862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.509170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-ac92eb28-1151-445a-8317-0e7e99c66f93 None None] MFA Rules not processed for user `df38935f18f54095b0f9ca196975260d`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:06.510363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ac92eb28-1151-445a-8317-0e7e99c66f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:06.515222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f2ac283a-1342-488a-9737-a1ea6571862a None None] MFA Rules not processed for user `65a9c92fb5144e3dacc922eede1131fd`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:06.516369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f2ac283a-1342-488a-9737-a1ea6571862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:06.578515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1204/2384] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:06.595097 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac283a-1342-488a-9737-a1ea6571862a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:06.596558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f2ac283a-1342-488a-9737-a1ea6571862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:06.602836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1181/2385] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:06.603200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92eb28-1151-445a-8317-0e7e99c66f93 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:06.604521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ac92eb28-1151-445a-8317-0e7e99c66f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:06.615790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92eb28-1151-445a-8317-0e7e99c66f93 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:06.619958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a142b-83c3-41a7-966b-1ed96f6b3b51 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09eabbe50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:06.620531 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a142b-83c3-41a7-966b-1ed96f6b3b51 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.620817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a142b-83c3-41a7-966b-1ed96f6b3b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.621098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a142b-83c3-41a7-966b-1ed96f6b3b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.628567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a142b-83c3-41a7-966b-1ed96f6b3b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:06.629925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a142b-83c3-41a7-966b-1ed96f6b3b51 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:06.638128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1182/2386] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:06 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:06.641891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a142b-83c3-41a7-966b-1ed96f6b3b51 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:06.641891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-960a142b-83c3-41a7-966b-1ed96f6b3b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:06.693193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac283a-1342-488a-9737-a1ea6571862a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:06.699364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j1gwTPVUS_CxgrqJgUlptQ, audit_chain_id=['j1gwTPVUS_CxgrqJgUlptQ']) at 0x7fe0a2701c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:06.700827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.701180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.701535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] PATH_INFO: `/v3/projects/0724b73b968f4184816cb049eb6b0e63` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.702730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0724b73b968f4184816cb049eb6b0e63)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:06.704726 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:06.718207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a142b-83c3-41a7-966b-1ed96f6b3b51 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:06.728209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc286d8-8bf5-4353-bda2-2f6e4266a7b7 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e3c4820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:06.733400 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc286d8-8bf5-4353-bda2-2f6e4266a7b7 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.733400 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc286d8-8bf5-4353-bda2-2f6e4266a7b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.733400 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc286d8-8bf5-4353-bda2-2f6e4266a7b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.744603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc286d8-8bf5-4353-bda2-2f6e4266a7b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:06.746447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc286d8-8bf5-4353-bda2-2f6e4266a7b7 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:06.759529 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1183/2387] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:06 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:06.832945 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0724b73b968f4184816cb049eb6b0e63', 'request_id': 'req-701340d6-a90f-4e6b-af4a-f1ba115eae67'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:06.929285 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0724b73b968f4184816cb049eb6b0e63', 'request_id': 'req-701340d6-a90f-4e6b-af4a-f1ba115eae67'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:06.946710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0724b73b968f4184816cb049eb6b0e63', 'request_id': 'req-701340d6-a90f-4e6b-af4a-f1ba115eae67'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:06.958021 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] The token cache is being invalidate because project 0724b73b968f4184816cb049eb6b0e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:06.958309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:06.959002 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-701340d6-a90f-4e6b-af4a-f1ba115eae67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:06.961374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1205/2388] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:06 2022] DELETE /identity/v3/projects/0724b73b968f4184816cb049eb6b0e63 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:06.965914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370332-898b-4992-abc6-f63f833452f3 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:06.966216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370332-898b-4992-abc6-f63f833452f3 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:06.966507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370332-898b-4992-abc6-f63f833452f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:06.992198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e1370332-898b-4992-abc6-f63f833452f3 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:06.993375 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e1370332-898b-4992-abc6-f63f833452f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:07.065134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1184/2389] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:07.074524 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff661a-c426-4df0-99f6-7cfdd5a08786 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:07.074819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff661a-c426-4df0-99f6-7cfdd5a08786 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:07.075130 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff661a-c426-4df0-99f6-7cfdd5a08786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:07.098404 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-8eff661a-c426-4df0-99f6-7cfdd5a08786 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:07.099630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8eff661a-c426-4df0-99f6-7cfdd5a08786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:07.107080 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1206/2390] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:07.111279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370332-898b-4992-abc6-f63f833452f3 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:07.121551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370332-898b-4992-abc6-f63f833452f3 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:07.125914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3777a-9f5b-4b9b-9c4f-baefd8937b2d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09e3d5e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:07.126513 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3777a-9f5b-4b9b-9c4f-baefd8937b2d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:07.126809 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3777a-9f5b-4b9b-9c4f-baefd8937b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:07.127094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3777a-9f5b-4b9b-9c4f-baefd8937b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:07.127819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3777a-9f5b-4b9b-9c4f-baefd8937b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:06:07.128116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3777a-9f5b-4b9b-9c4f-baefd8937b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:07.129703 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3777a-9f5b-4b9b-9c4f-baefd8937b2d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:07.143292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1185/2391] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:06:07.147788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff661a-c426-4df0-99f6-7cfdd5a08786 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:07.157486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff661a-c426-4df0-99f6-7cfdd5a08786 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:07.161994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff8a8f-e15b-4a49-b191-d0372a169cd1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09de2fd90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:07.162628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff8a8f-e15b-4a49-b191-d0372a169cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:07.162920 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff8a8f-e15b-4a49-b191-d0372a169cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:07.163392 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff8a8f-e15b-4a49-b191-d0372a169cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:07.164029 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff8a8f-e15b-4a49-b191-d0372a169cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:07.166185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff8a8f-e15b-4a49-b191-d0372a169cd1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:07.281359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1207/2392] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:07 2022] POST /identity/v3/projects => generated 401 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:07.285557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3777a-9f5b-4b9b-9c4f-baefd8937b2d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:07.295868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3777a-9f5b-4b9b-9c4f-baefd8937b2d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:07.358515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61856e-57da-4f99-bf3c-4030ec3ef370 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09dd849a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:07.359147 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61856e-57da-4f99-bf3c-4030ec3ef370 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:07.359433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61856e-57da-4f99-bf3c-4030ec3ef370 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:07.359713 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61856e-57da-4f99-bf3c-4030ec3ef370 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:07.360357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61856e-57da-4f99-bf3c-4030ec3ef370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:07.362296 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61856e-57da-4f99-bf3c-4030ec3ef370 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:07.451873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1186/2393] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:07 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:06:07.455647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff8a8f-e15b-4a49-b191-d0372a169cd1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:07.466059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff8a8f-e15b-4a49-b191-d0372a169cd1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:07.471140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab04b-39cb-47ad-8813-1412361b024e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09ea13b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:07.471140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab04b-39cb-47ad-8813-1412361b024e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:07.471435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab04b-39cb-47ad-8813-1412361b024e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:07.471747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab04b-39cb-47ad-8813-1412361b024e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:07.472556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ab04b-39cb-47ad-8813-1412361b024e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:07.474161 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ab04b-39cb-47ad-8813-1412361b024e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:07.485096 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1208/2394] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:07.489207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61856e-57da-4f99-bf3c-4030ec3ef370 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:07.499855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61856e-57da-4f99-bf3c-4030ec3ef370 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:07.505606 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b84f9-be0b-45c9-a040-b8535acbaffc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09e3f3490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:07.505606 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b84f9-be0b-45c9-a040-b8535acbaffc admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:07.505606 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b84f9-be0b-45c9-a040-b8535acbaffc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:07.505606 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b84f9-be0b-45c9-a040-b8535acbaffc admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:07.506144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b84f9-be0b-45c9-a040-b8535acbaffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:07.508871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b84f9-be0b-45c9-a040-b8535acbaffc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:07.518920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1187/2395] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:07.523253 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab04b-39cb-47ad-8813-1412361b024e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:07.533280 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab04b-39cb-47ad-8813-1412361b024e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:07.537676 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6b705-b9c1-43d0-b4a8-6cd1defeaae3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09e14ec40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:07.539319 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6b705-b9c1-43d0-b4a8-6cd1defeaae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:07.539618 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6b705-b9c1-43d0-b4a8-6cd1defeaae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:07.539906 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6b705-b9c1-43d0-b4a8-6cd1defeaae3 admin admin] PATH_INFO: `/v3/projects/4db6583f9b374a5689b0f72bad5e73ed/users/f5b519ccf2e6498e829211c3ef3407ce/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:07.562658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6b705-b9c1-43d0-b4a8-6cd1defeaae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db6583f9b374a5689b0f72bad5e73ed, user_id=f5b519ccf2e6498e829211c3ef3407ce, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:07.565343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6b705-b9c1-43d0-b4a8-6cd1defeaae3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:07.668129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1209/2396] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:07 2022] PUT /identity/v3/projects/4db6583f9b374a5689b0f72bad5e73ed/users/f5b519ccf2e6498e829211c3ef3407ce/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:07.678395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe6960-4631-427c-9be1-95558c578460 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:07.678751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe6960-4631-427c-9be1-95558c578460 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:07.679624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe6960-4631-427c-9be1-95558c578460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:07.716523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f7fe6960-4631-427c-9be1-95558c578460 None None] MFA Rules not processed for user `f5b519ccf2e6498e829211c3ef3407ce`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:07.717704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f7fe6960-4631-427c-9be1-95558c578460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:07.792653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1188/2397] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:07 2022] POST /identity/v3/auth/tokens => generated 3708 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:07.797129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6b705-b9c1-43d0-b4a8-6cd1defeaae3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:07.871768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6b705-b9c1-43d0-b4a8-6cd1defeaae3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:07.879103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6997-c0ef-499e-91af-e9f8ee93cfb2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09e4c8b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:07.879293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe6960-4631-427c-9be1-95558c578460 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:07.879736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6997-c0ef-499e-91af-e9f8ee93cfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:07.885243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6997-c0ef-499e-91af-e9f8ee93cfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:07.885243 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6997-c0ef-499e-91af-e9f8ee93cfb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:07.885603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f7fe6960-4631-427c-9be1-95558c578460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:07.885707 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae6997-c0ef-499e-91af-e9f8ee93cfb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:07.885707 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae6997-c0ef-499e-91af-e9f8ee93cfb2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:07.961362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe6960-4631-427c-9be1-95558c578460 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:07.966578 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de21dde-8e21-4a99-83e0-2f84fd03e096 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSKrNnvIRemFolwvYir7wQ, audit_chain_id=['lSKrNnvIRemFolwvYir7wQ']) at 0x7fe09e1df6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df38935f18f54095b0f9ca196975260d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ab2c81f04b344ce9acd80c60cfe45bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:07.967462 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de21dde-8e21-4a99-83e0-2f84fd03e096 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:07.967927 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de21dde-8e21-4a99-83e0-2f84fd03e096 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:07.968374 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de21dde-8e21-4a99-83e0-2f84fd03e096 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:07.969491 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de21dde-8e21-4a99-83e0-2f84fd03e096 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:06:07.969968 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de21dde-8e21-4a99-83e0-2f84fd03e096 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:07.971768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de21dde-8e21-4a99-83e0-2f84fd03e096 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:07.984254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1210/2398] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:07 2022] POST /identity/v3/projects => generated 399 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:07.988144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6997-c0ef-499e-91af-e9f8ee93cfb2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:07.997497 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1189/2399] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:06:07.998690 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de21dde-8e21-4a99-83e0-2f84fd03e096 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:08.013353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de21dde-8e21-4a99-83e0-2f84fd03e096 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:08.080509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6997-c0ef-499e-91af-e9f8ee93cfb2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:08.086835 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde358a-3785-4656-8bf7-d6c72c72dd7f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09e1ae490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:08.087669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde358a-3785-4656-8bf7-d6c72c72dd7f admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:08.088155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde358a-3785-4656-8bf7-d6c72c72dd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:08.088405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde358a-3785-4656-8bf7-d6c72c72dd7f admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:08.089054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde358a-3785-4656-8bf7-d6c72c72dd7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:08.091040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde358a-3785-4656-8bf7-d6c72c72dd7f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:08.100293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0fd5b-933a-462e-b91b-414c14155925 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSKrNnvIRemFolwvYir7wQ, audit_chain_id=['lSKrNnvIRemFolwvYir7wQ']) at 0x7fe09e162610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df38935f18f54095b0f9ca196975260d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ab2c81f04b344ce9acd80c60cfe45bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:08.101644 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0fd5b-933a-462e-b91b-414c14155925 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:08.101937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0fd5b-933a-462e-b91b-414c14155925 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:08.102322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0fd5b-933a-462e-b91b-414c14155925 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:08.102981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0fd5b-933a-462e-b91b-414c14155925 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:08.105327 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0fd5b-933a-462e-b91b-414c14155925 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:08.204601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1211/2400] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:07 2022] POST /identity/v3/users => generated 306 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:08.208419 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde358a-3785-4656-8bf7-d6c72c72dd7f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:08.218061 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde358a-3785-4656-8bf7-d6c72c72dd7f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:08.222594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b76e7-901f-493d-b45a-285ceae04f79 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09e194280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:08.223235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b76e7-901f-493d-b45a-285ceae04f79 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:08.223531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b76e7-901f-493d-b45a-285ceae04f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:08.223819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b76e7-901f-493d-b45a-285ceae04f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:08.224524 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b76e7-901f-493d-b45a-285ceae04f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:08.227343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b76e7-901f-493d-b45a-285ceae04f79 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:08.229369 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1190/2401] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:07 2022] POST /identity/v3/projects => generated 354 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:08.233337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0fd5b-933a-462e-b91b-414c14155925 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:08.237946 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1212/2402] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:08.242613 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b76e7-901f-493d-b45a-285ceae04f79 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:08.251897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b76e7-901f-493d-b45a-285ceae04f79 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:08.311390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0fd5b-933a-462e-b91b-414c14155925 tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:08.315963 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4977-df28-48b1-bb5b-37066f63068e tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSKrNnvIRemFolwvYir7wQ, audit_chain_id=['lSKrNnvIRemFolwvYir7wQ']) at 0x7fe09dec94f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df38935f18f54095b0f9ca196975260d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ab2c81f04b344ce9acd80c60cfe45bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:08.316134 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a17ae6-47d0-4ef3-a0b0-cd0108380b00 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09de9b190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:08.316772 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4977-df28-48b1-bb5b-37066f63068e tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:08.317075 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a17ae6-47d0-4ef3-a0b0-cd0108380b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:08.317165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4977-df28-48b1-bb5b-37066f63068e tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:08.317366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4977-df28-48b1-bb5b-37066f63068e tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:08.317451 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a17ae6-47d0-4ef3-a0b0-cd0108380b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:08.317651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a17ae6-47d0-4ef3-a0b0-cd0108380b00 admin admin] PATH_INFO: `/v3/projects/f691db75f6f341d886f653f747fc8099/users/62151710860f42108aea508846e8db9c/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:08.318075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4977-df28-48b1-bb5b-37066f63068e tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:06:08.318478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4977-df28-48b1-bb5b-37066f63068e tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:08.320800 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4977-df28-48b1-bb5b-37066f63068e tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:08.336461 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1191/2403] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:06:08.338210 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a17ae6-47d0-4ef3-a0b0-cd0108380b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f691db75f6f341d886f653f747fc8099, user_id=62151710860f42108aea508846e8db9c, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:08.341100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a17ae6-47d0-4ef3-a0b0-cd0108380b00 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:08.373874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4977-df28-48b1-bb5b-37066f63068e tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:08.383929 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4977-df28-48b1-bb5b-37066f63068e tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:08.388804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSKrNnvIRemFolwvYir7wQ, audit_chain_id=['lSKrNnvIRemFolwvYir7wQ']) at 0x7fe09e3d54c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df38935f18f54095b0f9ca196975260d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ab2c81f04b344ce9acd80c60cfe45bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:08.389590 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:08.389880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:08.390164 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] PATH_INFO: `/v3/projects/abbf57d3e73e4888b03bfabe2407246b` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:08.391305 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: Authorizing `identity:delete_project(project_id=abbf57d3e73e4888b03bfabe2407246b)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:08.393193 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:08.467901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1213/2404] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:08 2022] PUT /identity/v3/projects/f691db75f6f341d886f653f747fc8099/users/62151710860f42108aea508846e8db9c/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:08.471979 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a17ae6-47d0-4ef3-a0b0-cd0108380b00 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:08.530795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbf57d3e73e4888b03bfabe2407246b', 'request_id': 'req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:08.542241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbf57d3e73e4888b03bfabe2407246b', 'request_id': 'req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:08.544860 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a17ae6-47d0-4ef3-a0b0-cd0108380b00 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:08.608641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1b07-59e8-4b92-902f-50dfc199af7c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09e1834f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:08.609238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1b07-59e8-4b92-902f-50dfc199af7c admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:08.609532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1b07-59e8-4b92-902f-50dfc199af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:08.609813 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1b07-59e8-4b92-902f-50dfc199af7c admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:08.610502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c1b07-59e8-4b92-902f-50dfc199af7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:08.612148 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c1b07-59e8-4b92-902f-50dfc199af7c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:08.615627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbf57d3e73e4888b03bfabe2407246b', 'request_id': 'req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:08.622422 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1214/2405] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:08.626572 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1b07-59e8-4b92-902f-50dfc199af7c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:08.626698 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] The token cache is being invalidate because project abbf57d3e73e4888b03bfabe2407246b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:08.627021 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:08.627747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b5d8968f-d22c-4eb8-b6fc-1f0a35055e0b tempest-VolumeQuotaClassesTest-1509737648 tempest-VolumeQuotaClassesTest-1509737648-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:08.629248 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1192/2406] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:08 2022] DELETE /identity/v3/projects/abbf57d3e73e4888b03bfabe2407246b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:08.637256 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1b07-59e8-4b92-902f-50dfc199af7c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:08.641755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d473e-86f0-4c9e-a4a0-65755e75dddc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09e4ef5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:08.642586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d473e-86f0-4c9e-a4a0-65755e75dddc admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:08.642852 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d473e-86f0-4c9e-a4a0-65755e75dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:08.643376 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d473e-86f0-4c9e-a4a0-65755e75dddc admin admin] PATH_INFO: `/v3/projects/f691db75f6f341d886f653f747fc8099/users/62151710860f42108aea508846e8db9c/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:08.645004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d473e-86f0-4c9e-a4a0-65755e75dddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f691db75f6f341d886f653f747fc8099, user_id=62151710860f42108aea508846e8db9c, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:08.648308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d473e-86f0-4c9e-a4a0-65755e75dddc admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:08.658586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1215/2407] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:08 2022] PUT /identity/v3/projects/f691db75f6f341d886f653f747fc8099/users/62151710860f42108aea508846e8db9c/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:08.669951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3672e-8662-4773-baa4-ea4afc14b7b5 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:08.670246 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3672e-8662-4773-baa4-ea4afc14b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:08.670551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3672e-8662-4773-baa4-ea4afc14b7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:08.711468 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a0a3672e-8662-4773-baa4-ea4afc14b7b5 None None] MFA Rules not processed for user `62151710860f42108aea508846e8db9c`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:08.712645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a0a3672e-8662-4773-baa4-ea4afc14b7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:08.790566 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1193/2408] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:08 2022] POST /identity/v3/auth/tokens => generated 3773 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:06:08.970658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d473e-86f0-4c9e-a4a0-65755e75dddc admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:08.972379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-548d473e-86f0-4c9e-a4a0-65755e75dddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:09.043073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d473e-86f0-4c9e-a4a0-65755e75dddc admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:09.046665 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801729-b865-4835-8519-1647986cd370 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e1c05e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:09.047367 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801729-b865-4835-8519-1647986cd370 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:09.047661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801729-b865-4835-8519-1647986cd370 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:09.047949 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801729-b865-4835-8519-1647986cd370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:09.058232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801729-b865-4835-8519-1647986cd370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:09.059768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801729-b865-4835-8519-1647986cd370 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:09.070015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1216/2409] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:08 2022] GET /identity/v3/auth/tokens => generated 3773 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:09.341096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3672e-8662-4773-baa4-ea4afc14b7b5 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:09.351073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3672e-8662-4773-baa4-ea4afc14b7b5 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:09.354721 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc2f08-91fa-48ae-a210-2e6ba0801967 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e1593d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:09.355324 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc2f08-91fa-48ae-a210-2e6ba0801967 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:09.355620 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc2f08-91fa-48ae-a210-2e6ba0801967 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:09.355903 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc2f08-91fa-48ae-a210-2e6ba0801967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:09.357686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d2dc2f08-91fa-48ae-a210-2e6ba0801967 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:09.403382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801729-b865-4835-8519-1647986cd370 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:09.405034 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-11801729-b865-4835-8519-1647986cd370 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:09.453378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc2f08-91fa-48ae-a210-2e6ba0801967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:09.454828 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc2f08-91fa-48ae-a210-2e6ba0801967 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:09.464314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1194/2410] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:09 2022] GET /identity/v3/auth/tokens => generated 3708 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:09.478262 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801729-b865-4835-8519-1647986cd370 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:09.482714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09eb3eb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:09.483552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:09.483863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:09.484111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] PATH_INFO: `/v3/users/e928e7768e77425cbde213a6990c2078` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:09.485263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e928e7768e77425cbde213a6990c2078)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:09.487186 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:09.728637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e928e7768e77425cbde213a6990c2078'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:09.740314 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e928e7768e77425cbde213a6990c2078'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:09.740985 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e928e7768e77425cbde213a6990c2078'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:09.741781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e928e7768e77425cbde213a6990c2078'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:09.838176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e928e7768e77425cbde213a6990c2078'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:09.852503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1217/2411] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:09 2022] DELETE /identity/v3/users/e928e7768e77425cbde213a6990c2078 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:09.857202 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2e34-f56a-4b32-b1dc-b69017c48943 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:09.857706 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2e34-f56a-4b32-b1dc-b69017c48943 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:09.857813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2e34-f56a-4b32-b1dc-b69017c48943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:09.880497 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e40a2e34-f56a-4b32-b1dc-b69017c48943 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:09.881678 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e40a2e34-f56a-4b32-b1dc-b69017c48943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:09.963397 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1195/2412] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:09.970628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:09.972201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:10.038223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec033c4-7106-4741-9606-50d99565457e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:10.041955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef2524-e737-4773-9e9a-d31f99a81196 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e4e0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:10.042537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2524-e737-4773-9e9a-d31f99a81196 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:10.042830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2524-e737-4773-9e9a-d31f99a81196 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:10.043129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2524-e737-4773-9e9a-d31f99a81196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:10.052461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef2524-e737-4773-9e9a-d31f99a81196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:10.053947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef2524-e737-4773-9e9a-d31f99a81196 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:10.063288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1218/2413] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:10.763527 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a2e34-f56a-4b32-b1dc-b69017c48943 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:10.764989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e40a2e34-f56a-4b32-b1dc-b69017c48943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:10.777260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a2e34-f56a-4b32-b1dc-b69017c48943 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:10.782036 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09de7f520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:10.787519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:10.787519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:10.787519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] PATH_INFO: `/v3/projects/d8166b11a7f5496893f560152bde4e67` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:10.787519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8166b11a7f5496893f560152bde4e67)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:10.787519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:10.898962 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb101d9-b2f2-425b-81bd-fb4a1e85ddea None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:10.899580 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb101d9-b2f2-425b-81bd-fb4a1e85ddea None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:10.899676 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb101d9-b2f2-425b-81bd-fb4a1e85ddea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:10.924983 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-bcb101d9-b2f2-425b-81bd-fb4a1e85ddea None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:10.925358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8166b11a7f5496893f560152bde4e67', 'request_id': 'req-5455fd02-c226-4322-b296-638fcac280d2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:10.926212 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-bcb101d9-b2f2-425b-81bd-fb4a1e85ddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:10.937126 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8166b11a7f5496893f560152bde4e67', 'request_id': 'req-5455fd02-c226-4322-b296-638fcac280d2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:10.991951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1219/2414] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:06:10 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:11.003796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb101d9-b2f2-425b-81bd-fb4a1e85ddea None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:11.005049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-bcb101d9-b2f2-425b-81bd-fb4a1e85ddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:11.077102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb101d9-b2f2-425b-81bd-fb4a1e85ddea None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:11.081895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2520d8-c430-4491-9681-2c1457fd2b76 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e14ecd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:11.082527 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2520d8-c430-4491-9681-2c1457fd2b76 service swift] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:11.082819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2520d8-c430-4491-9681-2c1457fd2b76 service swift] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:11.083104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2520d8-c430-4491-9681-2c1457fd2b76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:11.083772 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8166b11a7f5496893f560152bde4e67', 'request_id': 'req-5455fd02-c226-4322-b296-638fcac280d2'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:11.092219 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2520d8-c430-4491-9681-2c1457fd2b76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:11.093789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2520d8-c430-4491-9681-2c1457fd2b76 service swift] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:11.095274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] The token cache is being invalidate because project d8166b11a7f5496893f560152bde4e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:11.095587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:11.096219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:11.097902 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1196/2415] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:10 2022] DELETE /identity/v3/projects/d8166b11a7f5496893f560152bde4e67 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:11.102294 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:11.116837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1220/2416] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:06:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 28 19:06:11.118316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:11.178798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455fd02-c226-4322-b296-638fcac280d2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:11.183406 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c19cd-ef46-45c6-8696-71941d8b5e83 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09e58d9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:11.184204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c19cd-ef46-45c6-8696-71941d8b5e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:11.184489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c19cd-ef46-45c6-8696-71941d8b5e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:11.184766 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c19cd-ef46-45c6-8696-71941d8b5e83 admin admin] PATH_INFO: `/v3/users/df38935f18f54095b0f9ca196975260d` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:11.185977 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c19cd-ef46-45c6-8696-71941d8b5e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df38935f18f54095b0f9ca196975260d)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:11.187957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c19cd-ef46-45c6-8696-71941d8b5e83 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:11.357624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4f3c19cd-ef46-45c6-8696-71941d8b5e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df38935f18f54095b0f9ca196975260d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:11.433079 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4f3c19cd-ef46-45c6-8696-71941d8b5e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df38935f18f54095b0f9ca196975260d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:11.457320 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4f3c19cd-ef46-45c6-8696-71941d8b5e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df38935f18f54095b0f9ca196975260d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:11.458189 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4f3c19cd-ef46-45c6-8696-71941d8b5e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df38935f18f54095b0f9ca196975260d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:11.458808 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-4f3c19cd-ef46-45c6-8696-71941d8b5e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df38935f18f54095b0f9ca196975260d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:11.474243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1197/2417] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:11 2022] DELETE /identity/v3/users/df38935f18f54095b0f9ca196975260d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:12.308026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2520d8-c430-4491-9681-2c1457fd2b76 service swift] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:12.318269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2520d8-c430-4491-9681-2c1457fd2b76 service swift] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:12.381109 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k9XXerYgTgKhXJBWe0J17w, audit_chain_id=['k9XXerYgTgKhXJBWe0J17w']) at 0x7fe09eba9a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:12.382515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:12.382801 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:12.383082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] PATH_INFO: `/v3/projects/3ab2c81f04b344ce9acd80c60cfe45bb` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:12.384272 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ab2c81f04b344ce9acd80c60cfe45bb)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:12.386222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:12.526666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab2c81f04b344ce9acd80c60cfe45bb', 'request_id': 'req-289ac965-c949-4e34-b4df-519f3a80819b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:12.650567 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab2c81f04b344ce9acd80c60cfe45bb', 'request_id': 'req-289ac965-c949-4e34-b4df-519f3a80819b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:12.666540 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab2c81f04b344ce9acd80c60cfe45bb', 'request_id': 'req-289ac965-c949-4e34-b4df-519f3a80819b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:12.676767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] The token cache is being invalidate because project 3ab2c81f04b344ce9acd80c60cfe45bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:12.677140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:12.677820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-289ac965-c949-4e34-b4df-519f3a80819b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:12.679575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1221/2418] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:12 2022] DELETE /identity/v3/projects/3ab2c81f04b344ce9acd80c60cfe45bb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:12.685909 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4bee3-3ab0-4df4-a220-c4e8c3a8bf44 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:12.686441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4bee3-3ab0-4df4-a220-c4e8c3a8bf44 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:12.686545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4bee3-3ab0-4df4-a220-c4e8c3a8bf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:12.720314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d6f4bee3-3ab0-4df4-a220-c4e8c3a8bf44 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:12.721870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d6f4bee3-3ab0-4df4-a220-c4e8c3a8bf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:12.792424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1198/2419] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:12.800008 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33a266-9bf1-4186-8d1c-214cdcf9f092 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:12.800303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33a266-9bf1-4186-8d1c-214cdcf9f092 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:12.800585 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33a266-9bf1-4186-8d1c-214cdcf9f092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:12.824059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-dc33a266-9bf1-4186-8d1c-214cdcf9f092 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:12.825247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-dc33a266-9bf1-4186-8d1c-214cdcf9f092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:12.833012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1222/2420] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:12.838504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4bee3-3ab0-4df4-a220-c4e8c3a8bf44 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:12.848170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4bee3-3ab0-4df4-a220-c4e8c3a8bf44 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:12.854880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380de4-99a5-4b1e-b9a2-c3933297bc04 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09e15bc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:12.855770 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380de4-99a5-4b1e-b9a2-c3933297bc04 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:12.856273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380de4-99a5-4b1e-b9a2-c3933297bc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:12.856755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380de4-99a5-4b1e-b9a2-c3933297bc04 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:12.857667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9380de4-99a5-4b1e-b9a2-c3933297bc04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:06:12.858141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9380de4-99a5-4b1e-b9a2-c3933297bc04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:12.860200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9380de4-99a5-4b1e-b9a2-c3933297bc04 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:12.874378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1199/2421] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:06:12.878663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33a266-9bf1-4186-8d1c-214cdcf9f092 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:12.888764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33a266-9bf1-4186-8d1c-214cdcf9f092 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:12.893354 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85daf84-7175-42e5-9189-69235c0395cc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09e500df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:12.893984 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85daf84-7175-42e5-9189-69235c0395cc admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:12.894270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85daf84-7175-42e5-9189-69235c0395cc admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:12.894550 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85daf84-7175-42e5-9189-69235c0395cc admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:12.895222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85daf84-7175-42e5-9189-69235c0395cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:12.897681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85daf84-7175-42e5-9189-69235c0395cc admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:13.011601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1223/2422] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:12 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:13.017073 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380de4-99a5-4b1e-b9a2-c3933297bc04 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:13.031244 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380de4-99a5-4b1e-b9a2-c3933297bc04 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:13.097055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0746b6-ec0d-44f3-9707-153f9756511d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09e15b310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:13.097586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0746b6-ec0d-44f3-9707-153f9756511d admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:13.097876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0746b6-ec0d-44f3-9707-153f9756511d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:13.098162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0746b6-ec0d-44f3-9707-153f9756511d admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:13.098807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0746b6-ec0d-44f3-9707-153f9756511d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:13.100911 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0746b6-ec0d-44f3-9707-153f9756511d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:13.190014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1200/2423] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:13 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:13.191313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85daf84-7175-42e5-9189-69235c0395cc admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:13.201943 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85daf84-7175-42e5-9189-69235c0395cc admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:13.206741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e956444-560d-445c-a395-c78f46504c70 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09de55d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:13.207502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e956444-560d-445c-a395-c78f46504c70 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:13.207939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e956444-560d-445c-a395-c78f46504c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:13.208288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e956444-560d-445c-a395-c78f46504c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:13.209059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e956444-560d-445c-a395-c78f46504c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:13.211603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e956444-560d-445c-a395-c78f46504c70 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:13.224990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1224/2424] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:13.229043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0746b6-ec0d-44f3-9707-153f9756511d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:13.239549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0746b6-ec0d-44f3-9707-153f9756511d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:13.250371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90babc99-5989-4674-9cbf-fbbd27d1e6e3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09dd84490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:13.251269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90babc99-5989-4674-9cbf-fbbd27d1e6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:13.251623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90babc99-5989-4674-9cbf-fbbd27d1e6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:13.251987 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90babc99-5989-4674-9cbf-fbbd27d1e6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:13.252753 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90babc99-5989-4674-9cbf-fbbd27d1e6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:13.254418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90babc99-5989-4674-9cbf-fbbd27d1e6e3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:13.276688 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1201/2425] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:13.278145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e956444-560d-445c-a395-c78f46504c70 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:13.297869 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e956444-560d-445c-a395-c78f46504c70 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:13.302523 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8be3c-253a-41a7-bf0c-cf14a0a76f81 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09de9b130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:13.303898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8be3c-253a-41a7-bf0c-cf14a0a76f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:13.304761 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8be3c-253a-41a7-bf0c-cf14a0a76f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:13.305252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8be3c-253a-41a7-bf0c-cf14a0a76f81 admin admin] PATH_INFO: `/v3/projects/26af3a3bef3448548bad6d76cef467f2/users/8647679011cd4eb8b0285f72ecb74637/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:13.328947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8be3c-253a-41a7-bf0c-cf14a0a76f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26af3a3bef3448548bad6d76cef467f2, user_id=8647679011cd4eb8b0285f72ecb74637, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:13.331638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8be3c-253a-41a7-bf0c-cf14a0a76f81 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:13.418277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1225/2426] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:13 2022] PUT /identity/v3/projects/26af3a3bef3448548bad6d76cef467f2/users/8647679011cd4eb8b0285f72ecb74637/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:13.430053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c912a-3e3f-4ca7-8288-1ba836faa941 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:13.430607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c912a-3e3f-4ca7-8288-1ba836faa941 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:13.430950 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c912a-3e3f-4ca7-8288-1ba836faa941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:13.484409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-7b1c912a-3e3f-4ca7-8288-1ba836faa941 None None] MFA Rules not processed for user `8647679011cd4eb8b0285f72ecb74637`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:13.485695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7b1c912a-3e3f-4ca7-8288-1ba836faa941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:13.575777 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1202/2427] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:13 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:13.576317 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8be3c-253a-41a7-bf0c-cf14a0a76f81 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:13.661442 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8be3c-253a-41a7-bf0c-cf14a0a76f81 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:13.668854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e27ea-9917-489f-861e-e1bf2b6aa8c8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09defefa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:13.668854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e27ea-9917-489f-861e-e1bf2b6aa8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:13.668854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e27ea-9917-489f-861e-e1bf2b6aa8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:13.668854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e27ea-9917-489f-861e-e1bf2b6aa8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:13.669234 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e27ea-9917-489f-861e-e1bf2b6aa8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:13.670524 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e27ea-9917-489f-861e-e1bf2b6aa8c8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:13.789309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1226/2428] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:13 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:06:13.793672 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c912a-3e3f-4ca7-8288-1ba836faa941 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:13.804407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c912a-3e3f-4ca7-8288-1ba836faa941 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:13.880316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb414db-678e-4f07-abc9-ad3cb153a857 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09ea23880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:13.881094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb414db-678e-4f07-abc9-ad3cb153a857 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:13.881385 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb414db-678e-4f07-abc9-ad3cb153a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:13.882537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb414db-678e-4f07-abc9-ad3cb153a857 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:13.883317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb414db-678e-4f07-abc9-ad3cb153a857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:13.885268 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb414db-678e-4f07-abc9-ad3cb153a857 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:13.970350 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1203/2429] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:13 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:06:13.974336 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e27ea-9917-489f-861e-e1bf2b6aa8c8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:13.989203 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e27ea-9917-489f-861e-e1bf2b6aa8c8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:14.000820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9e986-3187-4fc2-9cfe-407ee1ad0e9d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09de9da90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:14.001497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9e986-3187-4fc2-9cfe-407ee1ad0e9d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:14.001744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9e986-3187-4fc2-9cfe-407ee1ad0e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:14.002037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9e986-3187-4fc2-9cfe-407ee1ad0e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:14.002773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9e986-3187-4fc2-9cfe-407ee1ad0e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:14.004452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9e986-3187-4fc2-9cfe-407ee1ad0e9d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:14.016804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1227/2430] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:14.021944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb414db-678e-4f07-abc9-ad3cb153a857 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:14.032652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb414db-678e-4f07-abc9-ad3cb153a857 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:14.037028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e64ce-9e82-4ae5-bd48-5688ee752402 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09de101c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:14.037911 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e64ce-9e82-4ae5-bd48-5688ee752402 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:14.038358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e64ce-9e82-4ae5-bd48-5688ee752402 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:14.047187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e64ce-9e82-4ae5-bd48-5688ee752402 admin admin] PATH_INFO: `/v3/projects/4c2b93ebc91e42bf82b88f92d4c902ad/users/28eef18bcc9b4cdc84802d41dbaa955d/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:14.069998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e64ce-9e82-4ae5-bd48-5688ee752402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2b93ebc91e42bf82b88f92d4c902ad, user_id=28eef18bcc9b4cdc84802d41dbaa955d, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:14.073087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e64ce-9e82-4ae5-bd48-5688ee752402 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:14.182580 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1204/2431] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:14 2022] PUT /identity/v3/projects/4c2b93ebc91e42bf82b88f92d4c902ad/users/28eef18bcc9b4cdc84802d41dbaa955d/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:14.186512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9e986-3187-4fc2-9cfe-407ee1ad0e9d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:14.197258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9e986-3187-4fc2-9cfe-407ee1ad0e9d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:14.271058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a6d98-bd4c-4bf3-a293-72c3ba7cc56a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09e118a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:14.271720 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6d98-bd4c-4bf3-a293-72c3ba7cc56a admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:14.272054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6d98-bd4c-4bf3-a293-72c3ba7cc56a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:14.273052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6d98-bd4c-4bf3-a293-72c3ba7cc56a admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:14.273758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a6d98-bd4c-4bf3-a293-72c3ba7cc56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:14.275504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a6d98-bd4c-4bf3-a293-72c3ba7cc56a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:14.287014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1228/2432] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:14.292060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e64ce-9e82-4ae5-bd48-5688ee752402 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:14.302692 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e64ce-9e82-4ae5-bd48-5688ee752402 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:14.307612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba34959-c323-4141-9900-a88abfc01f00 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09de43cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:14.308588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34959-c323-4141-9900-a88abfc01f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:14.309025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34959-c323-4141-9900-a88abfc01f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:14.309318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34959-c323-4141-9900-a88abfc01f00 admin admin] PATH_INFO: `/v3/projects/4c2b93ebc91e42bf82b88f92d4c902ad/users/28eef18bcc9b4cdc84802d41dbaa955d/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:14.311284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba34959-c323-4141-9900-a88abfc01f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2b93ebc91e42bf82b88f92d4c902ad, user_id=28eef18bcc9b4cdc84802d41dbaa955d, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:14.315775 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba34959-c323-4141-9900-a88abfc01f00 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:14.324689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1205/2433] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:14 2022] PUT /identity/v3/projects/4c2b93ebc91e42bf82b88f92d4c902ad/users/28eef18bcc9b4cdc84802d41dbaa955d/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:14.335875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ef83b-5f92-4815-b7e7-eb590186c986 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:14.336417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ef83b-5f92-4815-b7e7-eb590186c986 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:14.336515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ef83b-5f92-4815-b7e7-eb590186c986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:14.374706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-c29ef83b-5f92-4815-b7e7-eb590186c986 None None] MFA Rules not processed for user `28eef18bcc9b4cdc84802d41dbaa955d`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:14.375914 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c29ef83b-5f92-4815-b7e7-eb590186c986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:14.456530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1229/2434] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:14 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:14.467533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba34959-c323-4141-9900-a88abfc01f00 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:14.469310 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4ba34959-c323-4141-9900-a88abfc01f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:14.554207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba34959-c323-4141-9900-a88abfc01f00 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:14.559226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f253d4b-dd0e-4f8d-911f-90136e437731 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09de10040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:14.559827 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253d4b-dd0e-4f8d-911f-90136e437731 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:14.560112 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253d4b-dd0e-4f8d-911f-90136e437731 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:14.560390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253d4b-dd0e-4f8d-911f-90136e437731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:14.572890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f253d4b-dd0e-4f8d-911f-90136e437731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:14.575180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f253d4b-dd0e-4f8d-911f-90136e437731 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:14.587199 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1206/2435] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:14 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:15.448737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ef83b-5f92-4815-b7e7-eb590186c986 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:15.450181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c29ef83b-5f92-4815-b7e7-eb590186c986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:15.535509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ef83b-5f92-4815-b7e7-eb590186c986 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:15.541541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09ea1f8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:15.542615 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:15.544486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:15.544486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] PATH_INFO: `/v3/users/f5b519ccf2e6498e829211c3ef3407ce` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:15.544486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b519ccf2e6498e829211c3ef3407ce)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:15.546317 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:15.743397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b519ccf2e6498e829211c3ef3407ce'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:15.759961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b519ccf2e6498e829211c3ef3407ce'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:15.761455 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b519ccf2e6498e829211c3ef3407ce'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:15.761830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b519ccf2e6498e829211c3ef3407ce'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:16.357013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b519ccf2e6498e829211c3ef3407ce'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:16.357013 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1230/2436] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:15 2022] DELETE /identity/v3/users/f5b519ccf2e6498e829211c3ef3407ce => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:16.358611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79a3c-973c-4dcb-b391-29a33823f219 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:16.359181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79a3c-973c-4dcb-b391-29a33823f219 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:16.359181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79a3c-973c-4dcb-b391-29a33823f219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:16.393894 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-27c79a3c-973c-4dcb-b391-29a33823f219 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:16.395412 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-27c79a3c-973c-4dcb-b391-29a33823f219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:16.483289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1207/2437] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:16.494697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:16.496095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:16.571356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776255f4-4a79-43e4-982d-b66390ca44cf admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:16.575421 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fab75c-a3c1-4bba-a6c9-83977ec3c097 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e347310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:16.576119 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab75c-a3c1-4bba-a6c9-83977ec3c097 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:16.576530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab75c-a3c1-4bba-a6c9-83977ec3c097 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:16.577011 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab75c-a3c1-4bba-a6c9-83977ec3c097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:16.588536 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fab75c-a3c1-4bba-a6c9-83977ec3c097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:16.589998 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fab75c-a3c1-4bba-a6c9-83977ec3c097 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:16.599919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1231/2438] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:16 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:06:17.254352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79a3c-973c-4dcb-b391-29a33823f219 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:17.260725 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-27c79a3c-973c-4dcb-b391-29a33823f219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:17.269941 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79a3c-973c-4dcb-b391-29a33823f219 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:17.276743 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f53a3-6dcc-4846-8c57-0f0221ae6be2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09e90fca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:17.277632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f53a3-6dcc-4846-8c57-0f0221ae6be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:17.277948 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f53a3-6dcc-4846-8c57-0f0221ae6be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:17.278228 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f53a3-6dcc-4846-8c57-0f0221ae6be2 admin admin] PATH_INFO: `/v3/users/8647679011cd4eb8b0285f72ecb74637` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:17.279423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f53a3-6dcc-4846-8c57-0f0221ae6be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8647679011cd4eb8b0285f72ecb74637)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:17.282183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f53a3-6dcc-4846-8c57-0f0221ae6be2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:17.410915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fab75c-a3c1-4bba-a6c9-83977ec3c097 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:17.410915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c0fab75c-a3c1-4bba-a6c9-83977ec3c097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:17.435734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fab75c-a3c1-4bba-a6c9-83977ec3c097 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:17.445480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09e194250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:17.446332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:17.446621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:17.446904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] PATH_INFO: `/v3/projects/4db6583f9b374a5689b0f72bad5e73ed` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:17.448846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db6583f9b374a5689b0f72bad5e73ed)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:17.460888 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:17.483395 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-dd1f53a3-6dcc-4846-8c57-0f0221ae6be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8647679011cd4eb8b0285f72ecb74637'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:17.552647 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-dd1f53a3-6dcc-4846-8c57-0f0221ae6be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8647679011cd4eb8b0285f72ecb74637'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:17.565523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-dd1f53a3-6dcc-4846-8c57-0f0221ae6be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8647679011cd4eb8b0285f72ecb74637'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:17.566274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-dd1f53a3-6dcc-4846-8c57-0f0221ae6be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8647679011cd4eb8b0285f72ecb74637'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:17.566969 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-dd1f53a3-6dcc-4846-8c57-0f0221ae6be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8647679011cd4eb8b0285f72ecb74637'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:17.586637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1208/2439] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:17 2022] DELETE /identity/v3/users/8647679011cd4eb8b0285f72ecb74637 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:17.595832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca754-e336-489d-a0cd-1d8e8b477bf1 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:17.596667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca754-e336-489d-a0cd-1d8e8b477bf1 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:17.596667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca754-e336-489d-a0cd-1d8e8b477bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:17.610194 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db6583f9b374a5689b0f72bad5e73ed', 'request_id': 'req-f366e786-c418-425c-a18b-8f801c44e056'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:17.623328 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e04ca754-e336-489d-a0cd-1d8e8b477bf1 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:17.625151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e04ca754-e336-489d-a0cd-1d8e8b477bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:17.689349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db6583f9b374a5689b0f72bad5e73ed', 'request_id': 'req-f366e786-c418-425c-a18b-8f801c44e056'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:17.697337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1209/2440] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:17.705683 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db6583f9b374a5689b0f72bad5e73ed', 'request_id': 'req-f366e786-c418-425c-a18b-8f801c44e056'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:17.708105 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca754-e336-489d-a0cd-1d8e8b477bf1 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:17.710040 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e04ca754-e336-489d-a0cd-1d8e8b477bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:17.714684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] The token cache is being invalidate because project 4db6583f9b374a5689b0f72bad5e73ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:17.715330 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:17.716231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:17.718269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1232/2441] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:17 2022] DELETE /identity/v3/projects/4db6583f9b374a5689b0f72bad5e73ed => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:17.724204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:17.726647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:17.743613 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366e786-c418-425c-a18b-8f801c44e056 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:17.749214 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09e3b5bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:17.750661 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:17.751236 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:17.751928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] PATH_INFO: `/v3/users/62151710860f42108aea508846e8db9c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:17.753397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62151710860f42108aea508846e8db9c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:17.755617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:17.785016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca754-e336-489d-a0cd-1d8e8b477bf1 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:17.789403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f61e2-ff06-4702-aceb-d2928966c5ff service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e1fbbb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:17.790252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f61e2-ff06-4702-aceb-d2928966c5ff service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:17.790537 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f61e2-ff06-4702-aceb-d2928966c5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:17.790814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f61e2-ff06-4702-aceb-d2928966c5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:17.792567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-886f61e2-ff06-4702-aceb-d2928966c5ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:17.805966 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f61e2-ff06-4702-aceb-d2928966c5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:17.807767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f61e2-ff06-4702-aceb-d2928966c5ff service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:17.818650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1210/2442] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:06:18.024935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62151710860f42108aea508846e8db9c'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:18.041994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62151710860f42108aea508846e8db9c'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:18.043061 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62151710860f42108aea508846e8db9c'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:18.043720 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62151710860f42108aea508846e8db9c'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:18.152601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62151710860f42108aea508846e8db9c'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:18.169604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1233/2443] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:17 2022] DELETE /identity/v3/users/62151710860f42108aea508846e8db9c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:18.487824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f61e2-ff06-4702-aceb-d2928966c5ff service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:18.489568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-886f61e2-ff06-4702-aceb-d2928966c5ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:18.504152 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f61e2-ff06-4702-aceb-d2928966c5ff service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:18.622965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09e3d1fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:18.624220 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:18.624731 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:18.625233 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] PATH_INFO: `/v3/projects/26af3a3bef3448548bad6d76cef467f2` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:18.626879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=26af3a3bef3448548bad6d76cef467f2)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:18.629321 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:18.759162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26af3a3bef3448548bad6d76cef467f2', 'request_id': 'req-3d73816f-63e5-48ab-a91c-1224a7f356ff'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:18.786876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26af3a3bef3448548bad6d76cef467f2', 'request_id': 'req-3d73816f-63e5-48ab-a91c-1224a7f356ff'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:18.893236 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:18.898450 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:18.901216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26af3a3bef3448548bad6d76cef467f2', 'request_id': 'req-3d73816f-63e5-48ab-a91c-1224a7f356ff'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:18.914070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] The token cache is being invalidate because project 26af3a3bef3448548bad6d76cef467f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:18.914372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:18.919376 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:18.919376 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1211/2444] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:18 2022] DELETE /identity/v3/projects/26af3a3bef3448548bad6d76cef467f2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:18.921239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9986c7-f52c-47c8-8791-338de8ebfec3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:18.933715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:18.935826 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:19.023215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73816f-63e5-48ab-a91c-1224a7f356ff admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:19.028636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc681-e69b-4aa1-a64d-0d38b9d9168e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09e1888b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:19.029560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc681-e69b-4aa1-a64d-0d38b9d9168e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:19.029862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc681-e69b-4aa1-a64d-0d38b9d9168e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:19.030147 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc681-e69b-4aa1-a64d-0d38b9d9168e admin admin] PATH_INFO: `/v3/users/28eef18bcc9b4cdc84802d41dbaa955d` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:19.031324 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbc681-e69b-4aa1-a64d-0d38b9d9168e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28eef18bcc9b4cdc84802d41dbaa955d)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:19.033502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbc681-e69b-4aa1-a64d-0d38b9d9168e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:19.035422 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NeLCnaOfT1OZauSTcoINkQ, audit_chain_id=['NeLCnaOfT1OZauSTcoINkQ']) at 0x7fe09de9b850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:19.036211 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:19.036568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:19.036917 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] PATH_INFO: `/v3/projects/f691db75f6f341d886f653f747fc8099` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:19.038949 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f691db75f6f341d886f653f747fc8099)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:19.041356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:19.922131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a4dbc681-e69b-4aa1-a64d-0d38b9d9168e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28eef18bcc9b4cdc84802d41dbaa955d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:19.925916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f691db75f6f341d886f653f747fc8099', 'request_id': 'req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:20.016098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a4dbc681-e69b-4aa1-a64d-0d38b9d9168e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28eef18bcc9b4cdc84802d41dbaa955d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:20.029732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a4dbc681-e69b-4aa1-a64d-0d38b9d9168e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28eef18bcc9b4cdc84802d41dbaa955d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:20.039954 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a4dbc681-e69b-4aa1-a64d-0d38b9d9168e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28eef18bcc9b4cdc84802d41dbaa955d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:20.039954 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a4dbc681-e69b-4aa1-a64d-0d38b9d9168e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28eef18bcc9b4cdc84802d41dbaa955d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:20.045605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1212/2445] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:18 2022] DELETE /identity/v3/users/28eef18bcc9b4cdc84802d41dbaa955d => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:20.101239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f691db75f6f341d886f653f747fc8099', 'request_id': 'req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:20.115449 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f691db75f6f341d886f653f747fc8099', 'request_id': 'req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:20.128064 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] The token cache is being invalidate because project f691db75f6f341d886f653f747fc8099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:20.131704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:20.131704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-b1ad807b-3199-4a50-bd54-0cd8f6119f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:20.131704 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1234/2446] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:18 2022] DELETE /identity/v3/projects/f691db75f6f341d886f653f747fc8099 => generated 0 bytes in 1238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:20.136004 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15f53-8c86-493d-8acf-269e6adec57f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:20.136652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15f53-8c86-493d-8acf-269e6adec57f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:20.136905 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15f53-8c86-493d-8acf-269e6adec57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:20.174715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-baa15f53-8c86-493d-8acf-269e6adec57f None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:20.176078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-baa15f53-8c86-493d-8acf-269e6adec57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:20.246008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1213/2447] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:20.253859 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a8ae-d641-464f-8a3d-09814765f459 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:20.254148 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a8ae-d641-464f-8a3d-09814765f459 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:20.254476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a8ae-d641-464f-8a3d-09814765f459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:20.278476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-49e6a8ae-d641-464f-8a3d-09814765f459 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:20.283281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-49e6a8ae-d641-464f-8a3d-09814765f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:20.286910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1235/2448] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:20.291872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15f53-8c86-493d-8acf-269e6adec57f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:20.301848 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15f53-8c86-493d-8acf-269e6adec57f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:20.308069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e052241-669e-4445-961d-75096439291d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09de33340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:20.308971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052241-669e-4445-961d-75096439291d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:20.309330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052241-669e-4445-961d-75096439291d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:20.309667 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052241-669e-4445-961d-75096439291d admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:20.310484 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e052241-669e-4445-961d-75096439291d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:06:20.310847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e052241-669e-4445-961d-75096439291d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:20.312647 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e052241-669e-4445-961d-75096439291d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:20.329748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1214/2449] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:06:20.334358 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6a8ae-d641-464f-8a3d-09814765f459 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:20.350697 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6a8ae-d641-464f-8a3d-09814765f459 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:20.359925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b9c7-256b-4de3-accf-f6801f7023de admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e970ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:20.360885 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b9c7-256b-4de3-accf-f6801f7023de admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:20.361282 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b9c7-256b-4de3-accf-f6801f7023de admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:20.361675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b9c7-256b-4de3-accf-f6801f7023de admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:20.362847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93b9c7-256b-4de3-accf-f6801f7023de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:20.369157 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93b9c7-256b-4de3-accf-f6801f7023de admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:20.492607 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1236/2450] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:20 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:20.496586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e052241-669e-4445-961d-75096439291d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:20.508104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e052241-669e-4445-961d-75096439291d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:20.588815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec341e-a96b-49e1-bb95-45aa2fb6c99a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e159e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:20.589429 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec341e-a96b-49e1-bb95-45aa2fb6c99a admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:20.589723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec341e-a96b-49e1-bb95-45aa2fb6c99a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:20.590007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec341e-a96b-49e1-bb95-45aa2fb6c99a admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:20.590710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec341e-a96b-49e1-bb95-45aa2fb6c99a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:20.592703 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec341e-a96b-49e1-bb95-45aa2fb6c99a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:20.636827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b9c7-256b-4de3-accf-f6801f7023de admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:20.638531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9a93b9c7-256b-4de3-accf-f6801f7023de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:20.652230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b9c7-256b-4de3-accf-f6801f7023de admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:20.656660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oKG3zYoER46MG1b7bokfLA, audit_chain_id=['oKG3zYoER46MG1b7bokfLA']) at 0x7fe09de9b850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:20.657462 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:20.657757 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:20.658044 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] PATH_INFO: `/v3/projects/4c2b93ebc91e42bf82b88f92d4c902ad` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:20.659169 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2b93ebc91e42bf82b88f92d4c902ad)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:20.661070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:20.712314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1215/2451] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:20 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:06:20.716920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec341e-a96b-49e1-bb95-45aa2fb6c99a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:20.727612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec341e-a96b-49e1-bb95-45aa2fb6c99a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:20.732205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65428d80-1d54-4a2f-8b02-90cba9ff8da1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e922fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:20.732807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65428d80-1d54-4a2f-8b02-90cba9ff8da1 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:20.733096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65428d80-1d54-4a2f-8b02-90cba9ff8da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:20.733378 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65428d80-1d54-4a2f-8b02-90cba9ff8da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:20.734075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65428d80-1d54-4a2f-8b02-90cba9ff8da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:20.735824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65428d80-1d54-4a2f-8b02-90cba9ff8da1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:20.747538 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1216/2452] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:20.754650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65428d80-1d54-4a2f-8b02-90cba9ff8da1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:20.764319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65428d80-1d54-4a2f-8b02-90cba9ff8da1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:20.768953 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c584c-83c8-456f-9305-5ffa40653022 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e3dc2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:20.769530 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c584c-83c8-456f-9305-5ffa40653022 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:20.769842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c584c-83c8-456f-9305-5ffa40653022 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:20.770123 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c584c-83c8-456f-9305-5ffa40653022 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:20.770807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c584c-83c8-456f-9305-5ffa40653022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:20.772857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c584c-83c8-456f-9305-5ffa40653022 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:20.785368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1217/2453] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:20.790022 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c584c-83c8-456f-9305-5ffa40653022 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:20.799616 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c584c-83c8-456f-9305-5ffa40653022 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:20.804546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605d2b7-90d8-4a61-8e54-210b51c08e7d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e3f67f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:20.805354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d2b7-90d8-4a61-8e54-210b51c08e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:20.805645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d2b7-90d8-4a61-8e54-210b51c08e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:20.805940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d2b7-90d8-4a61-8e54-210b51c08e7d admin admin] PATH_INFO: `/v3/projects/35baf3f6a7af457aa3ab65cd2f43a0d0/users/32b46c3b4e46493790ffd322460b4f2d/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:20.826137 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605d2b7-90d8-4a61-8e54-210b51c08e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35baf3f6a7af457aa3ab65cd2f43a0d0, user_id=32b46c3b4e46493790ffd322460b4f2d, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:20.828885 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605d2b7-90d8-4a61-8e54-210b51c08e7d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:20.994183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1218/2454] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:20 2022] PUT /identity/v3/projects/35baf3f6a7af457aa3ab65cd2f43a0d0/users/32b46c3b4e46493790ffd322460b4f2d/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:21.002185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2b93ebc91e42bf82b88f92d4c902ad', 'request_id': 'req-cd1d76e1-f737-4545-beaf-b080eddb67f1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:21.004394 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a24c6-24ee-4591-84e7-3d0c5d29e65e None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.004689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a24c6-24ee-4591-84e7-3d0c5d29e65e None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.004972 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a24c6-24ee-4591-84e7-3d0c5d29e65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.042675 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-dc0a24c6-24ee-4591-84e7-3d0c5d29e65e None None] MFA Rules not processed for user `32b46c3b4e46493790ffd322460b4f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:21.043847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-dc0a24c6-24ee-4591-84e7-3d0c5d29e65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:21.115219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1219/2455] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:21 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:06:21.119398 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a24c6-24ee-4591-84e7-3d0c5d29e65e None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:21.129350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2b93ebc91e42bf82b88f92d4c902ad', 'request_id': 'req-cd1d76e1-f737-4545-beaf-b080eddb67f1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:21.142193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2b93ebc91e42bf82b88f92d4c902ad', 'request_id': 'req-cd1d76e1-f737-4545-beaf-b080eddb67f1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:21.153487 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] The token cache is being invalidate because project 4c2b93ebc91e42bf82b88f92d4c902ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:21.153857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:21.154568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cd1d76e1-f737-4545-beaf-b080eddb67f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:21.156424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1237/2456] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:20 2022] DELETE /identity/v3/projects/4c2b93ebc91e42bf82b88f92d4c902ad => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:21.162079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dee2ce-1142-4c14-b88a-5c6f29ae0a1d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.162079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dee2ce-1142-4c14-b88a-5c6f29ae0a1d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.162079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dee2ce-1142-4c14-b88a-5c6f29ae0a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.186016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f4dee2ce-1142-4c14-b88a-5c6f29ae0a1d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:21.187249 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f4dee2ce-1142-4c14-b88a-5c6f29ae0a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:21.189967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a24c6-24ee-4591-84e7-3d0c5d29e65e None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:21.195532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96544e6-f237-46f6-9343-e516ef4e2e85 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e272610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:21.196131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96544e6-f237-46f6-9343-e516ef4e2e85 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.196254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1238/2457] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:06:21.196418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96544e6-f237-46f6-9343-e516ef4e2e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.196701 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96544e6-f237-46f6-9343-e516ef4e2e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.197355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96544e6-f237-46f6-9343-e516ef4e2e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:21.199269 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96544e6-f237-46f6-9343-e516ef4e2e85 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:21.203695 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958583b7-2f81-48fb-9407-5a170ef6d496 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.203988 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958583b7-2f81-48fb-9407-5a170ef6d496 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.204269 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958583b7-2f81-48fb-9407-5a170ef6d496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.227270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-958583b7-2f81-48fb-9407-5a170ef6d496 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:21.228413 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-958583b7-2f81-48fb-9407-5a170ef6d496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:21.235720 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1239/2458] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:21.239876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958583b7-2f81-48fb-9407-5a170ef6d496 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:21.248804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958583b7-2f81-48fb-9407-5a170ef6d496 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:21.253168 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823616f-2c99-4148-94c2-3548265b92b8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HarCtLQKQtC2HOujgXksvQ, audit_chain_id=['HarCtLQKQtC2HOujgXksvQ']) at 0x7fe09eae0190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:21.253760 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823616f-2c99-4148-94c2-3548265b92b8 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.254052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823616f-2c99-4148-94c2-3548265b92b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.254337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823616f-2c99-4148-94c2-3548265b92b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.255051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823616f-2c99-4148-94c2-3548265b92b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:06:21.255401 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823616f-2c99-4148-94c2-3548265b92b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:21.257817 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823616f-2c99-4148-94c2-3548265b92b8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:21.270261 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1240/2459] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:06:21.276058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823616f-2c99-4148-94c2-3548265b92b8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:21.285365 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823616f-2c99-4148-94c2-3548265b92b8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:21.290113 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a63fc3-643e-4224-965d-28db43161a74 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HarCtLQKQtC2HOujgXksvQ, audit_chain_id=['HarCtLQKQtC2HOujgXksvQ']) at 0x7fe09dec3f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:21.290689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a63fc3-643e-4224-965d-28db43161a74 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.290976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a63fc3-643e-4224-965d-28db43161a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.291297 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a63fc3-643e-4224-965d-28db43161a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.291925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a63fc3-643e-4224-965d-28db43161a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:21.293811 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a63fc3-643e-4224-965d-28db43161a74 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:21.376283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1220/2460] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:21 2022] POST /identity/v3/projects => generated 375 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:21.383324 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96544e6-f237-46f6-9343-e516ef4e2e85 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:21.384877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d96544e6-f237-46f6-9343-e516ef4e2e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:21.427788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1241/2461] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:21 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:21.432670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a63fc3-643e-4224-965d-28db43161a74 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:21.460248 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96544e6-f237-46f6-9343-e516ef4e2e85 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:21.500409 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a63fc3-643e-4224-965d-28db43161a74 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:21.504679 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78f017-f1fe-418c-91e8-1c4db4be48b1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HarCtLQKQtC2HOujgXksvQ, audit_chain_id=['HarCtLQKQtC2HOujgXksvQ']) at 0x7fe09e194250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:21.505281 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78f017-f1fe-418c-91e8-1c4db4be48b1 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.505596 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78f017-f1fe-418c-91e8-1c4db4be48b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.505877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78f017-f1fe-418c-91e8-1c4db4be48b1 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.507303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78f017-f1fe-418c-91e8-1c4db4be48b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:21.509214 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78f017-f1fe-418c-91e8-1c4db4be48b1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:21.521642 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6496b9-0595-4360-ae56-96fa46c4eb87 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e3acd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:21.522894 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6496b9-0595-4360-ae56-96fa46c4eb87 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.523203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6496b9-0595-4360-ae56-96fa46c4eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.557262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6496b9-0595-4360-ae56-96fa46c4eb87 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.557262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6496b9-0595-4360-ae56-96fa46c4eb87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:21.557262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6496b9-0595-4360-ae56-96fa46c4eb87 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:21.758249 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1242/2462] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:21 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:21.762682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78f017-f1fe-418c-91e8-1c4db4be48b1 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:21.772563 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78f017-f1fe-418c-91e8-1c4db4be48b1 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:21.776971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e2e28-0c81-41b5-aabd-8245b782d33d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HarCtLQKQtC2HOujgXksvQ, audit_chain_id=['HarCtLQKQtC2HOujgXksvQ']) at 0x7fe09e1a1730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:21.777557 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e2e28-0c81-41b5-aabd-8245b782d33d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.777877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e2e28-0c81-41b5-aabd-8245b782d33d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.778164 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e2e28-0c81-41b5-aabd-8245b782d33d admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.778878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e2e28-0c81-41b5-aabd-8245b782d33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:21.780512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e2e28-0c81-41b5-aabd-8245b782d33d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:21.791122 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1243/2463] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:21.794995 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e2e28-0c81-41b5-aabd-8245b782d33d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:21.798683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1221/2464] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:21 2022] POST /identity/v3/users => generated 288 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:21.804546 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e2e28-0c81-41b5-aabd-8245b782d33d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:21.809119 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af137be-7cf8-47dd-bf2f-2a1e27d4f39f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HarCtLQKQtC2HOujgXksvQ, audit_chain_id=['HarCtLQKQtC2HOujgXksvQ']) at 0x7fe09e4ef520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:21.809382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af137be-7cf8-47dd-bf2f-2a1e27d4f39f admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.809674 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af137be-7cf8-47dd-bf2f-2a1e27d4f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.809957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af137be-7cf8-47dd-bf2f-2a1e27d4f39f admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.810641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af137be-7cf8-47dd-bf2f-2a1e27d4f39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:21.812049 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6496b9-0595-4360-ae56-96fa46c4eb87 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:21.812231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af137be-7cf8-47dd-bf2f-2a1e27d4f39f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:21.822403 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6496b9-0595-4360-ae56-96fa46c4eb87 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:21.823650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1244/2465] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:21.826904 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13754d21-4a50-49d0-919f-af2b6c4a696b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09de33160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:21.827523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754d21-4a50-49d0-919f-af2b6c4a696b admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.827631 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af137be-7cf8-47dd-bf2f-2a1e27d4f39f admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:21.827814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754d21-4a50-49d0-919f-af2b6c4a696b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.828096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754d21-4a50-49d0-919f-af2b6c4a696b admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.828843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13754d21-4a50-49d0-919f-af2b6c4a696b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:21.830523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13754d21-4a50-49d0-919f-af2b6c4a696b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:21.837596 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af137be-7cf8-47dd-bf2f-2a1e27d4f39f admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:21.841621 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1222/2466] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:21.842205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3fbaa-3fdf-4bfb-bfb7-9114c51c4486 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HarCtLQKQtC2HOujgXksvQ, audit_chain_id=['HarCtLQKQtC2HOujgXksvQ']) at 0x7fe09e1c0dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:21.843050 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3fbaa-3fdf-4bfb-bfb7-9114c51c4486 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.843379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3fbaa-3fdf-4bfb-bfb7-9114c51c4486 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.843666 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3fbaa-3fdf-4bfb-bfb7-9114c51c4486 admin admin] PATH_INFO: `/v3/projects/802a715b4ed5468ab0efc3a06cbf242a/users/f40f5509c392494a9f6b2f801185190b/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.845216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13754d21-4a50-49d0-919f-af2b6c4a696b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:21.854745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13754d21-4a50-49d0-919f-af2b6c4a696b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:21.859190 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab6d5e-fbd4-42c1-a89c-e72c1d52f90d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e1b8e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:21.859773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab6d5e-fbd4-42c1-a89c-e72c1d52f90d admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.860059 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab6d5e-fbd4-42c1-a89c-e72c1d52f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.860342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab6d5e-fbd4-42c1-a89c-e72c1d52f90d admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.861035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab6d5e-fbd4-42c1-a89c-e72c1d52f90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:21.862651 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab6d5e-fbd4-42c1-a89c-e72c1d52f90d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:21.864171 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3fbaa-3fdf-4bfb-bfb7-9114c51c4486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802a715b4ed5468ab0efc3a06cbf242a, user_id=f40f5509c392494a9f6b2f801185190b, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:21.867405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3fbaa-3fdf-4bfb-bfb7-9114c51c4486 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:21.874063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1223/2467] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:21.878046 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab6d5e-fbd4-42c1-a89c-e72c1d52f90d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:21.888249 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab6d5e-fbd4-42c1-a89c-e72c1d52f90d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:21.894622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd233802-6982-4374-8a2a-f25733be69c8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09de43a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:21.894622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd233802-6982-4374-8a2a-f25733be69c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.894622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd233802-6982-4374-8a2a-f25733be69c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.894622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd233802-6982-4374-8a2a-f25733be69c8 admin admin] PATH_INFO: `/v3/projects/10ff8f52e9bf4643bbf61bd624408d39/users/1a63363be1dc41abb38920a34dc2f843/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:21.917581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd233802-6982-4374-8a2a-f25733be69c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ff8f52e9bf4643bbf61bd624408d39, user_id=1a63363be1dc41abb38920a34dc2f843, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:21.920354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd233802-6982-4374-8a2a-f25733be69c8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:21.981836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1245/2468] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:21 2022] PUT /identity/v3/projects/802a715b4ed5468ab0efc3a06cbf242a/users/f40f5509c392494a9f6b2f801185190b/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:21.993334 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b5cb-d5fd-441c-8c05-d3a0b2905d79 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:21.993633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b5cb-d5fd-441c-8c05-d3a0b2905d79 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:21.993922 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b5cb-d5fd-441c-8c05-d3a0b2905d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:22.028337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4906b5cb-d5fd-441c-8c05-d3a0b2905d79 None None] MFA Rules not processed for user `f40f5509c392494a9f6b2f801185190b`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:22.029425 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4906b5cb-d5fd-441c-8c05-d3a0b2905d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:22.038770 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1224/2469] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:21 2022] PUT /identity/v3/projects/10ff8f52e9bf4643bbf61bd624408d39/users/1a63363be1dc41abb38920a34dc2f843/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:22.049694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d65be-5da1-4572-807f-19fc406c86cd None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:22.054891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d65be-5da1-4572-807f-19fc406c86cd None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:22.054891 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d65be-5da1-4572-807f-19fc406c86cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:22.087313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-bf7d65be-5da1-4572-807f-19fc406c86cd None None] MFA Rules not processed for user `1a63363be1dc41abb38920a34dc2f843`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:22.088486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-bf7d65be-5da1-4572-807f-19fc406c86cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:22.104383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1246/2470] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:21 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:06:22.114357 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906b5cb-d5fd-441c-8c05-d3a0b2905d79 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:22.115798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4906b5cb-d5fd-441c-8c05-d3a0b2905d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:22.159628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1225/2471] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:22 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:06:22.164857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d65be-5da1-4572-807f-19fc406c86cd None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:22.180428 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906b5cb-d5fd-441c-8c05-d3a0b2905d79 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:22.234463 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d65be-5da1-4572-807f-19fc406c86cd None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:22.235148 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0774da-22d5-4dfd-bc5e-9b49363712d8 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09de9ba30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:22.235739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0774da-22d5-4dfd-bc5e-9b49363712d8 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:22.236027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0774da-22d5-4dfd-bc5e-9b49363712d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:22.236308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0774da-22d5-4dfd-bc5e-9b49363712d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:22.238988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd318f-4bcf-4721-8c92-9e19ae056848 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09de43700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:22.239615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd318f-4bcf-4721-8c92-9e19ae056848 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:22.239909 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd318f-4bcf-4721-8c92-9e19ae056848 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:22.240194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd318f-4bcf-4721-8c92-9e19ae056848 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:22.241404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd318f-4bcf-4721-8c92-9e19ae056848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:22.243307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd318f-4bcf-4721-8c92-9e19ae056848 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:22.299187 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0774da-22d5-4dfd-bc5e-9b49363712d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:22.300553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0774da-22d5-4dfd-bc5e-9b49363712d8 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:22.309939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1247/2472] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:22 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:06:22.371957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1226/2473] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:22 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:22.377115 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0774da-22d5-4dfd-bc5e-9b49363712d8 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:22.388686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0774da-22d5-4dfd-bc5e-9b49363712d8 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:22.458015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fcfda-fc08-49d2-83ba-47c3bb19b13b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09de50730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:22.458632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fcfda-fc08-49d2-83ba-47c3bb19b13b admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:22.459047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fcfda-fc08-49d2-83ba-47c3bb19b13b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:22.459296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fcfda-fc08-49d2-83ba-47c3bb19b13b admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:22.461144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fcfda-fc08-49d2-83ba-47c3bb19b13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:22.463167 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fcfda-fc08-49d2-83ba-47c3bb19b13b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:22.587210 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1248/2474] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:22 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:22.591084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd318f-4bcf-4721-8c92-9e19ae056848 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:22.601613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd318f-4bcf-4721-8c92-9e19ae056848 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:22.606351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac669-6719-44ca-bb4a-7c02b956cad0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e1b0490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:22.606956 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac669-6719-44ca-bb4a-7c02b956cad0 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:22.607290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac669-6719-44ca-bb4a-7c02b956cad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:22.607575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac669-6719-44ca-bb4a-7c02b956cad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:22.608275 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ac669-6719-44ca-bb4a-7c02b956cad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:22.609927 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ac669-6719-44ca-bb4a-7c02b956cad0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:22.624123 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1227/2475] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:22.625382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fcfda-fc08-49d2-83ba-47c3bb19b13b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:22.635007 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fcfda-fc08-49d2-83ba-47c3bb19b13b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:22.639500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32431256-99ad-405e-833d-158b7b2c389d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e1c0520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:22.640320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32431256-99ad-405e-833d-158b7b2c389d admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:22.640614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32431256-99ad-405e-833d-158b7b2c389d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:22.640898 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32431256-99ad-405e-833d-158b7b2c389d admin admin] PATH_INFO: `/v3/projects/7857ff59828c476184e9bb04e4e457d1/users/d3dbb9c67b01425ab34d8ac47afe4ae5/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:22.660456 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32431256-99ad-405e-833d-158b7b2c389d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7857ff59828c476184e9bb04e4e457d1, user_id=d3dbb9c67b01425ab34d8ac47afe4ae5, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:22.663914 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32431256-99ad-405e-833d-158b7b2c389d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:22.746699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1249/2476] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:22 2022] PUT /identity/v3/projects/7857ff59828c476184e9bb04e4e457d1/users/d3dbb9c67b01425ab34d8ac47afe4ae5/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:22.751088 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac669-6719-44ca-bb4a-7c02b956cad0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:22.761308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac669-6719-44ca-bb4a-7c02b956cad0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:22.825802 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cba6d-797a-4c9b-b869-d221e1fbd8bd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e1b0f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:22.826412 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cba6d-797a-4c9b-b869-d221e1fbd8bd admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:22.826726 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cba6d-797a-4c9b-b869-d221e1fbd8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:22.827012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cba6d-797a-4c9b-b869-d221e1fbd8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:22.827731 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cba6d-797a-4c9b-b869-d221e1fbd8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:22.829361 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cba6d-797a-4c9b-b869-d221e1fbd8bd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:22.840125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1228/2477] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:22.844533 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32431256-99ad-405e-833d-158b7b2c389d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:22.854490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32431256-99ad-405e-833d-158b7b2c389d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:22.858871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5220931-f73a-4a5b-bde8-7f75a3a20ff9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09eafdac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:22.866345 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5220931-f73a-4a5b-bde8-7f75a3a20ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:22.866345 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5220931-f73a-4a5b-bde8-7f75a3a20ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:22.866345 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5220931-f73a-4a5b-bde8-7f75a3a20ff9 admin admin] PATH_INFO: `/v3/projects/7857ff59828c476184e9bb04e4e457d1/users/d3dbb9c67b01425ab34d8ac47afe4ae5/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:22.866345 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5220931-f73a-4a5b-bde8-7f75a3a20ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7857ff59828c476184e9bb04e4e457d1, user_id=d3dbb9c67b01425ab34d8ac47afe4ae5, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:22.866345 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5220931-f73a-4a5b-bde8-7f75a3a20ff9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:22.875224 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1250/2478] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:22 2022] PUT /identity/v3/projects/7857ff59828c476184e9bb04e4e457d1/users/d3dbb9c67b01425ab34d8ac47afe4ae5/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:22.886325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ee292-e473-455d-8852-1a5993337710 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:22.886639 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ee292-e473-455d-8852-1a5993337710 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:22.886975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ee292-e473-455d-8852-1a5993337710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:22.924417 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e68ee292-e473-455d-8852-1a5993337710 None None] MFA Rules not processed for user `d3dbb9c67b01425ab34d8ac47afe4ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:22.928021 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e68ee292-e473-455d-8852-1a5993337710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:23.003786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1229/2479] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:22 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:23.014768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5220931-f73a-4a5b-bde8-7f75a3a20ff9 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:23.016507 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b5220931-f73a-4a5b-bde8-7f75a3a20ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:23.081570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5220931-f73a-4a5b-bde8-7f75a3a20ff9 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:23.085139 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40aa0d5-361e-4e32-bdbd-4d2ea0c1b3ff service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e1051f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:23.085725 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aa0d5-361e-4e32-bdbd-4d2ea0c1b3ff service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:23.086019 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aa0d5-361e-4e32-bdbd-4d2ea0c1b3ff service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:23.086305 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aa0d5-361e-4e32-bdbd-4d2ea0c1b3ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:23.088082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c40aa0d5-361e-4e32-bdbd-4d2ea0c1b3ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:23.153726 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40aa0d5-361e-4e32-bdbd-4d2ea0c1b3ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:23.157204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40aa0d5-361e-4e32-bdbd-4d2ea0c1b3ff service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:23.163808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1251/2480] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:23 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:06:25.543433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ee292-e473-455d-8852-1a5993337710 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:25.552902 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ee292-e473-455d-8852-1a5993337710 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:25.558838 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac50be-94b6-4344-9138-1f5097c4af58 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e3c4df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:25.558838 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac50be-94b6-4344-9138-1f5097c4af58 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:25.558838 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac50be-94b6-4344-9138-1f5097c4af58 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:25.558838 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac50be-94b6-4344-9138-1f5097c4af58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:25.621644 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac50be-94b6-4344-9138-1f5097c4af58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:25.623095 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac50be-94b6-4344-9138-1f5097c4af58 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:25.632672 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1230/2481] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:25 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:28.493803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40aa0d5-361e-4e32-bdbd-4d2ea0c1b3ff service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:28.502208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40aa0d5-361e-4e32-bdbd-4d2ea0c1b3ff service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:28.505623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87130641-8781-433b-a8cd-dd6e496cd653 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09dd90970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:28.506193 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87130641-8781-433b-a8cd-dd6e496cd653 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:28.506493 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87130641-8781-433b-a8cd-dd6e496cd653 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:28.506773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87130641-8781-433b-a8cd-dd6e496cd653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:28.516100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87130641-8781-433b-a8cd-dd6e496cd653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:28.517457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87130641-8781-433b-a8cd-dd6e496cd653 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:28.526429 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1252/2482] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:28 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:06:34.974830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac50be-94b6-4344-9138-1f5097c4af58 service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:35.049166 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac50be-94b6-4344-9138-1f5097c4af58 service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:35.053548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ae2e1-61c6-4f9c-8e17-5b330aed0955 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09defee20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:35.054349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae2e1-61c6-4f9c-8e17-5b330aed0955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:35.058135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae2e1-61c6-4f9c-8e17-5b330aed0955 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:35.058135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae2e1-61c6-4f9c-8e17-5b330aed0955 admin admin] PATH_INFO: `/v3/users/32b46c3b4e46493790ffd322460b4f2d` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:35.058135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ae2e1-61c6-4f9c-8e17-5b330aed0955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b46c3b4e46493790ffd322460b4f2d)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:35.059387 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ae2e1-61c6-4f9c-8e17-5b330aed0955 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:35.331595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ab0ae2e1-61c6-4f9c-8e17-5b330aed0955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b46c3b4e46493790ffd322460b4f2d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:35.366449 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87130641-8781-433b-a8cd-dd6e496cd653 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:35.377414 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87130641-8781-433b-a8cd-dd6e496cd653 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:35.381628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HarCtLQKQtC2HOujgXksvQ, audit_chain_id=['HarCtLQKQtC2HOujgXksvQ']) at 0x7fe09def9790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:35.382410 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:35.382701 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:35.382976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] PATH_INFO: `/v3/users/f40f5509c392494a9f6b2f801185190b` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:35.384165 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40f5509c392494a9f6b2f801185190b)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:35.386380 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:35.431268 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ab0ae2e1-61c6-4f9c-8e17-5b330aed0955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b46c3b4e46493790ffd322460b4f2d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:35.443865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ab0ae2e1-61c6-4f9c-8e17-5b330aed0955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b46c3b4e46493790ffd322460b4f2d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:35.444491 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ab0ae2e1-61c6-4f9c-8e17-5b330aed0955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b46c3b4e46493790ffd322460b4f2d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:35.445097 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ab0ae2e1-61c6-4f9c-8e17-5b330aed0955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b46c3b4e46493790ffd322460b4f2d'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:35.457684 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1231/2483] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:34 2022] DELETE /identity/v3/users/32b46c3b4e46493790ffd322460b4f2d => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:35.461984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d03d0d-3cab-4203-bf2c-f9fcf9f98004 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:35.462277 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d03d0d-3cab-4203-bf2c-f9fcf9f98004 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:35.462563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d03d0d-3cab-4203-bf2c-f9fcf9f98004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:35.486394 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a9d03d0d-3cab-4203-bf2c-f9fcf9f98004 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:35.487583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a9d03d0d-3cab-4203-bf2c-f9fcf9f98004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:35.551426 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1232/2484] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:06:35.562216 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d03d0d-3cab-4203-bf2c-f9fcf9f98004 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:35.563594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a9d03d0d-3cab-4203-bf2c-f9fcf9f98004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:35.604261 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40f5509c392494a9f6b2f801185190b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:35.616435 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40f5509c392494a9f6b2f801185190b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:35.617201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40f5509c392494a9f6b2f801185190b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:35.617964 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40f5509c392494a9f6b2f801185190b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:35.626707 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d03d0d-3cab-4203-bf2c-f9fcf9f98004 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:35.630410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cdac5-8669-4eba-832e-0e669782af17 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e8faa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:35.636242 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cdac5-8669-4eba-832e-0e669782af17 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:35.636242 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cdac5-8669-4eba-832e-0e669782af17 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:35.636242 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cdac5-8669-4eba-832e-0e669782af17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:35.636242 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a20cdac5-8669-4eba-832e-0e669782af17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:35.646723 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cdac5-8669-4eba-832e-0e669782af17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:35.648259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cdac5-8669-4eba-832e-0e669782af17 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:35.658193 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1233/2485] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:06:35.677390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40f5509c392494a9f6b2f801185190b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:35.693738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1253/2486] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:35 2022] DELETE /identity/v3/users/f40f5509c392494a9f6b2f801185190b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:35.696120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3a359-cdc6-41ed-aace-a604f636fdbe None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:35.696434 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3a359-cdc6-41ed-aace-a604f636fdbe None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:35.696705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3a359-cdc6-41ed-aace-a604f636fdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:35.719508 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-05f3a359-cdc6-41ed-aace-a604f636fdbe None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:35.722415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-05f3a359-cdc6-41ed-aace-a604f636fdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:35.787787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1234/2487] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:35.798215 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:35.799570 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:35.863255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cacf1-919d-430a-a929-0231f3a97ea3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:35.866706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8488d-fb63-4559-88b0-0a00bb56fd78 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e480dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:35.867327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8488d-fb63-4559-88b0-0a00bb56fd78 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:35.867620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8488d-fb63-4559-88b0-0a00bb56fd78 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:35.867905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8488d-fb63-4559-88b0-0a00bb56fd78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:35.877134 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8488d-fb63-4559-88b0-0a00bb56fd78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:35.878565 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8488d-fb63-4559-88b0-0a00bb56fd78 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:35.888643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1254/2488] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:36.266098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3a359-cdc6-41ed-aace-a604f636fdbe None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:36.268804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-05f3a359-cdc6-41ed-aace-a604f636fdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:36.286420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3a359-cdc6-41ed-aace-a604f636fdbe None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:36.292575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e1dfb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:36.293464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:36.293852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:36.294264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] PATH_INFO: `/v3/projects/35baf3f6a7af457aa3ab65cd2f43a0d0` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:36.295878 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35baf3f6a7af457aa3ab65cd2f43a0d0)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:36.307623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:36.421955 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35baf3f6a7af457aa3ab65cd2f43a0d0', 'request_id': 'req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.433581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35baf3f6a7af457aa3ab65cd2f43a0d0', 'request_id': 'req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.517192 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35baf3f6a7af457aa3ab65cd2f43a0d0', 'request_id': 'req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.526326 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8488d-fb63-4559-88b0-0a00bb56fd78 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:36.528560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-1be8488d-fb63-4559-88b0-0a00bb56fd78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:36.531803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] The token cache is being invalidate because project 35baf3f6a7af457aa3ab65cd2f43a0d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:36.532292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.533807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.539078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1235/2489] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:36 2022] DELETE /identity/v3/projects/35baf3f6a7af457aa3ab65cd2f43a0d0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:36.540447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:36.541873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:36.542061 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8488d-fb63-4559-88b0-0a00bb56fd78 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:36.604131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HarCtLQKQtC2HOujgXksvQ, audit_chain_id=['HarCtLQKQtC2HOujgXksvQ']) at 0x7fe09eba9a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:36.604950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:36.605240 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:36.605520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] PATH_INFO: `/v3/projects/802a715b4ed5468ab0efc3a06cbf242a` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:36.606620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=802a715b4ed5468ab0efc3a06cbf242a)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:36.608594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:36.613483 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fffcc3-1ec0-4e8c-a516-efaf05187d65 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:36.618094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fcfe8-50d9-40df-a776-4a5a2c80c94b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e3fa370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:36.618983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fcfe8-50d9-40df-a776-4a5a2c80c94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:36.619297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fcfe8-50d9-40df-a776-4a5a2c80c94b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:36.619585 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fcfe8-50d9-40df-a776-4a5a2c80c94b admin admin] PATH_INFO: `/v3/users/1a63363be1dc41abb38920a34dc2f843` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:36.621308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fcfe8-50d9-40df-a776-4a5a2c80c94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a63363be1dc41abb38920a34dc2f843)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:36.623243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fcfe8-50d9-40df-a776-4a5a2c80c94b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:36.746457 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802a715b4ed5468ab0efc3a06cbf242a', 'request_id': 'req-d2681dc7-0a55-4682-ae18-02d52a80a391'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.831802 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802a715b4ed5468ab0efc3a06cbf242a', 'request_id': 'req-d2681dc7-0a55-4682-ae18-02d52a80a391'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.846583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802a715b4ed5468ab0efc3a06cbf242a', 'request_id': 'req-d2681dc7-0a55-4682-ae18-02d52a80a391'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.859796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] The token cache is being invalidate because project 802a715b4ed5468ab0efc3a06cbf242a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:36.860086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.860797 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-d2681dc7-0a55-4682-ae18-02d52a80a391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.862320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1255/2490] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:36 2022] DELETE /identity/v3/projects/802a715b4ed5468ab0efc3a06cbf242a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:36.862499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3f3fcfe8-50d9-40df-a776-4a5a2c80c94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a63363be1dc41abb38920a34dc2f843'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.866842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0222f2-65f6-4010-a1df-c059db49fb76 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:36.867158 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0222f2-65f6-4010-a1df-c059db49fb76 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:36.867444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0222f2-65f6-4010-a1df-c059db49fb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:36.890061 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-aa0222f2-65f6-4010-a1df-c059db49fb76 None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:36.891263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-aa0222f2-65f6-4010-a1df-c059db49fb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:36.922764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3f3fcfe8-50d9-40df-a776-4a5a2c80c94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a63363be1dc41abb38920a34dc2f843'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.936920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3f3fcfe8-50d9-40df-a776-4a5a2c80c94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a63363be1dc41abb38920a34dc2f843'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.937731 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3f3fcfe8-50d9-40df-a776-4a5a2c80c94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a63363be1dc41abb38920a34dc2f843'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.938340 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-3f3fcfe8-50d9-40df-a776-4a5a2c80c94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a63363be1dc41abb38920a34dc2f843'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:36.952167 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1236/2491] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:36 2022] DELETE /identity/v3/users/1a63363be1dc41abb38920a34dc2f843 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:36.956359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1256/2492] 10.222.0.21 () {58 vars in 967 bytes} [Mon Feb 28 19:06:36 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:36.956567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7fc5e-b799-41de-ab3b-b35fad1f1e28 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:36.956918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7fc5e-b799-41de-ab3b-b35fad1f1e28 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:36.957245 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7fc5e-b799-41de-ab3b-b35fad1f1e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:36.980352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0222f2-65f6-4010-a1df-c059db49fb76 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:36.981889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-aa0222f2-65f6-4010-a1df-c059db49fb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:36.982124 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-46b7fc5e-b799-41de-ab3b-b35fad1f1e28 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:36.983303 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-46b7fc5e-b799-41de-ab3b-b35fad1f1e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:37.057461 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1237/2493] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:37.065155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0222f2-65f6-4010-a1df-c059db49fb76 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:37.066439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559429c9-c298-4621-8959-93d373fa55f3 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.066995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559429c9-c298-4621-8959-93d373fa55f3 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.067140 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559429c9-c298-4621-8959-93d373fa55f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.090551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-559429c9-c298-4621-8959-93d373fa55f3 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:37.091746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-559429c9-c298-4621-8959-93d373fa55f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:37.103388 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1238/2494] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:06:37.105603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559429c9-c298-4621-8959-93d373fa55f3 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:37.114737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559429c9-c298-4621-8959-93d373fa55f3 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:37.121563 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbe93c-c926-4574-8cda-627d124a67eb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7F4VjohES2Wh3JWNJiCW9Q, audit_chain_id=['7F4VjohES2Wh3JWNJiCW9Q']) at 0x7fe09e411790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:37.122303 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe93c-c926-4574-8cda-627d124a67eb admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.122600 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe93c-c926-4574-8cda-627d124a67eb admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.122884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe93c-c926-4574-8cda-627d124a67eb admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.123614 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbe93c-c926-4574-8cda-627d124a67eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:06:37.123921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbe93c-c926-4574-8cda-627d124a67eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:37.125598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbe93c-c926-4574-8cda-627d124a67eb admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:37.134945 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d46d2-3278-4d20-9001-31dd78567991 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e35fa00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:37.135664 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d46d2-3278-4d20-9001-31dd78567991 service swift] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.135958 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d46d2-3278-4d20-9001-31dd78567991 service swift] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.136237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d46d2-3278-4d20-9001-31dd78567991 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.138603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1239/2495] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:06:37.142900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbe93c-c926-4574-8cda-627d124a67eb admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:37.152833 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbe93c-c926-4574-8cda-627d124a67eb admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:37.157270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f577b3-e166-4953-b38e-fd1176e1c10d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7F4VjohES2Wh3JWNJiCW9Q, audit_chain_id=['7F4VjohES2Wh3JWNJiCW9Q']) at 0x7fe09e15b2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:37.157855 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f577b3-e166-4953-b38e-fd1176e1c10d admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.158145 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f577b3-e166-4953-b38e-fd1176e1c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.158431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f577b3-e166-4953-b38e-fd1176e1c10d admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.159060 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f577b3-e166-4953-b38e-fd1176e1c10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:37.160973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f577b3-e166-4953-b38e-fd1176e1c10d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:37.201760 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d46d2-3278-4d20-9001-31dd78567991 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:37.203430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d46d2-3278-4d20-9001-31dd78567991 service swift] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:37.211789 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1257/2496] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:06:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 28 19:06:37.336142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1240/2497] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:37 2022] POST /identity/v3/projects => generated 397 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:06:37.340892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d46d2-3278-4d20-9001-31dd78567991 service swift] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:37.351063 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d46d2-3278-4d20-9001-31dd78567991 service swift] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:37.415764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044c37e-0e53-4830-b34c-2a5a1f4bee00 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7F4VjohES2Wh3JWNJiCW9Q, audit_chain_id=['7F4VjohES2Wh3JWNJiCW9Q']) at 0x7fe09e540b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:37.416383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044c37e-0e53-4830-b34c-2a5a1f4bee00 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.416703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044c37e-0e53-4830-b34c-2a5a1f4bee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.416985 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044c37e-0e53-4830-b34c-2a5a1f4bee00 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.417626 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044c37e-0e53-4830-b34c-2a5a1f4bee00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:37.419577 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044c37e-0e53-4830-b34c-2a5a1f4bee00 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:37.442747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f577b3-e166-4953-b38e-fd1176e1c10d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:37.444293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-65f577b3-e166-4953-b38e-fd1176e1c10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:37.514017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f577b3-e166-4953-b38e-fd1176e1c10d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:37.517764 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb31496-7703-4eeb-9282-4b221d357376 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e3f3190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:37.518532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb31496-7703-4eeb-9282-4b221d357376 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.518833 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb31496-7703-4eeb-9282-4b221d357376 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.519134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb31496-7703-4eeb-9282-4b221d357376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.520963 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8eb31496-7703-4eeb-9282-4b221d357376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:37.540626 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1258/2498] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:37 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:37.542730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044c37e-0e53-4830-b34c-2a5a1f4bee00 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:37.544402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-5044c37e-0e53-4830-b34c-2a5a1f4bee00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:37.556352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044c37e-0e53-4830-b34c-2a5a1f4bee00 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:37.561475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e58caf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:37.562496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.562785 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.563066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] PATH_INFO: `/v3/projects/10ff8f52e9bf4643bbf61bd624408d39` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.564223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ff8f52e9bf4643bbf61bd624408d39)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:37.566132 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:37.611366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb31496-7703-4eeb-9282-4b221d357376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:37.612862 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb31496-7703-4eeb-9282-4b221d357376 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:37.623893 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1241/2499] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:37 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:06:37.625062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb31496-7703-4eeb-9282-4b221d357376 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:37.634828 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb31496-7703-4eeb-9282-4b221d357376 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:37.639857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf57b7-baee-4273-8da1-f144c6d25f46 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7F4VjohES2Wh3JWNJiCW9Q, audit_chain_id=['7F4VjohES2Wh3JWNJiCW9Q']) at 0x7fe09de98af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:37.640453 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf57b7-baee-4273-8da1-f144c6d25f46 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.640740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf57b7-baee-4273-8da1-f144c6d25f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.641018 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf57b7-baee-4273-8da1-f144c6d25f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.641914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf57b7-baee-4273-8da1-f144c6d25f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:37.643529 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf57b7-baee-4273-8da1-f144c6d25f46 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:37.655427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1242/2500] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:37.659232 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf57b7-baee-4273-8da1-f144c6d25f46 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:37.669415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf57b7-baee-4273-8da1-f144c6d25f46 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:37.674091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd34c5-75ef-4bb5-99e4-a4f11cbe3a00 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7F4VjohES2Wh3JWNJiCW9Q, audit_chain_id=['7F4VjohES2Wh3JWNJiCW9Q']) at 0x7fe09de52af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:37.674714 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd34c5-75ef-4bb5-99e4-a4f11cbe3a00 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.675008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd34c5-75ef-4bb5-99e4-a4f11cbe3a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.675357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd34c5-75ef-4bb5-99e4-a4f11cbe3a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.676070 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd34c5-75ef-4bb5-99e4-a4f11cbe3a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:37.677661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd34c5-75ef-4bb5-99e4-a4f11cbe3a00 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:37.689005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1243/2501] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:37.692842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd34c5-75ef-4bb5-99e4-a4f11cbe3a00 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:37.704576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd34c5-75ef-4bb5-99e4-a4f11cbe3a00 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:37.718660 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ff8f52e9bf4643bbf61bd624408d39', 'request_id': 'req-f2a46602-a520-4f69-9f00-0bac8da39a51'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:37.774452 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ff8f52e9bf4643bbf61bd624408d39', 'request_id': 'req-f2a46602-a520-4f69-9f00-0bac8da39a51'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:37.777346 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c704bc7-4035-4d0e-b270-8e01220ca6e0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7F4VjohES2Wh3JWNJiCW9Q, audit_chain_id=['7F4VjohES2Wh3JWNJiCW9Q']) at 0x7fe09e2721f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:37.778182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c704bc7-4035-4d0e-b270-8e01220ca6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.778469 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c704bc7-4035-4d0e-b270-8e01220ca6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.778754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c704bc7-4035-4d0e-b270-8e01220ca6e0 admin admin] PATH_INFO: `/v3/projects/47674e7732044e1a9a5918add0f2f190/users/e1158fad3b3d40c5bdb07b7d7cdd2a39/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.793047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ff8f52e9bf4643bbf61bd624408d39', 'request_id': 'req-f2a46602-a520-4f69-9f00-0bac8da39a51'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:37.798830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] The token cache is being invalidate because project 10ff8f52e9bf4643bbf61bd624408d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:37.798830 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:37.799378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:37.800862 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1259/2502] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:37 2022] DELETE /identity/v3/projects/10ff8f52e9bf4643bbf61bd624408d39 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:37.804892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:37.805525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c704bc7-4035-4d0e-b270-8e01220ca6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47674e7732044e1a9a5918add0f2f190, user_id=e1158fad3b3d40c5bdb07b7d7cdd2a39, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:37.806235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:37.809389 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c704bc7-4035-4d0e-b270-8e01220ca6e0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:37.819841 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a46602-a520-4f69-9f00-0bac8da39a51 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:37.824456 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09e6ad7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:37.825255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.825544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.825819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] PATH_INFO: `/v3/users/d3dbb9c67b01425ab34d8ac47afe4ae5` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.826929 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3dbb9c67b01425ab34d8ac47afe4ae5)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:37.829038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:37.947966 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1244/2503] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:37 2022] PUT /identity/v3/projects/47674e7732044e1a9a5918add0f2f190/users/e1158fad3b3d40c5bdb07b7d7cdd2a39/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:37.959150 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dae10-299a-435e-9618-e6aca7eb3b1c None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:37.959532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dae10-299a-435e-9618-e6aca7eb3b1c None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:37.959917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dae10-299a-435e-9618-e6aca7eb3b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:37.997466 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-099dae10-299a-435e-9618-e6aca7eb3b1c None None] MFA Rules not processed for user `e1158fad3b3d40c5bdb07b7d7cdd2a39`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:37.998631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-099dae10-299a-435e-9618-e6aca7eb3b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:38.010379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3dbb9c67b01425ab34d8ac47afe4ae5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:38.022466 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3dbb9c67b01425ab34d8ac47afe4ae5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:38.023292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3dbb9c67b01425ab34d8ac47afe4ae5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:38.023913 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3dbb9c67b01425ab34d8ac47afe4ae5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:38.072867 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1245/2504] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:37 2022] POST /identity/v3/auth/tokens => generated 3704 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:38.082634 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dae10-299a-435e-9618-e6aca7eb3b1c None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:38.083972 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-099dae10-299a-435e-9618-e6aca7eb3b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:38.100032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3dbb9c67b01425ab34d8ac47afe4ae5'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:38.114568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1260/2505] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:37 2022] DELETE /identity/v3/users/d3dbb9c67b01425ab34d8ac47afe4ae5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:38.150130 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dae10-299a-435e-9618-e6aca7eb3b1c None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:38.213470 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c754a-1b29-40f4-929f-566676eb0a1e service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e1ccbb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:38.214801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c754a-1b29-40f4-929f-566676eb0a1e service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:38.215289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c754a-1b29-40f4-929f-566676eb0a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:38.215584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c754a-1b29-40f4-929f-566676eb0a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:38.284975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c754a-1b29-40f4-929f-566676eb0a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:38.286591 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c754a-1b29-40f4-929f-566676eb0a1e service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:38.296678 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1246/2506] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:38 2022] GET /identity/v3/auth/tokens => generated 3704 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:06:38.699051 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:38.700654 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:38.775310 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a27d1-7dd1-4679-839c-c0498073257d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:38.780417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k97FaVlUS9Cn957QniJ6JQ, audit_chain_id=['k97FaVlUS9Cn957QniJ6JQ']) at 0x7fe09ddcf790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:38.781199 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:38.781489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:38.781784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] PATH_INFO: `/v3/projects/7857ff59828c476184e9bb04e4e457d1` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:38.782872 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7857ff59828c476184e9bb04e4e457d1)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:38.784774 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:38.885464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c754a-1b29-40f4-929f-566676eb0a1e service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:38.887172 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-509c754a-1b29-40f4-929f-566676eb0a1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:38.954381 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c754a-1b29-40f4-929f-566676eb0a1e service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:38.956092 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7857ff59828c476184e9bb04e4e457d1', 'request_id': 'req-7140f8d6-2423-4554-856d-7f40d54c71bd'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:39.011325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cab9b-49e6-41e9-a76b-e14eb7fd3298 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e3d54c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:39.011924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cab9b-49e6-41e9-a76b-e14eb7fd3298 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:39.012218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cab9b-49e6-41e9-a76b-e14eb7fd3298 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:39.012496 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cab9b-49e6-41e9-a76b-e14eb7fd3298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:39.014187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4b9cab9b-49e6-41e9-a76b-e14eb7fd3298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:39.037058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7857ff59828c476184e9bb04e4e457d1', 'request_id': 'req-7140f8d6-2423-4554-856d-7f40d54c71bd'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:39.050204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7857ff59828c476184e9bb04e4e457d1', 'request_id': 'req-7140f8d6-2423-4554-856d-7f40d54c71bd'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:39.061099 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] The token cache is being invalidate because project 7857ff59828c476184e9bb04e4e457d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:39.061798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:39.062656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:39.064649 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1261/2507] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:38 2022] DELETE /identity/v3/projects/7857ff59828c476184e9bb04e4e457d1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:39.110481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cab9b-49e6-41e9-a76b-e14eb7fd3298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:39.111999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cab9b-49e6-41e9-a76b-e14eb7fd3298 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:39.125179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1247/2508] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:38 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:06:47.869252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:47.871227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:47.940984 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140f8d6-2423-4554-856d-7f40d54c71bd admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:47.945468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7F4VjohES2Wh3JWNJiCW9Q, audit_chain_id=['7F4VjohES2Wh3JWNJiCW9Q']) at 0x7fe09e480dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:47.946260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:47.946553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:47.946842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] PATH_INFO: `/v3/users/e1158fad3b3d40c5bdb07b7d7cdd2a39` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:47.949339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1158fad3b3d40c5bdb07b7d7cdd2a39)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:47.951303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:48.124637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1158fad3b3d40c5bdb07b7d7cdd2a39'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:48.136404 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1158fad3b3d40c5bdb07b7d7cdd2a39'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:48.137090 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1158fad3b3d40c5bdb07b7d7cdd2a39'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:48.137696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1158fad3b3d40c5bdb07b7d7cdd2a39'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:48.242601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1158fad3b3d40c5bdb07b7d7cdd2a39'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:48.256333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1262/2509] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:06:47 2022] DELETE /identity/v3/users/e1158fad3b3d40c5bdb07b7d7cdd2a39 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:48.261015 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b383e-238b-49e4-a745-55e293a2585d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:48.261532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b383e-238b-49e4-a745-55e293a2585d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:48.261630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b383e-238b-49e4-a745-55e293a2585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:48.283363 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-636b383e-238b-49e4-a745-55e293a2585d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:48.284523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-636b383e-238b-49e4-a745-55e293a2585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:48.348914 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1248/2510] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:48.359593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:48.360905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:48.424387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955b088-88b4-4cba-b008-e01f5bd14f02 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:48.427856 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f203c5-dee1-487e-872c-c09dd1d8152b service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09de9b190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:48.428437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f203c5-dee1-487e-872c-c09dd1d8152b service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:48.428729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f203c5-dee1-487e-872c-c09dd1d8152b service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:48.429010 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f203c5-dee1-487e-872c-c09dd1d8152b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:48.438394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f203c5-dee1-487e-872c-c09dd1d8152b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:48.439850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f203c5-dee1-487e-872c-c09dd1d8152b service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:48.449092 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1263/2511] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:48.899881 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b383e-238b-49e4-a745-55e293a2585d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:48.902104 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-636b383e-238b-49e4-a745-55e293a2585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:48.914860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b383e-238b-49e4-a745-55e293a2585d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:48.919624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7F4VjohES2Wh3JWNJiCW9Q, audit_chain_id=['7F4VjohES2Wh3JWNJiCW9Q']) at 0x7fe09e1980d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:48.920424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:48.920705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:48.920985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] PATH_INFO: `/v3/projects/47674e7732044e1a9a5918add0f2f190` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:48.922091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47674e7732044e1a9a5918add0f2f190)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:48.924072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:49.066316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47674e7732044e1a9a5918add0f2f190', 'request_id': 'req-13d768d4-d042-4be1-92aa-b3b9373fffd9'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:49.077938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47674e7732044e1a9a5918add0f2f190', 'request_id': 'req-13d768d4-d042-4be1-92aa-b3b9373fffd9'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:49.145415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47674e7732044e1a9a5918add0f2f190', 'request_id': 'req-13d768d4-d042-4be1-92aa-b3b9373fffd9'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:49.155952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] The token cache is being invalidate because project 47674e7732044e1a9a5918add0f2f190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:06:49.156233 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:49.156847 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-13d768d4-d042-4be1-92aa-b3b9373fffd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:06:49.158283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1249/2512] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:06:48 2022] DELETE /identity/v3/projects/47674e7732044e1a9a5918add0f2f190 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:49.163321 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6609af-ceb4-479d-9125-bf4333c5ca0b None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:49.165971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6609af-ceb4-479d-9125-bf4333c5ca0b None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:49.165971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6609af-ceb4-479d-9125-bf4333c5ca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:49.186926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-4d6609af-ceb4-479d-9125-bf4333c5ca0b None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:49.188140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-4d6609af-ceb4-479d-9125-bf4333c5ca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:49.253728 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1264/2513] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:06:49.261926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50575d-f685-4b86-afa2-7472e67aa704 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:49.262418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50575d-f685-4b86-afa2-7472e67aa704 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:49.262535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50575d-f685-4b86-afa2-7472e67aa704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:49.285368 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-be50575d-f685-4b86-afa2-7472e67aa704 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:49.286499 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-be50575d-f685-4b86-afa2-7472e67aa704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:49.294757 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1250/2514] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:49.299019 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6609af-ceb4-479d-9125-bf4333c5ca0b None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:49.308562 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6609af-ceb4-479d-9125-bf4333c5ca0b None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:49.312956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5dc5a-cb1f-47c4-8489-6ac1bc874331 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09e8e0b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:49.313548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5dc5a-cb1f-47c4-8489-6ac1bc874331 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:49.313843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5dc5a-cb1f-47c4-8489-6ac1bc874331 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:49.314129 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5dc5a-cb1f-47c4-8489-6ac1bc874331 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:49.314817 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5dc5a-cb1f-47c4-8489-6ac1bc874331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:06:49.315140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5dc5a-cb1f-47c4-8489-6ac1bc874331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:49.316739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5dc5a-cb1f-47c4-8489-6ac1bc874331 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:49.329217 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1265/2515] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:06:49.333288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50575d-f685-4b86-afa2-7472e67aa704 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:49.342640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50575d-f685-4b86-afa2-7472e67aa704 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:49.347012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5b68d-7d9a-4928-8f07-d47153439e34 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09e3c4820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:49.347624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5b68d-7d9a-4928-8f07-d47153439e34 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:49.347908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5b68d-7d9a-4928-8f07-d47153439e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:49.348183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5b68d-7d9a-4928-8f07-d47153439e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:49.348814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5b68d-7d9a-4928-8f07-d47153439e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:49.350691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5b68d-7d9a-4928-8f07-d47153439e34 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:49.438262 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1251/2516] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:49 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:49.442406 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5dc5a-cb1f-47c4-8489-6ac1bc874331 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:49.452144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5dc5a-cb1f-47c4-8489-6ac1bc874331 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:49.515827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a11c7-2c45-42a7-8235-e7f0da586ed2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09e1aec10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:49.516337 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a11c7-2c45-42a7-8235-e7f0da586ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:49.516628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a11c7-2c45-42a7-8235-e7f0da586ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:49.516911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a11c7-2c45-42a7-8235-e7f0da586ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:49.517549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a11c7-2c45-42a7-8235-e7f0da586ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:49.519474 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a11c7-2c45-42a7-8235-e7f0da586ed2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:49.625864 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1266/2517] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:49 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:06:49.630018 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5b68d-7d9a-4928-8f07-d47153439e34 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:49.640679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5b68d-7d9a-4928-8f07-d47153439e34 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:49.645154 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beb073-25d5-49c7-b5ea-a33017ed1175 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09e14a8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:49.645776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beb073-25d5-49c7-b5ea-a33017ed1175 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:49.646061 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beb073-25d5-49c7-b5ea-a33017ed1175 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:49.646342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beb073-25d5-49c7-b5ea-a33017ed1175 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:49.647055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23beb073-25d5-49c7-b5ea-a33017ed1175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:49.648690 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23beb073-25d5-49c7-b5ea-a33017ed1175 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:49.659596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1252/2518] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:06:49.663378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a11c7-2c45-42a7-8235-e7f0da586ed2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:49.673264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a11c7-2c45-42a7-8235-e7f0da586ed2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:49.677728 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630b8a4-3f9e-46c7-bfed-3899483e9b1b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09ddfdaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:49.678350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630b8a4-3f9e-46c7-bfed-3899483e9b1b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:49.678641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630b8a4-3f9e-46c7-bfed-3899483e9b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:49.678924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630b8a4-3f9e-46c7-bfed-3899483e9b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:49.679658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630b8a4-3f9e-46c7-bfed-3899483e9b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:49.681252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630b8a4-3f9e-46c7-bfed-3899483e9b1b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:49.691431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1267/2519] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:49.695266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beb073-25d5-49c7-b5ea-a33017ed1175 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:49.705846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beb073-25d5-49c7-b5ea-a33017ed1175 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:49.710627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044a082-74cb-4b8d-bd1e-6c3d0a95c0f4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09df261f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:49.711452 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044a082-74cb-4b8d-bd1e-6c3d0a95c0f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:49.711732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044a082-74cb-4b8d-bd1e-6c3d0a95c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:49.712010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044a082-74cb-4b8d-bd1e-6c3d0a95c0f4 admin admin] PATH_INFO: `/v3/projects/90acc320256d4622a351a587d9f604c3/users/59f038939b324d9b8e7214cec4e82933/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:49.731615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044a082-74cb-4b8d-bd1e-6c3d0a95c0f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90acc320256d4622a351a587d9f604c3, user_id=59f038939b324d9b8e7214cec4e82933, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:49.734205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044a082-74cb-4b8d-bd1e-6c3d0a95c0f4 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:49.813806 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1253/2520] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:49 2022] PUT /identity/v3/projects/90acc320256d4622a351a587d9f604c3/users/59f038939b324d9b8e7214cec4e82933/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:06:49.818685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059db0-d910-4c02-b814-b47442bc908e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:49.819012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059db0-d910-4c02-b814-b47442bc908e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:49.819331 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059db0-d910-4c02-b814-b47442bc908e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:49.842703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-68059db0-d910-4c02-b814-b47442bc908e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:49.843915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-68059db0-d910-4c02-b814-b47442bc908e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:49.908117 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1268/2521] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:49.918260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044a082-74cb-4b8d-bd1e-6c3d0a95c0f4 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:49.919901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c044a082-74cb-4b8d-bd1e-6c3d0a95c0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:49.984937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044a082-74cb-4b8d-bd1e-6c3d0a95c0f4 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:49.988420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc35652-8061-4e3a-b7a9-c8f767a22a71 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e472fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:49.989005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc35652-8061-4e3a-b7a9-c8f767a22a71 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:49.989289 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc35652-8061-4e3a-b7a9-c8f767a22a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:49.989567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc35652-8061-4e3a-b7a9-c8f767a22a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:49.999007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc35652-8061-4e3a-b7a9-c8f767a22a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:50.001372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc35652-8061-4e3a-b7a9-c8f767a22a71 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:50.009405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1254/2522] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:06:49 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:06:57.173799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8b043-7f87-4a2c-a7b9-7299696a40a8 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:57.174320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8b043-7f87-4a2c-a7b9-7299696a40a8 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:57.174438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8b043-7f87-4a2c-a7b9-7299696a40a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:57.209843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-14b8b043-7f87-4a2c-a7b9-7299696a40a8 None None] MFA Rules not processed for user `59f038939b324d9b8e7214cec4e82933`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:06:57.210982 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-14b8b043-7f87-4a2c-a7b9-7299696a40a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:06:57.281978 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1269/2523] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:06:57 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:06:57.286364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc35652-8061-4e3a-b7a9-c8f767a22a71 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:57.295934 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc35652-8061-4e3a-b7a9-c8f767a22a71 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:57.300256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94fd53-9140-489d-a66a-11232b029395 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09e1cc5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:57.300857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fd53-9140-489d-a66a-11232b029395 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:57.301142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fd53-9140-489d-a66a-11232b029395 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:57.301427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fd53-9140-489d-a66a-11232b029395 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:57.302062 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94fd53-9140-489d-a66a-11232b029395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:57.303972 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94fd53-9140-489d-a66a-11232b029395 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:57.444055 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1255/2524] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:06:57 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:06:57.449328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8b043-7f87-4a2c-a7b9-7299696a40a8 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:57.459877 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8b043-7f87-4a2c-a7b9-7299696a40a8 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:57.540841 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e1387-97e4-457e-8bdb-c91898fd91dd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09e45d700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:57.541656 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e1387-97e4-457e-8bdb-c91898fd91dd admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:57.541926 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e1387-97e4-457e-8bdb-c91898fd91dd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:57.542369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e1387-97e4-457e-8bdb-c91898fd91dd admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:57.543207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e1387-97e4-457e-8bdb-c91898fd91dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:57.545136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e1387-97e4-457e-8bdb-c91898fd91dd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:57.634699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1270/2525] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:06:57 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:06:57.637550 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94fd53-9140-489d-a66a-11232b029395 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:57.647631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94fd53-9140-489d-a66a-11232b029395 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:57.652038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2efa6-e526-4a0c-89e8-736d24ade359 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09deb47c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:57.652637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2efa6-e526-4a0c-89e8-736d24ade359 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:57.652959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2efa6-e526-4a0c-89e8-736d24ade359 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:57.653359 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2efa6-e526-4a0c-89e8-736d24ade359 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:57.654090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2efa6-e526-4a0c-89e8-736d24ade359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:57.655768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2efa6-e526-4a0c-89e8-736d24ade359 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:57.666152 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1256/2526] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:57.670327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e1387-97e4-457e-8bdb-c91898fd91dd admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:57.680155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e1387-97e4-457e-8bdb-c91898fd91dd admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:57.685700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1c76b-be7c-47a9-a159-254a1dcb03e9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09e108e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:57.686402 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1c76b-be7c-47a9-a159-254a1dcb03e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:57.686696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1c76b-be7c-47a9-a159-254a1dcb03e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:57.686980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1c76b-be7c-47a9-a159-254a1dcb03e9 admin admin] PATH_INFO: `/v3/projects/884f946601014cdfa5f7bbc37ad6562a/users/f9112c65bae44090ba2a77bfe98cf2eb/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:57.709045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1c76b-be7c-47a9-a159-254a1dcb03e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884f946601014cdfa5f7bbc37ad6562a, user_id=f9112c65bae44090ba2a77bfe98cf2eb, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:57.712126 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1c76b-be7c-47a9-a159-254a1dcb03e9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:57.763952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1271/2527] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:57 2022] PUT /identity/v3/projects/884f946601014cdfa5f7bbc37ad6562a/users/f9112c65bae44090ba2a77bfe98cf2eb/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:06:57.767883 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2efa6-e526-4a0c-89e8-736d24ade359 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:57.777759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2efa6-e526-4a0c-89e8-736d24ade359 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:57.844276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64149c-4567-4342-a0de-d44e3af29ada admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09dec95b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:57.844887 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64149c-4567-4342-a0de-d44e3af29ada admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:57.845179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64149c-4567-4342-a0de-d44e3af29ada admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:57.845466 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64149c-4567-4342-a0de-d44e3af29ada admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:57.846165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64149c-4567-4342-a0de-d44e3af29ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:57.847919 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64149c-4567-4342-a0de-d44e3af29ada admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:57.858807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1257/2528] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:06:57.863086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1c76b-be7c-47a9-a159-254a1dcb03e9 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:06:57.872971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1c76b-be7c-47a9-a159-254a1dcb03e9 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:06:57.877543 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103db824-bf6a-4731-92ed-a091442cc000 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dFNbxCAdRbKJZxqnHK8c1Q, audit_chain_id=['dFNbxCAdRbKJZxqnHK8c1Q']) at 0x7fe09ddfdaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:06:57.878383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103db824-bf6a-4731-92ed-a091442cc000 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:06:57.878673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103db824-bf6a-4731-92ed-a091442cc000 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:06:57.878958 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103db824-bf6a-4731-92ed-a091442cc000 admin admin] PATH_INFO: `/v3/projects/884f946601014cdfa5f7bbc37ad6562a/users/f9112c65bae44090ba2a77bfe98cf2eb/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:06:57.880773 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103db824-bf6a-4731-92ed-a091442cc000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884f946601014cdfa5f7bbc37ad6562a, user_id=f9112c65bae44090ba2a77bfe98cf2eb, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:06:57.883396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103db824-bf6a-4731-92ed-a091442cc000 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:06:57.894259 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1272/2529] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:06:57 2022] PUT /identity/v3/projects/884f946601014cdfa5f7bbc37ad6562a/users/f9112c65bae44090ba2a77bfe98cf2eb/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:07:02.823430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64149c-4567-4342-a0de-d44e3af29ada admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:07:02.826668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ff64149c-4567-4342-a0de-d44e3af29ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:02.918739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64149c-4567-4342-a0de-d44e3af29ada admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:07:03.000744 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d9d7a-c7df-411d-828d-a1d0ec7ea7ac service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e3d5e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:07:03.001601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d9d7a-c7df-411d-828d-a1d0ec7ea7ac service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:03.001895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d9d7a-c7df-411d-828d-a1d0ec7ea7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:03.002224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d9d7a-c7df-411d-828d-a1d0ec7ea7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:03.004082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-586d9d7a-c7df-411d-828d-a1d0ec7ea7ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:03.084674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d9d7a-c7df-411d-828d-a1d0ec7ea7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:07:03.084674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d9d7a-c7df-411d-828d-a1d0ec7ea7ac service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:07:03.093421 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1258/2530] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:07:02 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:07:05.218634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9ff7c-02f0-4de5-bc9c-9141bad1b6ea None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:05.219072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9ff7c-02f0-4de5-bc9c-9141bad1b6ea None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:05.219185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9ff7c-02f0-4de5-bc9c-9141bad1b6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:05.258104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-58c9ff7c-02f0-4de5-bc9c-9141bad1b6ea None None] MFA Rules not processed for user `f9112c65bae44090ba2a77bfe98cf2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:07:05.259311 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-58c9ff7c-02f0-4de5-bc9c-9141bad1b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:05.339302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1273/2531] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:07:05 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:07:05.350173 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d9d7a-c7df-411d-828d-a1d0ec7ea7ac service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:07:05.352486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-586d9d7a-c7df-411d-828d-a1d0ec7ea7ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:05.437083 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d9d7a-c7df-411d-828d-a1d0ec7ea7ac service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:07:05.442427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6631cf6-4f7c-4ee0-94e0-981c2cdb9dbf service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=wTjUJdAdSkmocIsusTZBDA, audit_chain_id=['wTjUJdAdSkmocIsusTZBDA']) at 0x7fe09e2721f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:07:05.442960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6631cf6-4f7c-4ee0-94e0-981c2cdb9dbf service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:05.443279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6631cf6-4f7c-4ee0-94e0-981c2cdb9dbf service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:05.443564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6631cf6-4f7c-4ee0-94e0-981c2cdb9dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:05.507045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6631cf6-4f7c-4ee0-94e0-981c2cdb9dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:07:05.508657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6631cf6-4f7c-4ee0-94e0-981c2cdb9dbf service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:07:05.517732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1259/2532] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:07:05 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:07:21.096049 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9ff7c-02f0-4de5-bc9c-9141bad1b6ea None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:07:21.097386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-58c9ff7c-02f0-4de5-bc9c-9141bad1b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:21.160408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9ff7c-02f0-4de5-bc9c-9141bad1b6ea None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:07:21.164146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9f173-07d4-4116-97a3-6b4f60eb2be6 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e45d430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:07:21.164724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f173-07d4-4116-97a3-6b4f60eb2be6 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:21.165040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f173-07d4-4116-97a3-6b4f60eb2be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:21.165854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f173-07d4-4116-97a3-6b4f60eb2be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:21.167576 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b4b9f173-07d4-4116-97a3-6b4f60eb2be6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:21.176847 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9f173-07d4-4116-97a3-6b4f60eb2be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:07:21.178249 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9f173-07d4-4116-97a3-6b4f60eb2be6 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:07:21.186586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1274/2533] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:07:21 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:07:31.337657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf858-3725-48a0-bcaa-2ff6aa7f12ac None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:31.338284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf858-3725-48a0-bcaa-2ff6aa7f12ac None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:31.338284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf858-3725-48a0-bcaa-2ff6aa7f12ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:31.367825 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-c6daf858-3725-48a0-bcaa-2ff6aa7f12ac None None] MFA Rules not processed for user `59f038939b324d9b8e7214cec4e82933`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:07:31.369629 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c6daf858-3725-48a0-bcaa-2ff6aa7f12ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:31.376283 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1260/2534] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:07:31 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:07:32.139475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9f173-07d4-4116-97a3-6b4f60eb2be6 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:07:32.147958 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9f173-07d4-4116-97a3-6b4f60eb2be6 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:07:32.152251 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf8da5-c5d4-44fb-af9c-3136d5d9c5f6 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09de9b5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:07:32.152826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf8da5-c5d4-44fb-af9c-3136d5d9c5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:32.153123 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf8da5-c5d4-44fb-af9c-3136d5d9c5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:32.153407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf8da5-c5d4-44fb-af9c-3136d5d9c5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:32.155060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b7cf8da5-c5d4-44fb-af9c-3136d5d9c5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:32.165672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf8da5-c5d4-44fb-af9c-3136d5d9c5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:07:32.166611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf8da5-c5d4-44fb-af9c-3136d5d9c5f6 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:07:32.174434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1275/2535] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:07:32 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:07:33.115366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daf858-3725-48a0-bcaa-2ff6aa7f12ac None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:07:33.116823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-c6daf858-3725-48a0-bcaa-2ff6aa7f12ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:33.200697 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daf858-3725-48a0-bcaa-2ff6aa7f12ac None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:07:33.205850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb148-cb07-487a-b75a-c2c53a883960 service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=RLyH0N9xSwiZDKvJxMSolg, audit_chain_id=['RLyH0N9xSwiZDKvJxMSolg']) at 0x7fe09e3f3bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f330acd453f445ea31acf9fc43b53ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:07:33.206444 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb148-cb07-487a-b75a-c2c53a883960 service placement] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:33.206739 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb148-cb07-487a-b75a-c2c53a883960 service placement] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:33.207029 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb148-cb07-487a-b75a-c2c53a883960 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:33.208767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f0cbb148-cb07-487a-b75a-c2c53a883960 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:33.220834 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbb148-cb07-487a-b75a-c2c53a883960 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:07:33.222441 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbb148-cb07-487a-b75a-c2c53a883960 service placement] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:07:33.233279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1261/2536] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:07:33 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:07:33.330976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf8da5-c5d4-44fb-af9c-3136d5d9c5f6 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:07:33.332437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b7cf8da5-c5d4-44fb-af9c-3136d5d9c5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:33.345961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf8da5-c5d4-44fb-af9c-3136d5d9c5f6 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:07:33.350531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e694-ccdf-49aa-a0e9-e11feb840cdd service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=PTVXDCHNQWCQjy3BZQYY3Q, audit_chain_id=['PTVXDCHNQWCQjy3BZQYY3Q']) at 0x7fe09e9c3f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f330acd453f445ea31acf9fc43b53ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:07:33.351100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e694-ccdf-49aa-a0e9-e11feb840cdd service placement] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:33.351438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e694-ccdf-49aa-a0e9-e11feb840cdd service placement] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:33.351721 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e694-ccdf-49aa-a0e9-e11feb840cdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:33.354163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-58b4e694-ccdf-49aa-a0e9-e11feb840cdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:33.364597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4e694-ccdf-49aa-a0e9-e11feb840cdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:07:33.366155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4e694-ccdf-49aa-a0e9-e11feb840cdd service placement] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:07:33.376300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1276/2537] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:07:33 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:07:37.820707 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb148-cb07-487a-b75a-c2c53a883960 service placement] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:07:37.822804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f0cbb148-cb07-487a-b75a-c2c53a883960 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:37.843506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb148-cb07-487a-b75a-c2c53a883960 service placement] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:07:37.851127 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd91209-121b-4bb9-9eec-eb1e33d3e507 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=VPv8sXhDS8CbQz_czxciPg, audit_chain_id=['VPv8sXhDS8CbQz_czxciPg']) at 0x7fe09ea18d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:07:37.851922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd91209-121b-4bb9-9eec-eb1e33d3e507 service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:37.852895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd91209-121b-4bb9-9eec-eb1e33d3e507 service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:37.854215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd91209-121b-4bb9-9eec-eb1e33d3e507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:37.856353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-6cd91209-121b-4bb9-9eec-eb1e33d3e507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:37.871358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd91209-121b-4bb9-9eec-eb1e33d3e507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:07:37.872991 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd91209-121b-4bb9-9eec-eb1e33d3e507 service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:07:37.887700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1262/2538] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:07:37 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:07:43.262951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e694-ccdf-49aa-a0e9-e11feb840cdd service placement] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:07:43.275399 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e694-ccdf-49aa-a0e9-e11feb840cdd service placement] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:07:43.280972 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a379c33-bda3-4122-83be-989339951fb9 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=VPv8sXhDS8CbQz_czxciPg, audit_chain_id=['VPv8sXhDS8CbQz_czxciPg']) at 0x7fe09ddd57c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:07:43.281544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a379c33-bda3-4122-83be-989339951fb9 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:43.281831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a379c33-bda3-4122-83be-989339951fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:43.282110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a379c33-bda3-4122-83be-989339951fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:43.283781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6a379c33-bda3-4122-83be-989339951fb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:43.354581 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a379c33-bda3-4122-83be-989339951fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:07:43.356188 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a379c33-bda3-4122-83be-989339951fb9 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:07:43.364915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1277/2539] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:07:43 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:07:49.201718 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd91209-121b-4bb9-9eec-eb1e33d3e507 service nova] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:07:49.212883 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd91209-121b-4bb9-9eec-eb1e33d3e507 service nova] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:07:49.218080 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09231d4-37ee-47f0-ade1-09dd3537076a service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=VPv8sXhDS8CbQz_czxciPg, audit_chain_id=['VPv8sXhDS8CbQz_czxciPg']) at 0x7fe09e17f250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:07:49.218654 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09231d4-37ee-47f0-ade1-09dd3537076a service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:49.218939 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09231d4-37ee-47f0-ade1-09dd3537076a service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:49.219261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09231d4-37ee-47f0-ade1-09dd3537076a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:49.220938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e09231d4-37ee-47f0-ade1-09dd3537076a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:49.233819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09231d4-37ee-47f0-ade1-09dd3537076a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:07:49.235411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09231d4-37ee-47f0-ade1-09dd3537076a service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:07:49.245442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1263/2540] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:07:49 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:07:52.079928 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a379c33-bda3-4122-83be-989339951fb9 service nova] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:07:52.090601 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a379c33-bda3-4122-83be-989339951fb9 service nova] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:07:52.094176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d80a84-4906-4b11-b087-faf66f19c0e1 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e123c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:07:52.094754 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80a84-4906-4b11-b087-faf66f19c0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:52.095042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80a84-4906-4b11-b087-faf66f19c0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:52.095355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80a84-4906-4b11-b087-faf66f19c0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:52.108318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d80a84-4906-4b11-b087-faf66f19c0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:07:52.108318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d80a84-4906-4b11-b087-faf66f19c0e1 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:07:52.115604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1278/2541] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:07:52 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:07:55.253830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09231d4-37ee-47f0-ade1-09dd3537076a service nova] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:07:55.265207 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09231d4-37ee-47f0-ade1-09dd3537076a service nova] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:07:55.270650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3d774-5e80-47c6-bd91-83f93ed93d7f service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=wTjUJdAdSkmocIsusTZBDA, audit_chain_id=['wTjUJdAdSkmocIsusTZBDA']) at 0x7fe09df255b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:07:55.271265 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3d774-5e80-47c6-bd91-83f93ed93d7f service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:55.271557 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3d774-5e80-47c6-bd91-83f93ed93d7f service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:55.271850 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3d774-5e80-47c6-bd91-83f93ed93d7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:55.274145 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3ed3d774-5e80-47c6-bd91-83f93ed93d7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:55.286246 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3d774-5e80-47c6-bd91-83f93ed93d7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:07:55.288088 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3d774-5e80-47c6-bd91-83f93ed93d7f service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:07:55.299930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1264/2542] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:07:55 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:07:56.844866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef4a46-e870-48b9-bb0b-f133bca131e4 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:07:56.844866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef4a46-e870-48b9-bb0b-f133bca131e4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:07:56.844866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef4a46-e870-48b9-bb0b-f133bca131e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:07:56.857638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a6ef4a46-e870-48b9-bb0b-f133bca131e4 None None] MFA Rules not processed for user `b9371804d1f943a6b6b3b2a9901030c8`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:07:56.858788 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a6ef4a46-e870-48b9-bb0b-f133bca131e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:07:56.865144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1279/2543] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:07:56 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:08:31.228398 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70542f0a-b30b-4cb3-a01e-331f8124adcf None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:08:31.228935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70542f0a-b30b-4cb3-a01e-331f8124adcf None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:08:31.229033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70542f0a-b30b-4cb3-a01e-331f8124adcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:08:31.250606 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-70542f0a-b30b-4cb3-a01e-331f8124adcf None None] MFA Rules not processed for user `d7a958a47ae44558a637dbe34b5a8f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:08:31.254149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-70542f0a-b30b-4cb3-a01e-331f8124adcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:08:31.259330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1265/2544] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:08:31 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:09:36.064799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef4a46-e870-48b9-bb0b-f133bca131e4 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:09:36.075925 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef4a46-e870-48b9-bb0b-f133bca131e4 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:09:36.080586 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4e6dd-6e75-4999-b80d-836cc709ceb4 service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=PTVXDCHNQWCQjy3BZQYY3Q, audit_chain_id=['PTVXDCHNQWCQjy3BZQYY3Q']) at 0x7fe09de50eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f330acd453f445ea31acf9fc43b53ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:09:36.081165 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4e6dd-6e75-4999-b80d-836cc709ceb4 service placement] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:09:36.081459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4e6dd-6e75-4999-b80d-836cc709ceb4 service placement] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:09:36.081746 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4e6dd-6e75-4999-b80d-836cc709ceb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:09:36.083451 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0fc4e6dd-6e75-4999-b80d-836cc709ceb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:09:36.094516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4e6dd-6e75-4999-b80d-836cc709ceb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:09:36.096131 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4e6dd-6e75-4999-b80d-836cc709ceb4 service placement] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:09:36.105756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1280/2545] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:09:36 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:09:47.351435 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7447375-4d8c-4eb5-a2cd-c9d7682cbff0 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:09:47.351926 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7447375-4d8c-4eb5-a2cd-c9d7682cbff0 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:09:47.352027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7447375-4d8c-4eb5-a2cd-c9d7682cbff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:09:47.376256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f7447375-4d8c-4eb5-a2cd-c9d7682cbff0 None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:09:47.377405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f7447375-4d8c-4eb5-a2cd-c9d7682cbff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:09:47.442183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1266/2546] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:09:47 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:09:47.580137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4e6dd-6e75-4999-b80d-836cc709ceb4 service placement] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:09:47.582200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-0fc4e6dd-6e75-4999-b80d-836cc709ceb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:09:47.655532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4e6dd-6e75-4999-b80d-836cc709ceb4 service placement] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:09:47.660459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15904e-d9b9-4d19-a8fb-acaf7bbdf44a service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e196be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:09:47.661038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15904e-d9b9-4d19-a8fb-acaf7bbdf44a service swift] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:09:47.661327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15904e-d9b9-4d19-a8fb-acaf7bbdf44a service swift] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:09:47.661606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15904e-d9b9-4d19-a8fb-acaf7bbdf44a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:09:47.669389 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15904e-d9b9-4d19-a8fb-acaf7bbdf44a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:09:47.670944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15904e-d9b9-4d19-a8fb-acaf7bbdf44a service swift] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:09:47.678603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1281/2547] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:09:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 19:10:07.504540 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1aaaf-b3ec-46ca-98da-31ab31ed4fb3 None None] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:07.505169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1aaaf-b3ec-46ca-98da-31ab31ed4fb3 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:07.505169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1aaaf-b3ec-46ca-98da-31ab31ed4fb3 None None] PATH_INFO: `/` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:07.506791 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1267/2548] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 19:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:10:07.512338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a98ca-caef-4a02-9dc7-8a84788b46a1 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:07.512794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a98ca-caef-4a02-9dc7-8a84788b46a1 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:07.512915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a98ca-caef-4a02-9dc7-8a84788b46a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:07.537423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-d66a98ca-caef-4a02-9dc7-8a84788b46a1 None None] MFA Rules not processed for user `6d280e56dc8848eb92cbee073fd9fbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:10:07.538605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d66a98ca-caef-4a02-9dc7-8a84788b46a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:07.550746 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1282/2549] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 19:10:07 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:10:07.562586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1aaaf-b3ec-46ca-98da-31ab31ed4fb3 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:07.564263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d4a1aaaf-b3ec-46ca-98da-31ab31ed4fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:07.640430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1aaaf-b3ec-46ca-98da-31ab31ed4fb3 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:07.644016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bf15c-5910-4bb1-bbc6-892686027e9f service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=IAdTf7zmRlS7ZAE69VgzOQ, audit_chain_id=['IAdTf7zmRlS7ZAE69VgzOQ']) at 0x7fe09e3ad730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e956656659004428b3aaf23ae962f001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:07.645282 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bf15c-5910-4bb1-bbc6-892686027e9f service glance] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:07.645713 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bf15c-5910-4bb1-bbc6-892686027e9f service glance] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:07.646085 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bf15c-5910-4bb1-bbc6-892686027e9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:07.657056 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bf15c-5910-4bb1-bbc6-892686027e9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:07.658772 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bf15c-5910-4bb1-bbc6-892686027e9f service glance] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:07.669933 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1268/2550] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:10:07 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:10:07.894185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faadcd6-18f4-4d51-9826-e0e098a2c8e4 None None] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:07.895600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faadcd6-18f4-4d51-9826-e0e098a2c8e4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:07.895600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faadcd6-18f4-4d51-9826-e0e098a2c8e4 None None] PATH_INFO: `/` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:07.897026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1283/2551] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 19:10:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 19:10:07.902674 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7de503-a681-41ee-bde0-ee89cdc0495a None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:07.903581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7de503-a681-41ee-bde0-ee89cdc0495a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:07.903581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7de503-a681-41ee-bde0-ee89cdc0495a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:07.933446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-ab7de503-a681-41ee-bde0-ee89cdc0495a None None] MFA Rules not processed for user `65a9c92fb5144e3dacc922eede1131fd`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:10:07.934617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ab7de503-a681-41ee-bde0-ee89cdc0495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:07.944953 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1269/2552] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 19:10:07 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:10:07.957951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faadcd6-18f4-4d51-9826-e0e098a2c8e4 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:07.969066 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faadcd6-18f4-4d51-9826-e0e098a2c8e4 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:07.972896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad594b-3d4c-4c34-9e77-87bedca927a5 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e1c0b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:07.973650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad594b-3d4c-4c34-9e77-87bedca927a5 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:07.974028 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad594b-3d4c-4c34-9e77-87bedca927a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:07.974382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad594b-3d4c-4c34-9e77-87bedca927a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:07.982107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad594b-3d4c-4c34-9e77-87bedca927a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:07.983573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad594b-3d4c-4c34-9e77-87bedca927a5 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:07.992277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1284/2553] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:10:07 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:10:10.863787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e83d-ce02-493f-9af6-843b6e157617 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:10.863787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e83d-ce02-493f-9af6-843b6e157617 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:10.863787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e83d-ce02-493f-9af6-843b6e157617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:10.883661 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-4724e83d-ce02-493f-9af6-843b6e157617 None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:10:10.884837 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4724e83d-ce02-493f-9af6-843b6e157617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:10.891621 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1270/2554] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:10:10 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:10:10.903950 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad594b-3d4c-4c34-9e77-87bedca927a5 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:10.917072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad594b-3d4c-4c34-9e77-87bedca927a5 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:10.921749 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf8d1-aadd-4406-b00c-15f82f912518 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e4f39a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:10.922257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf8d1-aadd-4406-b00c-15f82f912518 service swift] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:10.922548 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf8d1-aadd-4406-b00c-15f82f912518 service swift] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:10.922829 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf8d1-aadd-4406-b00c-15f82f912518 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:10.931812 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baf8d1-aadd-4406-b00c-15f82f912518 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:10.933584 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baf8d1-aadd-4406-b00c-15f82f912518 service swift] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:10.942022 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1285/2555] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:10:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 19:10:28.716337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24390921-5079-4167-b831-ed7591024115 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:28.716918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24390921-5079-4167-b831-ed7591024115 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:28.716918 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24390921-5079-4167-b831-ed7591024115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:28.746278 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-24390921-5079-4167-b831-ed7591024115 None None] MFA Rules not processed for user `59f038939b324d9b8e7214cec4e82933`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:10:28.747610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-24390921-5079-4167-b831-ed7591024115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:28.757670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1271/2556] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:10:28 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:10:29.228658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf8d1-aadd-4406-b00c-15f82f912518 service swift] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:29.238247 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf8d1-aadd-4406-b00c-15f82f912518 service swift] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:29.242682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8acc3-5a2d-4def-b69f-7b26fee22a1e service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09de5edc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:29.243329 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8acc3-5a2d-4def-b69f-7b26fee22a1e service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:29.243636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8acc3-5a2d-4def-b69f-7b26fee22a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:29.243892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8acc3-5a2d-4def-b69f-7b26fee22a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:29.245720 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-74f8acc3-5a2d-4def-b69f-7b26fee22a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:29.257275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8acc3-5a2d-4def-b69f-7b26fee22a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:29.258930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8acc3-5a2d-4def-b69f-7b26fee22a1e service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:29.268436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1286/2557] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:10:29 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:10:31.842556 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252958-1031-4af8-bec6-0fd23ae9b14f None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:31.843049 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252958-1031-4af8-bec6-0fd23ae9b14f None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:31.843200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252958-1031-4af8-bec6-0fd23ae9b14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:31.866427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-33252958-1031-4af8-bec6-0fd23ae9b14f None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:10:31.867594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-33252958-1031-4af8-bec6-0fd23ae9b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:31.874648 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1272/2558] 10.222.0.21 () {58 vars in 967 bytes} [Mon Feb 28 19:10:31 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:10:31.886676 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8acc3-5a2d-4def-b69f-7b26fee22a1e service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:31.898896 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8acc3-5a2d-4def-b69f-7b26fee22a1e service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:31.903647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1425bf-30aa-4222-948c-87669d6b4b75 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09de50130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:31.904231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1425bf-30aa-4222-948c-87669d6b4b75 service swift] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:31.904516 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1425bf-30aa-4222-948c-87669d6b4b75 service swift] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:31.904799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1425bf-30aa-4222-948c-87669d6b4b75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:31.914356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1425bf-30aa-4222-948c-87669d6b4b75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:31.916127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1425bf-30aa-4222-948c-87669d6b4b75 service swift] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:31.925242 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1287/2559] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:10:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 19:10:38.257969 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33252958-1031-4af8-bec6-0fd23ae9b14f None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:38.267128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33252958-1031-4af8-bec6-0fd23ae9b14f None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:38.272169 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf246-2b8a-4fda-b4f5-70395226c536 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e3f36d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:38.272741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf246-2b8a-4fda-b4f5-70395226c536 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:38.273036 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf246-2b8a-4fda-b4f5-70395226c536 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:38.273316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf246-2b8a-4fda-b4f5-70395226c536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:38.275647 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-bbcaf246-2b8a-4fda-b4f5-70395226c536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:38.346611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf246-2b8a-4fda-b4f5-70395226c536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:38.348149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf246-2b8a-4fda-b4f5-70395226c536 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:38.358053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1273/2560] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:10:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:10:44.557776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1425bf-30aa-4222-948c-87669d6b4b75 service swift] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:44.559209 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-de1425bf-30aa-4222-948c-87669d6b4b75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:44.572891 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1425bf-30aa-4222-948c-87669d6b4b75 service swift] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:44.577133 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5eae30-c857-4caa-8495-0c76072d9473 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FiTF_CooSCmXNU1uc82Y7A, audit_chain_id=['FiTF_CooSCmXNU1uc82Y7A']) at 0x7fe09e1c0b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:44.577921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eae30-c857-4caa-8495-0c76072d9473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:44.578208 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eae30-c857-4caa-8495-0c76072d9473 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:44.578514 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eae30-c857-4caa-8495-0c76072d9473 admin admin] PATH_INFO: `/v3/users/d7a958a47ae44558a637dbe34b5a8f9b` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:44.579600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5eae30-c857-4caa-8495-0c76072d9473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a958a47ae44558a637dbe34b5a8f9b)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:44.586756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5eae30-c857-4caa-8495-0c76072d9473 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:44.777729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cc5eae30-c857-4caa-8495-0c76072d9473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a958a47ae44558a637dbe34b5a8f9b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:10:44.789745 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cc5eae30-c857-4caa-8495-0c76072d9473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a958a47ae44558a637dbe34b5a8f9b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:10:44.790494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cc5eae30-c857-4caa-8495-0c76072d9473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a958a47ae44558a637dbe34b5a8f9b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:10:44.796300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cc5eae30-c857-4caa-8495-0c76072d9473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a958a47ae44558a637dbe34b5a8f9b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:10:44.866640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cc5eae30-c857-4caa-8495-0c76072d9473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a958a47ae44558a637dbe34b5a8f9b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:10:44.880545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1288/2561] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:10:44 2022] DELETE /identity/v3/users/d7a958a47ae44558a637dbe34b5a8f9b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:10:45.201790 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf246-2b8a-4fda-b4f5-70395226c536 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:45.212821 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf246-2b8a-4fda-b4f5-70395226c536 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:45.277722 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FiTF_CooSCmXNU1uc82Y7A, audit_chain_id=['FiTF_CooSCmXNU1uc82Y7A']) at 0x7fe09e3de340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:45.278555 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:45.278841 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:45.279139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] PATH_INFO: `/v3/projects/e00c264516ff48bdb7d2411e37b27ff4` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:45.280243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00c264516ff48bdb7d2411e37b27ff4)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:45.282380 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:45.416306 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00c264516ff48bdb7d2411e37b27ff4', 'request_id': 'req-bbeba002-64f9-43c5-99a1-194af468aa43'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:10:45.428290 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00c264516ff48bdb7d2411e37b27ff4', 'request_id': 'req-bbeba002-64f9-43c5-99a1-194af468aa43'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:10:45.479034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00c264516ff48bdb7d2411e37b27ff4', 'request_id': 'req-bbeba002-64f9-43c5-99a1-194af468aa43'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:10:45.489704 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] The token cache is being invalidate because project e00c264516ff48bdb7d2411e37b27ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:10:45.489924 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:10:45.490539 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bbeba002-64f9-43c5-99a1-194af468aa43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:10:45.492285 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1274/2562] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:10:45 2022] DELETE /identity/v3/projects/e00c264516ff48bdb7d2411e37b27ff4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:10:45.497146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c568-a7ea-47ab-aed6-a824adb91d3e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:45.497442 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c568-a7ea-47ab-aed6-a824adb91d3e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:45.497753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c568-a7ea-47ab-aed6-a824adb91d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:45.520736 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-2ff5c568-a7ea-47ab-aed6-a824adb91d3e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:10:45.521906 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2ff5c568-a7ea-47ab-aed6-a824adb91d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:45.585703 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1289/2563] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:10:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:10:45.598607 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b86ca-c609-4938-926b-2299da730da9 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:45.599000 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b86ca-c609-4938-926b-2299da730da9 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:45.599317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b86ca-c609-4938-926b-2299da730da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:45.623272 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-076b86ca-c609-4938-926b-2299da730da9 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:10:45.624438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-076b86ca-c609-4938-926b-2299da730da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:45.632868 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1275/2564] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:10:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:10:45.637145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5c568-a7ea-47ab-aed6-a824adb91d3e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:45.646369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5c568-a7ea-47ab-aed6-a824adb91d3e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:45.650658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925a327-b2ae-4069-a87a-10ef05a5c823 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09de50490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:45.651293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925a327-b2ae-4069-a87a-10ef05a5c823 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:45.651593 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925a327-b2ae-4069-a87a-10ef05a5c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:45.651876 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925a327-b2ae-4069-a87a-10ef05a5c823 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:45.652588 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925a327-b2ae-4069-a87a-10ef05a5c823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:10:45.652889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925a327-b2ae-4069-a87a-10ef05a5c823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:45.654476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925a327-b2ae-4069-a87a-10ef05a5c823 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:45.666904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1290/2565] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:10:45.671140 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b86ca-c609-4938-926b-2299da730da9 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:45.680334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b86ca-c609-4938-926b-2299da730da9 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:45.684687 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c72dc-a8f0-4729-91b8-db03bf983573 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09e272610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:45.685261 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c72dc-a8f0-4729-91b8-db03bf983573 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:45.685545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c72dc-a8f0-4729-91b8-db03bf983573 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:45.685823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c72dc-a8f0-4729-91b8-db03bf983573 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:45.686442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c72dc-a8f0-4729-91b8-db03bf983573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:45.688355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c72dc-a8f0-4729-91b8-db03bf983573 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:45.782980 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1276/2566] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:10:45 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:10:45.791934 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925a327-b2ae-4069-a87a-10ef05a5c823 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:45.803472 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925a327-b2ae-4069-a87a-10ef05a5c823 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:45.869970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b0f9-8de0-4ccc-a933-40b4de2dd973 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09ea7c760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:45.870583 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b0f9-8de0-4ccc-a933-40b4de2dd973 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:45.870899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b0f9-8de0-4ccc-a933-40b4de2dd973 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:45.871234 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b0f9-8de0-4ccc-a933-40b4de2dd973 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:45.871863 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77b0f9-8de0-4ccc-a933-40b4de2dd973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:45.873757 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77b0f9-8de0-4ccc-a933-40b4de2dd973 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:45.965486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1291/2567] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:10:45 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:10:45.969735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c72dc-a8f0-4729-91b8-db03bf983573 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:45.980347 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c72dc-a8f0-4729-91b8-db03bf983573 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:45.984888 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a9b34-1774-4b24-97ab-0c5272013ed2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09de33160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:45.985481 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9b34-1774-4b24-97ab-0c5272013ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:45.985769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9b34-1774-4b24-97ab-0c5272013ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:45.986052 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9b34-1774-4b24-97ab-0c5272013ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:45.986787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a9b34-1774-4b24-97ab-0c5272013ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:45.988415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a9b34-1774-4b24-97ab-0c5272013ed2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:46.001120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1277/2568] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:10:46.005363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b0f9-8de0-4ccc-a933-40b4de2dd973 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:46.015100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b0f9-8de0-4ccc-a933-40b4de2dd973 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:46.019723 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34422ee3-7d1f-487d-8984-07c1a2005a42 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09e58caf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:46.020405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34422ee3-7d1f-487d-8984-07c1a2005a42 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:46.020685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34422ee3-7d1f-487d-8984-07c1a2005a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:46.020984 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34422ee3-7d1f-487d-8984-07c1a2005a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:46.021680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34422ee3-7d1f-487d-8984-07c1a2005a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:46.023318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34422ee3-7d1f-487d-8984-07c1a2005a42 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:46.037565 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1292/2569] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:10:46.038625 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a9b34-1774-4b24-97ab-0c5272013ed2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:46.048082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a9b34-1774-4b24-97ab-0c5272013ed2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:46.053108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2e2f0-1692-4452-a8c0-72a75e20a6d2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09e1b0d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:46.053860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2e2f0-1692-4452-a8c0-72a75e20a6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:46.056485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2e2f0-1692-4452-a8c0-72a75e20a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:46.056485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2e2f0-1692-4452-a8c0-72a75e20a6d2 admin admin] PATH_INFO: `/v3/projects/21f702e5905949ebb7f5c18b7d47e134/users/84b26d19a40e4ed59afdc24284667b0d/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:46.074311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2e2f0-1692-4452-a8c0-72a75e20a6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f702e5905949ebb7f5c18b7d47e134, user_id=84b26d19a40e4ed59afdc24284667b0d, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:46.076959 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2e2f0-1692-4452-a8c0-72a75e20a6d2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:46.130931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1278/2570] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:10:46 2022] PUT /identity/v3/projects/21f702e5905949ebb7f5c18b7d47e134/users/84b26d19a40e4ed59afdc24284667b0d/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:10:46.140844 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6a691-0670-4592-8dbd-528a6f43c51f None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:46.141147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6a691-0670-4592-8dbd-528a6f43c51f None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:46.141437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6a691-0670-4592-8dbd-528a6f43c51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:46.179007 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-e1c6a691-0670-4592-8dbd-528a6f43c51f None None] MFA Rules not processed for user `84b26d19a40e4ed59afdc24284667b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:10:46.180187 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e1c6a691-0670-4592-8dbd-528a6f43c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:46.254502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1293/2571] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:10:46 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:10:46.259531 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2e2f0-1692-4452-a8c0-72a75e20a6d2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:46.328473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2e2f0-1692-4452-a8c0-72a75e20a6d2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:46.333574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9806e-e496-4397-bac3-6b561312a5bc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09e8dfaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:46.334182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9806e-e496-4397-bac3-6b561312a5bc admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:46.334473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9806e-e496-4397-bac3-6b561312a5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:46.334759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9806e-e496-4397-bac3-6b561312a5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:46.335451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9806e-e496-4397-bac3-6b561312a5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:46.337407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9806e-e496-4397-bac3-6b561312a5bc admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:46.443274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1279/2572] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:10:46 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:10:46.446829 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6a691-0670-4592-8dbd-528a6f43c51f None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:46.459042 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6a691-0670-4592-8dbd-528a6f43c51f None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:46.525795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f050660-7f61-4019-9399-2c53bb9c857a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09ea7c700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:46.526407 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f050660-7f61-4019-9399-2c53bb9c857a admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:46.526700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f050660-7f61-4019-9399-2c53bb9c857a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:46.526985 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f050660-7f61-4019-9399-2c53bb9c857a admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:46.527734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f050660-7f61-4019-9399-2c53bb9c857a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:46.529647 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f050660-7f61-4019-9399-2c53bb9c857a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:46.662886 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1294/2573] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:10:46 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:10:46.666999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9806e-e496-4397-bac3-6b561312a5bc admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:46.676983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9806e-e496-4397-bac3-6b561312a5bc admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:46.681427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeadef-596d-48a3-97f6-9eab29afcb76 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09de6c220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:46.682015 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeadef-596d-48a3-97f6-9eab29afcb76 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:46.682309 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeadef-596d-48a3-97f6-9eab29afcb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:46.682593 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeadef-596d-48a3-97f6-9eab29afcb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:46.683315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeadef-596d-48a3-97f6-9eab29afcb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:46.685015 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeadef-596d-48a3-97f6-9eab29afcb76 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:46.696037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1280/2574] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:10:46.700163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f050660-7f61-4019-9399-2c53bb9c857a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:46.710540 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f050660-7f61-4019-9399-2c53bb9c857a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:46.714837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987baf9b-1127-4cd6-a750-f28e639537af admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09de0ec10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:46.715684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987baf9b-1127-4cd6-a750-f28e639537af admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:46.715976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987baf9b-1127-4cd6-a750-f28e639537af admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:46.716258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987baf9b-1127-4cd6-a750-f28e639537af admin admin] PATH_INFO: `/v3/projects/6b9455842a6c4f12a80e35ea2abe5e25/users/840fd3175ae347848b43cef119d1ccf8/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:46.735142 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987baf9b-1127-4cd6-a750-f28e639537af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9455842a6c4f12a80e35ea2abe5e25, user_id=840fd3175ae347848b43cef119d1ccf8, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:46.737795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987baf9b-1127-4cd6-a750-f28e639537af admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:46.833687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1295/2575] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:10:46 2022] PUT /identity/v3/projects/6b9455842a6c4f12a80e35ea2abe5e25/users/840fd3175ae347848b43cef119d1ccf8/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:10:46.837611 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeadef-596d-48a3-97f6-9eab29afcb76 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:46.847359 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeadef-596d-48a3-97f6-9eab29afcb76 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:46.911604 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beff59-a869-42ef-9063-8e02f590c73f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09e272610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:46.912232 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beff59-a869-42ef-9063-8e02f590c73f admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:46.912524 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beff59-a869-42ef-9063-8e02f590c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:46.912813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beff59-a869-42ef-9063-8e02f590c73f admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:46.913561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beff59-a869-42ef-9063-8e02f590c73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:46.915139 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beff59-a869-42ef-9063-8e02f590c73f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:46.928120 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1281/2576] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:10:46.932327 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987baf9b-1127-4cd6-a750-f28e639537af admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:46.942979 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987baf9b-1127-4cd6-a750-f28e639537af admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:46.947491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d1e2e-c8bd-4151-bba3-ccfdefd87bbe admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09e78ef10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:46.948313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d1e2e-c8bd-4151-bba3-ccfdefd87bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:46.948609 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d1e2e-c8bd-4151-bba3-ccfdefd87bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:46.948893 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d1e2e-c8bd-4151-bba3-ccfdefd87bbe admin admin] PATH_INFO: `/v3/projects/6b9455842a6c4f12a80e35ea2abe5e25/users/840fd3175ae347848b43cef119d1ccf8/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:46.950684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d1e2e-c8bd-4151-bba3-ccfdefd87bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9455842a6c4f12a80e35ea2abe5e25, user_id=840fd3175ae347848b43cef119d1ccf8, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:46.953313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d1e2e-c8bd-4151-bba3-ccfdefd87bbe admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:46.963806 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1296/2577] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:10:46 2022] PUT /identity/v3/projects/6b9455842a6c4f12a80e35ea2abe5e25/users/840fd3175ae347848b43cef119d1ccf8/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:10:46.975398 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316df16-cd51-4908-bfaf-a4d0bd2b9862 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:46.975794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316df16-cd51-4908-bfaf-a4d0bd2b9862 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:46.976182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316df16-cd51-4908-bfaf-a4d0bd2b9862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:47.014144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d316df16-cd51-4908-bfaf-a4d0bd2b9862 None None] MFA Rules not processed for user `840fd3175ae347848b43cef119d1ccf8`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:10:47.015354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d316df16-cd51-4908-bfaf-a4d0bd2b9862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:47.094010 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1282/2578] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:10:46 2022] POST /identity/v3/auth/tokens => generated 3751 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:10:47.104299 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d1e2e-c8bd-4151-bba3-ccfdefd87bbe admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:47.105977 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f63d1e2e-c8bd-4151-bba3-ccfdefd87bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:10:47.170409 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d1e2e-c8bd-4151-bba3-ccfdefd87bbe admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:47.173857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d328b-8085-4396-a908-504f2cf82697 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e105eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:47.174438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d328b-8085-4396-a908-504f2cf82697 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:47.174730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d328b-8085-4396-a908-504f2cf82697 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:47.175012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d328b-8085-4396-a908-504f2cf82697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:47.236957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d328b-8085-4396-a908-504f2cf82697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:47.238385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d328b-8085-4396-a908-504f2cf82697 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:47.247755 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1297/2579] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:10:47 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:10:54.949572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316df16-cd51-4908-bfaf-a4d0bd2b9862 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:10:54.959762 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316df16-cd51-4908-bfaf-a4d0bd2b9862 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:10:54.964028 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a7794-2845-4874-9dc6-d15a7af27520 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e3bf8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:10:54.964881 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a7794-2845-4874-9dc6-d15a7af27520 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:10:54.965399 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a7794-2845-4874-9dc6-d15a7af27520 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:10:54.965904 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a7794-2845-4874-9dc6-d15a7af27520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:10:54.976768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a7794-2845-4874-9dc6-d15a7af27520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:10:54.978545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a7794-2845-4874-9dc6-d15a7af27520 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:10:54.999532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1283/2580] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:10:54 2022] GET /identity/v3/auth/tokens => generated 3751 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:11:27.788795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d328b-8085-4396-a908-504f2cf82697 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:27.856081 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d328b-8085-4396-a908-504f2cf82697 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:27.860239 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09de5eee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:27.861033 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:27.861319 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:27.861598 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] PATH_INFO: `/v3/users/84b26d19a40e4ed59afdc24284667b0d` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:27.862687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b26d19a40e4ed59afdc24284667b0d)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:27.864673 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:28.074122 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b26d19a40e4ed59afdc24284667b0d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:28.085410 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b26d19a40e4ed59afdc24284667b0d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:28.086058 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b26d19a40e4ed59afdc24284667b0d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:28.086670 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b26d19a40e4ed59afdc24284667b0d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:28.151980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b26d19a40e4ed59afdc24284667b0d'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:28.165622 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1298/2581] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:11:27 2022] DELETE /identity/v3/users/84b26d19a40e4ed59afdc24284667b0d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:11:28.170321 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa7891-ca22-416c-833f-d8763b18f2d4 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:28.170842 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa7891-ca22-416c-833f-d8763b18f2d4 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:28.170950 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa7891-ca22-416c-833f-d8763b18f2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:28.194986 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-5daa7891-ca22-416c-833f-d8763b18f2d4 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:11:28.196150 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5daa7891-ca22-416c-833f-d8763b18f2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:11:28.260405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1284/2582] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:11:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:11:28.272163 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:28.273611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:11:28.338574 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c3343-28a3-4070-9aaf-33624c299b7d admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:28.341996 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b3dd9-9aae-4983-9010-fa05627486ee service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09eae0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:28.342595 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b3dd9-9aae-4983-9010-fa05627486ee service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:28.342888 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b3dd9-9aae-4983-9010-fa05627486ee service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:28.343203 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b3dd9-9aae-4983-9010-fa05627486ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:28.352185 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b3dd9-9aae-4983-9010-fa05627486ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:28.353611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b3dd9-9aae-4983-9010-fa05627486ee service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:28.362527 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1299/2583] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:11:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:11:28.833771 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa7891-ca22-416c-833f-d8763b18f2d4 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:28.835893 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5daa7891-ca22-416c-833f-d8763b18f2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:11:28.848067 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa7891-ca22-416c-833f-d8763b18f2d4 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:28.853237 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09de7f1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:28.854017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:28.854308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:28.854594 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] PATH_INFO: `/v3/projects/21f702e5905949ebb7f5c18b7d47e134` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:28.855751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f702e5905949ebb7f5c18b7d47e134)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:28.857663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:28.958574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f702e5905949ebb7f5c18b7d47e134', 'request_id': 'req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:28.969506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f702e5905949ebb7f5c18b7d47e134', 'request_id': 'req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:29.020298 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f702e5905949ebb7f5c18b7d47e134', 'request_id': 'req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:29.030989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] The token cache is being invalidate because project 21f702e5905949ebb7f5c18b7d47e134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:11:29.031308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:29.031932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:29.033436 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1285/2584] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:11:28 2022] DELETE /identity/v3/projects/21f702e5905949ebb7f5c18b7d47e134 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:11:29.037449 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b3dd9-9aae-4983-9010-fa05627486ee service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:29.047223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b3dd9-9aae-4983-9010-fa05627486ee service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:29.111421 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a322f66-9001-421a-a932-399ce2ce2d84 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09e150910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:29.118657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a322f66-9001-421a-a932-399ce2ce2d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:29.118657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a322f66-9001-421a-a932-399ce2ce2d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:29.118657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a322f66-9001-421a-a932-399ce2ce2d84 admin admin] PATH_INFO: `/v3/users/840fd3175ae347848b43cef119d1ccf8` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:29.118657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a322f66-9001-421a-a932-399ce2ce2d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=840fd3175ae347848b43cef119d1ccf8)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:29.118657 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a322f66-9001-421a-a932-399ce2ce2d84 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:29.273667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6a322f66-9001-421a-a932-399ce2ce2d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840fd3175ae347848b43cef119d1ccf8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:29.285265 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6a322f66-9001-421a-a932-399ce2ce2d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840fd3175ae347848b43cef119d1ccf8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:29.285919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6a322f66-9001-421a-a932-399ce2ce2d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840fd3175ae347848b43cef119d1ccf8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:29.286520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6a322f66-9001-421a-a932-399ce2ce2d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840fd3175ae347848b43cef119d1ccf8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:29.352027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-6a322f66-9001-421a-a932-399ce2ce2d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840fd3175ae347848b43cef119d1ccf8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:29.365128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1300/2585] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:11:29 2022] DELETE /identity/v3/users/840fd3175ae347848b43cef119d1ccf8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:11:29.837795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:29.842990 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:11:29.852367 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b9bd7-3a00-4b6a-97df-4e6916c1024a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:29.915884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9xngcIzqT5W_yXLJfB4XRA, audit_chain_id=['9xngcIzqT5W_yXLJfB4XRA']) at 0x7fe09e58ddc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:29.916706 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:29.916995 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:29.917279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] PATH_INFO: `/v3/projects/6b9455842a6c4f12a80e35ea2abe5e25` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:29.918391 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9455842a6c4f12a80e35ea2abe5e25)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:29.920314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:30.032569 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9455842a6c4f12a80e35ea2abe5e25', 'request_id': 'req-bfeea517-37b7-4302-9502-a2f0c519a61e'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:30.043965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9455842a6c4f12a80e35ea2abe5e25', 'request_id': 'req-bfeea517-37b7-4302-9502-a2f0c519a61e'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:30.128679 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9455842a6c4f12a80e35ea2abe5e25', 'request_id': 'req-bfeea517-37b7-4302-9502-a2f0c519a61e'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:30.139584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] The token cache is being invalidate because project 6b9455842a6c4f12a80e35ea2abe5e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:11:30.139871 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:30.140490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-bfeea517-37b7-4302-9502-a2f0c519a61e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:11:30.141970 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1286/2586] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:11:29 2022] DELETE /identity/v3/projects/6b9455842a6c4f12a80e35ea2abe5e25 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:11:30.146767 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eeb1d-a550-42a8-a0a0-fc277566e5b4 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:30.154290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eeb1d-a550-42a8-a0a0-fc277566e5b4 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:30.154290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eeb1d-a550-42a8-a0a0-fc277566e5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:30.170672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-221eeb1d-a550-42a8-a0a0-fc277566e5b4 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:11:30.171855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-221eeb1d-a550-42a8-a0a0-fc277566e5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:11:30.238808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1301/2587] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:11:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:11:30.247047 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530da80-24ba-4d8e-b082-cfdabd22754d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:30.247414 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530da80-24ba-4d8e-b082-cfdabd22754d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:30.247700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530da80-24ba-4d8e-b082-cfdabd22754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:30.271006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d530da80-24ba-4d8e-b082-cfdabd22754d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:11:30.272811 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d530da80-24ba-4d8e-b082-cfdabd22754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:11:30.280895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1287/2588] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:11:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:11:30.285114 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eeb1d-a550-42a8-a0a0-fc277566e5b4 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:30.294468 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eeb1d-a550-42a8-a0a0-fc277566e5b4 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:30.298748 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3040bf9-5100-42ee-8acc-67165dd0f485 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zoFjEsQbTQmd_PcHpxGe9Q, audit_chain_id=['zoFjEsQbTQmd_PcHpxGe9Q']) at 0x7fe09ddd56d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:30.299368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3040bf9-5100-42ee-8acc-67165dd0f485 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:30.299662 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3040bf9-5100-42ee-8acc-67165dd0f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:30.299947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3040bf9-5100-42ee-8acc-67165dd0f485 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:30.300630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3040bf9-5100-42ee-8acc-67165dd0f485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:11:30.300933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3040bf9-5100-42ee-8acc-67165dd0f485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:30.302511 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3040bf9-5100-42ee-8acc-67165dd0f485 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:30.315315 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1302/2589] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:11:30.320173 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530da80-24ba-4d8e-b082-cfdabd22754d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:30.329045 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530da80-24ba-4d8e-b082-cfdabd22754d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:30.333572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da469b5b-ed58-47d9-b120-6f0dc2fc860e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zoFjEsQbTQmd_PcHpxGe9Q, audit_chain_id=['zoFjEsQbTQmd_PcHpxGe9Q']) at 0x7fe09e8faa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:30.334153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469b5b-ed58-47d9-b120-6f0dc2fc860e admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:30.334443 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469b5b-ed58-47d9-b120-6f0dc2fc860e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:30.334786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469b5b-ed58-47d9-b120-6f0dc2fc860e admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:30.335957 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da469b5b-ed58-47d9-b120-6f0dc2fc860e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:30.337879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da469b5b-ed58-47d9-b120-6f0dc2fc860e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:30.473243 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1288/2590] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:11:30 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:11:30.477415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3040bf9-5100-42ee-8acc-67165dd0f485 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:30.487094 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3040bf9-5100-42ee-8acc-67165dd0f485 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:30.549770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cec941-9e0f-4672-8a99-a769a4f79eb7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zoFjEsQbTQmd_PcHpxGe9Q, audit_chain_id=['zoFjEsQbTQmd_PcHpxGe9Q']) at 0x7fe09ddb2f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:30.550385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cec941-9e0f-4672-8a99-a769a4f79eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:30.550672 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cec941-9e0f-4672-8a99-a769a4f79eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:30.550955 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cec941-9e0f-4672-8a99-a769a4f79eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:30.551632 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cec941-9e0f-4672-8a99-a769a4f79eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:30.554016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cec941-9e0f-4672-8a99-a769a4f79eb7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:30.638775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1303/2591] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:11:30 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:11:30.642931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da469b5b-ed58-47d9-b120-6f0dc2fc860e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:30.653153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da469b5b-ed58-47d9-b120-6f0dc2fc860e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:30.657923 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8156e-1fd4-487a-b0c0-fcc8f9f1d2c8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zoFjEsQbTQmd_PcHpxGe9Q, audit_chain_id=['zoFjEsQbTQmd_PcHpxGe9Q']) at 0x7fe09e1c8ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:30.658509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8156e-1fd4-487a-b0c0-fcc8f9f1d2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:30.658795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8156e-1fd4-487a-b0c0-fcc8f9f1d2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:30.659077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8156e-1fd4-487a-b0c0-fcc8f9f1d2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:30.659797 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8156e-1fd4-487a-b0c0-fcc8f9f1d2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:30.661423 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8156e-1fd4-487a-b0c0-fcc8f9f1d2c8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:30.672005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1289/2592] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:11:30.676027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cec941-9e0f-4672-8a99-a769a4f79eb7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:30.687667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cec941-9e0f-4672-8a99-a769a4f79eb7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:30.692055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55a9df-433b-4d8d-89de-93e671a9f7c2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zoFjEsQbTQmd_PcHpxGe9Q, audit_chain_id=['zoFjEsQbTQmd_PcHpxGe9Q']) at 0x7fe09de980a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:30.692650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a9df-433b-4d8d-89de-93e671a9f7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:30.692940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a9df-433b-4d8d-89de-93e671a9f7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:30.693223 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55a9df-433b-4d8d-89de-93e671a9f7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:30.693922 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55a9df-433b-4d8d-89de-93e671a9f7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:30.697279 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55a9df-433b-4d8d-89de-93e671a9f7c2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:30.707444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1304/2593] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:11:30.712177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8156e-1fd4-487a-b0c0-fcc8f9f1d2c8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:30.722239 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8156e-1fd4-487a-b0c0-fcc8f9f1d2c8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:30.727730 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61e4a9-eda2-4020-a3f6-c514497ce1c8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zoFjEsQbTQmd_PcHpxGe9Q, audit_chain_id=['zoFjEsQbTQmd_PcHpxGe9Q']) at 0x7fe09deb4c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:30.728511 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61e4a9-eda2-4020-a3f6-c514497ce1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:30.728799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61e4a9-eda2-4020-a3f6-c514497ce1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:30.729086 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61e4a9-eda2-4020-a3f6-c514497ce1c8 admin admin] PATH_INFO: `/v3/projects/c4dc93a23b7946cc8bed9e8da234ace5/users/4f63416ef4914bf1b2ed90312d839d47/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:30.749489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61e4a9-eda2-4020-a3f6-c514497ce1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dc93a23b7946cc8bed9e8da234ace5, user_id=4f63416ef4914bf1b2ed90312d839d47, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:30.752195 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61e4a9-eda2-4020-a3f6-c514497ce1c8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:30.859930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1290/2594] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:11:30 2022] PUT /identity/v3/projects/c4dc93a23b7946cc8bed9e8da234ace5/users/4f63416ef4914bf1b2ed90312d839d47/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:11:30.870594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7ff9-258b-41bd-97d4-2c466c6bbc8a None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:30.870895 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7ff9-258b-41bd-97d4-2c466c6bbc8a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:30.871221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7ff9-258b-41bd-97d4-2c466c6bbc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:30.908322 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-941e7ff9-258b-41bd-97d4-2c466c6bbc8a None None] MFA Rules not processed for user `4f63416ef4914bf1b2ed90312d839d47`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:11:30.909477 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-941e7ff9-258b-41bd-97d4-2c466c6bbc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:11:30.982645 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1305/2595] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:11:30 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:11:30.994597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61e4a9-eda2-4020-a3f6-c514497ce1c8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:30.996345 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-0b61e4a9-eda2-4020-a3f6-c514497ce1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:11:31.060705 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61e4a9-eda2-4020-a3f6-c514497ce1c8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:31.064397 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825034e1-f89e-4814-82b3-8934f6ad10bc service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=TvFjqSIbTa275Kqoum5bnA, audit_chain_id=['TvFjqSIbTa275Kqoum5bnA']) at 0x7fe09eb9f7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e956656659004428b3aaf23ae962f001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:31.064982 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825034e1-f89e-4814-82b3-8934f6ad10bc service glance] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:31.065274 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825034e1-f89e-4814-82b3-8934f6ad10bc service glance] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:31.065568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825034e1-f89e-4814-82b3-8934f6ad10bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:31.074147 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825034e1-f89e-4814-82b3-8934f6ad10bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:31.075624 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825034e1-f89e-4814-82b3-8934f6ad10bc service glance] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:31.084053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1291/2596] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:11:30 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:11:55.685199 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e7ff9-258b-41bd-97d4-2c466c6bbc8a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:55.686520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-941e7ff9-258b-41bd-97d4-2c466c6bbc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:11:55.749671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e7ff9-258b-41bd-97d4-2c466c6bbc8a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:55.753120 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4add202-c24b-4d4e-ad3f-68ccd7ba276c service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09ea7c760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:55.753696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4add202-c24b-4d4e-ad3f-68ccd7ba276c service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:55.753983 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4add202-c24b-4d4e-ad3f-68ccd7ba276c service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:55.754262 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4add202-c24b-4d4e-ad3f-68ccd7ba276c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:55.755940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d4add202-c24b-4d4e-ad3f-68ccd7ba276c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:11:55.833305 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4add202-c24b-4d4e-ad3f-68ccd7ba276c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:55.834821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4add202-c24b-4d4e-ad3f-68ccd7ba276c service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:55.845919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1306/2597] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:11:55 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:11:57.093400 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825034e1-f89e-4814-82b3-8934f6ad10bc service glance] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:11:57.103352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825034e1-f89e-4814-82b3-8934f6ad10bc service glance] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:11:57.107213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb77929-abab-4bf5-b83c-98b693ba3836 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e1df2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:11:57.107795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb77929-abab-4bf5-b83c-98b693ba3836 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:11:57.108083 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb77929-abab-4bf5-b83c-98b693ba3836 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:11:57.108396 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb77929-abab-4bf5-b83c-98b693ba3836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:11:57.110086 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7eb77929-abab-4bf5-b83c-98b693ba3836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:11:57.123895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb77929-abab-4bf5-b83c-98b693ba3836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:11:57.125337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb77929-abab-4bf5-b83c-98b693ba3836 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:11:57.135832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1292/2598] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:11:57 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:12:08.800141 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4add202-c24b-4d4e-ad3f-68ccd7ba276c service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:08.801498 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d4add202-c24b-4d4e-ad3f-68ccd7ba276c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:08.811984 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4add202-c24b-4d4e-ad3f-68ccd7ba276c service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:08.815552 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6375b9-e8bf-4903-bcd7-1137dfa09861 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e9c3f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:08.816148 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6375b9-e8bf-4903-bcd7-1137dfa09861 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:08.816436 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6375b9-e8bf-4903-bcd7-1137dfa09861 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:08.816715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6375b9-e8bf-4903-bcd7-1137dfa09861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:08.818293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ca6375b9-e8bf-4903-bcd7-1137dfa09861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:08.887181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6375b9-e8bf-4903-bcd7-1137dfa09861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:08.888610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6375b9-e8bf-4903-bcd7-1137dfa09861 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:08.897738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1307/2599] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:12:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:12:14.366524 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb77929-abab-4bf5-b83c-98b693ba3836 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:14.368022 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7eb77929-abab-4bf5-b83c-98b693ba3836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:14.381027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb77929-abab-4bf5-b83c-98b693ba3836 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:14.385784 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb307bac-a8e0-4eb6-a6b3-8cfea08a4dbd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7Ipew5rTa2aB3lKmqx7Kw, audit_chain_id=['L7Ipew5rTa2aB3lKmqx7Kw']) at 0x7fe09e3ad730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:14.386561 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb307bac-a8e0-4eb6-a6b3-8cfea08a4dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:14.386848 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb307bac-a8e0-4eb6-a6b3-8cfea08a4dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:14.387142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb307bac-a8e0-4eb6-a6b3-8cfea08a4dbd admin admin] PATH_INFO: `/v3/users/b9371804d1f943a6b6b3b2a9901030c8` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:14.406098 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb307bac-a8e0-4eb6-a6b3-8cfea08a4dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9371804d1f943a6b6b3b2a9901030c8)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:14.408043 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb307bac-a8e0-4eb6-a6b3-8cfea08a4dbd admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:14.558359 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cb307bac-a8e0-4eb6-a6b3-8cfea08a4dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9371804d1f943a6b6b3b2a9901030c8'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:14.601737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cb307bac-a8e0-4eb6-a6b3-8cfea08a4dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9371804d1f943a6b6b3b2a9901030c8'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:14.613715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cb307bac-a8e0-4eb6-a6b3-8cfea08a4dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9371804d1f943a6b6b3b2a9901030c8'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:14.615180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cb307bac-a8e0-4eb6-a6b3-8cfea08a4dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9371804d1f943a6b6b3b2a9901030c8'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:14.615180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-cb307bac-a8e0-4eb6-a6b3-8cfea08a4dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9371804d1f943a6b6b3b2a9901030c8'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:14.629159 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1293/2600] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:12:14 2022] DELETE /identity/v3/users/b9371804d1f943a6b6b3b2a9901030c8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:14.993501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6375b9-e8bf-4903-bcd7-1137dfa09861 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:15.003699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6375b9-e8bf-4903-bcd7-1137dfa09861 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:15.065637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7Ipew5rTa2aB3lKmqx7Kw, audit_chain_id=['L7Ipew5rTa2aB3lKmqx7Kw']) at 0x7fe09e25b9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:15.066423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:15.066715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:15.066999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] PATH_INFO: `/v3/projects/a73fa98b1d974ed1935c4d3e2879abad` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:15.078225 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73fa98b1d974ed1935c4d3e2879abad)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:15.080144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:15.220372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73fa98b1d974ed1935c4d3e2879abad', 'request_id': 'req-a60eac2c-ba17-44e5-ac9d-2562efa49692'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:15.293308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73fa98b1d974ed1935c4d3e2879abad', 'request_id': 'req-a60eac2c-ba17-44e5-ac9d-2562efa49692'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:15.304565 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73fa98b1d974ed1935c4d3e2879abad', 'request_id': 'req-a60eac2c-ba17-44e5-ac9d-2562efa49692'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:15.314322 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] The token cache is being invalidate because project a73fa98b1d974ed1935c4d3e2879abad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:12:15.314610 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:15.315279 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-a60eac2c-ba17-44e5-ac9d-2562efa49692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:15.316731 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1308/2601] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:12:14 2022] DELETE /identity/v3/projects/a73fa98b1d974ed1935c4d3e2879abad => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:15.321920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c01715-a9d8-40ee-8aa8-b1df7bca99bf None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:15.322214 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c01715-a9d8-40ee-8aa8-b1df7bca99bf None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:15.322519 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c01715-a9d8-40ee-8aa8-b1df7bca99bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:15.346430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-93c01715-a9d8-40ee-8aa8-b1df7bca99bf None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:15.347610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-93c01715-a9d8-40ee-8aa8-b1df7bca99bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:15.414560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1294/2602] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:15.426541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d80e84-e37b-485a-a62b-82be4e37f436 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:15.426541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d80e84-e37b-485a-a62b-82be4e37f436 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:15.426541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d80e84-e37b-485a-a62b-82be4e37f436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:15.447088 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-d6d80e84-e37b-485a-a62b-82be4e37f436 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:15.448743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d6d80e84-e37b-485a-a62b-82be4e37f436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:15.455765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1309/2603] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:15.460094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c01715-a9d8-40ee-8aa8-b1df7bca99bf None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:15.470801 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c01715-a9d8-40ee-8aa8-b1df7bca99bf None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:15.475258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c26de-400d-404b-90fb-1f2760d8ffc5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e8faa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:15.475852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c26de-400d-404b-90fb-1f2760d8ffc5 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:15.476144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c26de-400d-404b-90fb-1f2760d8ffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:15.476427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c26de-400d-404b-90fb-1f2760d8ffc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:15.477116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c26de-400d-404b-90fb-1f2760d8ffc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:12:15.477416 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c26de-400d-404b-90fb-1f2760d8ffc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:15.479721 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c26de-400d-404b-90fb-1f2760d8ffc5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:15.493277 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1295/2604] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:12:15.497554 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d80e84-e37b-485a-a62b-82be4e37f436 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:15.506501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d80e84-e37b-485a-a62b-82be4e37f436 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:15.511420 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c68d1-48e3-4f3e-a35a-d41db82b064c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e480910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:15.512004 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c68d1-48e3-4f3e-a35a-d41db82b064c admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:15.512290 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c68d1-48e3-4f3e-a35a-d41db82b064c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:15.512573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c68d1-48e3-4f3e-a35a-d41db82b064c admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:15.513233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c68d1-48e3-4f3e-a35a-d41db82b064c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:15.515105 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c68d1-48e3-4f3e-a35a-d41db82b064c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:15.629837 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1310/2605] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:12:15 2022] POST /identity/v3/projects => generated 357 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:12:15.632181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c26de-400d-404b-90fb-1f2760d8ffc5 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:15.643351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c26de-400d-404b-90fb-1f2760d8ffc5 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:15.706568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5fd1a-4586-4d76-85d7-fe42c9e38542 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e1b84c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:15.707180 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5fd1a-4586-4d76-85d7-fe42c9e38542 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:15.707467 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5fd1a-4586-4d76-85d7-fe42c9e38542 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:15.707746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5fd1a-4586-4d76-85d7-fe42c9e38542 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:15.708371 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5fd1a-4586-4d76-85d7-fe42c9e38542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:15.710265 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5fd1a-4586-4d76-85d7-fe42c9e38542 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:15.820457 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1296/2606] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:12:15 2022] POST /identity/v3/users => generated 279 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:12:15.822432 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c68d1-48e3-4f3e-a35a-d41db82b064c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:15.833110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c68d1-48e3-4f3e-a35a-d41db82b064c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:15.837894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c633aa-8738-4348-be3a-4a55900382c9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09def91c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:15.839712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c633aa-8738-4348-be3a-4a55900382c9 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:15.840019 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c633aa-8738-4348-be3a-4a55900382c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:15.840304 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c633aa-8738-4348-be3a-4a55900382c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:15.841060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c633aa-8738-4348-be3a-4a55900382c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:15.842693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c633aa-8738-4348-be3a-4a55900382c9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:15.852971 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1311/2607] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:12:15.857063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5fd1a-4586-4d76-85d7-fe42c9e38542 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:15.866773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5fd1a-4586-4d76-85d7-fe42c9e38542 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:15.871525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce9ab1-8269-43b3-b5b8-5868cdbdb2f9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e1df5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:15.872115 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce9ab1-8269-43b3-b5b8-5868cdbdb2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:15.872402 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce9ab1-8269-43b3-b5b8-5868cdbdb2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:15.872686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce9ab1-8269-43b3-b5b8-5868cdbdb2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:15.873393 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce9ab1-8269-43b3-b5b8-5868cdbdb2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:15.874952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce9ab1-8269-43b3-b5b8-5868cdbdb2f9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:15.884884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1297/2608] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:12:15.889644 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c633aa-8738-4348-be3a-4a55900382c9 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:15.898980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c633aa-8738-4348-be3a-4a55900382c9 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:15.904255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8d3c2-4514-4c02-ada0-4bc41b2b1f03 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e1a1670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:15.905065 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d3c2-4514-4c02-ada0-4bc41b2b1f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:15.905350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d3c2-4514-4c02-ada0-4bc41b2b1f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:15.905630 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d3c2-4514-4c02-ada0-4bc41b2b1f03 admin admin] PATH_INFO: `/v3/projects/d7599bca48014de4ad6104f9ef382370/users/314eadff625543868c44032d657b7c62/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:15.924475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8d3c2-4514-4c02-ada0-4bc41b2b1f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7599bca48014de4ad6104f9ef382370, user_id=314eadff625543868c44032d657b7c62, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:15.927189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8d3c2-4514-4c02-ada0-4bc41b2b1f03 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:16.019602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1312/2609] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:12:15 2022] PUT /identity/v3/projects/d7599bca48014de4ad6104f9ef382370/users/314eadff625543868c44032d657b7c62/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:16.030229 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8f74-00d2-468f-b93a-f88c27607216 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:16.030524 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8f74-00d2-468f-b93a-f88c27607216 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:16.030837 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8f74-00d2-468f-b93a-f88c27607216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:16.066937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-855a8f74-00d2-468f-b93a-f88c27607216 None None] MFA Rules not processed for user `314eadff625543868c44032d657b7c62`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:16.068143 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-855a8f74-00d2-468f-b93a-f88c27607216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:16.142991 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1298/2610] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:16 2022] POST /identity/v3/auth/tokens => generated 3664 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:16.147817 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8d3c2-4514-4c02-ada0-4bc41b2b1f03 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:16.217473 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8d3c2-4514-4c02-ada0-4bc41b2b1f03 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:16.221909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfcfc8-cc36-411a-a934-7e53717296e3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e14ea00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:16.222485 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfcfc8-cc36-411a-a934-7e53717296e3 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:16.222777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfcfc8-cc36-411a-a934-7e53717296e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:16.223062 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfcfc8-cc36-411a-a934-7e53717296e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:16.223737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfcfc8-cc36-411a-a934-7e53717296e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:16.225699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfcfc8-cc36-411a-a934-7e53717296e3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:16.329248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1313/2611] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:12:16 2022] POST /identity/v3/projects => generated 355 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:12:16.333303 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a8f74-00d2-468f-b93a-f88c27607216 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:16.344415 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a8f74-00d2-468f-b93a-f88c27607216 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:16.418205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7c38b-3a51-4316-98b7-83cb0ea3fc4e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e1d7ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:16.418886 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7c38b-3a51-4316-98b7-83cb0ea3fc4e admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:16.419147 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7c38b-3a51-4316-98b7-83cb0ea3fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:16.419440 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7c38b-3a51-4316-98b7-83cb0ea3fc4e admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:16.420090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7c38b-3a51-4316-98b7-83cb0ea3fc4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:16.422017 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7c38b-3a51-4316-98b7-83cb0ea3fc4e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:16.499660 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1299/2612] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:12:16 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:12:16.503786 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfcfc8-cc36-411a-a934-7e53717296e3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:16.514762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfcfc8-cc36-411a-a934-7e53717296e3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:16.519211 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aaa18-59f2-4c7c-85c7-f005b7768602 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e8c6250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:16.519805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aaa18-59f2-4c7c-85c7-f005b7768602 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:16.520098 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aaa18-59f2-4c7c-85c7-f005b7768602 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:16.520381 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aaa18-59f2-4c7c-85c7-f005b7768602 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:16.521077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aaa18-59f2-4c7c-85c7-f005b7768602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:16.522651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aaa18-59f2-4c7c-85c7-f005b7768602 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:16.533350 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1314/2613] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:12:16.537538 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7c38b-3a51-4316-98b7-83cb0ea3fc4e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:16.547740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7c38b-3a51-4316-98b7-83cb0ea3fc4e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:16.552241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7eedf-23f0-4d6b-8f51-038894a8b692 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e3dcbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:16.553036 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7eedf-23f0-4d6b-8f51-038894a8b692 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:16.553323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7eedf-23f0-4d6b-8f51-038894a8b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:16.553603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7eedf-23f0-4d6b-8f51-038894a8b692 admin admin] PATH_INFO: `/v3/projects/1e772cce100b4d64b5dc1e4c71a88beb/users/e5fabd5d228e4c7f9421bdb03351e7c5/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:16.573056 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7eedf-23f0-4d6b-8f51-038894a8b692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e772cce100b4d64b5dc1e4c71a88beb, user_id=e5fabd5d228e4c7f9421bdb03351e7c5, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:16.575920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7eedf-23f0-4d6b-8f51-038894a8b692 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:16.636908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1300/2614] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:12:16 2022] PUT /identity/v3/projects/1e772cce100b4d64b5dc1e4c71a88beb/users/e5fabd5d228e4c7f9421bdb03351e7c5/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:16.640957 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aaa18-59f2-4c7c-85c7-f005b7768602 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:16.651443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aaa18-59f2-4c7c-85c7-f005b7768602 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:16.714706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287379-55f6-47ff-a1c9-dbf728c510a0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09dec3370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:16.715334 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287379-55f6-47ff-a1c9-dbf728c510a0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:16.715623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287379-55f6-47ff-a1c9-dbf728c510a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:16.715904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287379-55f6-47ff-a1c9-dbf728c510a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:16.716652 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287379-55f6-47ff-a1c9-dbf728c510a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:16.718229 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287379-55f6-47ff-a1c9-dbf728c510a0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:16.727836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1315/2615] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:12:16.732758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7eedf-23f0-4d6b-8f51-038894a8b692 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:16.742588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7eedf-23f0-4d6b-8f51-038894a8b692 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:16.746999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46c42a-8444-49fb-b386-2364088df1df admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e3f67f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:16.747828 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46c42a-8444-49fb-b386-2364088df1df admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:16.748116 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46c42a-8444-49fb-b386-2364088df1df admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:16.748399 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46c42a-8444-49fb-b386-2364088df1df admin admin] PATH_INFO: `/v3/projects/1e772cce100b4d64b5dc1e4c71a88beb/users/e5fabd5d228e4c7f9421bdb03351e7c5/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:16.750165 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46c42a-8444-49fb-b386-2364088df1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e772cce100b4d64b5dc1e4c71a88beb, user_id=e5fabd5d228e4c7f9421bdb03351e7c5, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:16.752882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46c42a-8444-49fb-b386-2364088df1df admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:16.762812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1301/2616] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:12:16 2022] PUT /identity/v3/projects/1e772cce100b4d64b5dc1e4c71a88beb/users/e5fabd5d228e4c7f9421bdb03351e7c5/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:16.773699 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bb86b-1118-4705-a65c-398e29ee426a None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:16.773996 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bb86b-1118-4705-a65c-398e29ee426a None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:16.774311 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bb86b-1118-4705-a65c-398e29ee426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:16.810724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-dc5bb86b-1118-4705-a65c-398e29ee426a None None] MFA Rules not processed for user `e5fabd5d228e4c7f9421bdb03351e7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:16.812031 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-dc5bb86b-1118-4705-a65c-398e29ee426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:16.889067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1316/2617] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:16 2022] POST /identity/v3/auth/tokens => generated 3729 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:16.899647 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46c42a-8444-49fb-b386-2364088df1df admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:16.901808 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-6f46c42a-8444-49fb-b386-2364088df1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:16.966240 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46c42a-8444-49fb-b386-2364088df1df admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:16.969877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47eb76-8b53-4bd5-a545-9a60f46c1fd5 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e1d7ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:16.970533 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47eb76-8b53-4bd5-a545-9a60f46c1fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:16.970887 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47eb76-8b53-4bd5-a545-9a60f46c1fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:16.971268 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47eb76-8b53-4bd5-a545-9a60f46c1fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:16.981508 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47eb76-8b53-4bd5-a545-9a60f46c1fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:16.982724 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47eb76-8b53-4bd5-a545-9a60f46c1fd5 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:16.991960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1302/2618] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:12:16 2022] GET /identity/v3/auth/tokens => generated 3729 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:12:17.219931 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bb86b-1118-4705-a65c-398e29ee426a None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:17.221267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-dc5bb86b-1118-4705-a65c-398e29ee426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:17.232741 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bb86b-1118-4705-a65c-398e29ee426a None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:17.236238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b183-8270-4a9a-9713-5c9d95999388 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e1a1670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:17.236824 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b183-8270-4a9a-9713-5c9d95999388 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:17.237119 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b183-8270-4a9a-9713-5c9d95999388 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:17.237422 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b183-8270-4a9a-9713-5c9d95999388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:17.306754 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438b183-8270-4a9a-9713-5c9d95999388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:17.308218 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438b183-8270-4a9a-9713-5c9d95999388 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:17.316997 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1317/2619] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:12:17 2022] GET /identity/v3/auth/tokens => generated 3664 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:12:20.960007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47eb76-8b53-4bd5-a545-9a60f46c1fd5 service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:20.961389 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-fc47eb76-8b53-4bd5-a545-9a60f46c1fd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:21.035930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47eb76-8b53-4bd5-a545-9a60f46c1fd5 service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:21.040212 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zoFjEsQbTQmd_PcHpxGe9Q, audit_chain_id=['zoFjEsQbTQmd_PcHpxGe9Q']) at 0x7fe09df0bd30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:21.041006 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:21.041325 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:21.041597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] PATH_INFO: `/v3/users/4f63416ef4914bf1b2ed90312d839d47` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:21.042832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f63416ef4914bf1b2ed90312d839d47)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:21.044876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:21.214318 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f63416ef4914bf1b2ed90312d839d47'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:21.298659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f63416ef4914bf1b2ed90312d839d47'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:21.311095 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f63416ef4914bf1b2ed90312d839d47'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:21.311800 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f63416ef4914bf1b2ed90312d839d47'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:21.312400 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f63416ef4914bf1b2ed90312d839d47'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:21.325222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1303/2620] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:12:20 2022] DELETE /identity/v3/users/4f63416ef4914bf1b2ed90312d839d47 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:21.329737 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10986b1e-049e-42ee-b4bc-ab5e2d8c5a67 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:21.330248 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10986b1e-049e-42ee-b4bc-ab5e2d8c5a67 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:21.330359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10986b1e-049e-42ee-b4bc-ab5e2d8c5a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:21.351555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-10986b1e-049e-42ee-b4bc-ab5e2d8c5a67 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:21.352693 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-10986b1e-049e-42ee-b4bc-ab5e2d8c5a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:21.418671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1318/2621] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:21.430213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:21.431839 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:21.503490 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4c09d-fce3-4b4f-860b-e1eab38b8e1d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:21.506920 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c90198-0a6c-4064-aafc-be969fea0a2c service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09de8e8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:21.507523 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c90198-0a6c-4064-aafc-be969fea0a2c service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:21.507808 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c90198-0a6c-4064-aafc-be969fea0a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:21.508083 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c90198-0a6c-4064-aafc-be969fea0a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:21.516808 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c90198-0a6c-4064-aafc-be969fea0a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:21.518222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c90198-0a6c-4064-aafc-be969fea0a2c service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:21.527085 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1304/2622] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:12:21 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:12:22.057981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10986b1e-049e-42ee-b4bc-ab5e2d8c5a67 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:22.059781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-10986b1e-049e-42ee-b4bc-ab5e2d8c5a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:22.077074 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10986b1e-049e-42ee-b4bc-ab5e2d8c5a67 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:22.082688 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zoFjEsQbTQmd_PcHpxGe9Q, audit_chain_id=['zoFjEsQbTQmd_PcHpxGe9Q']) at 0x7fe09e1dd850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:22.083614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:22.083996 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:22.084323 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] PATH_INFO: `/v3/projects/c4dc93a23b7946cc8bed9e8da234ace5` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:22.086535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4dc93a23b7946cc8bed9e8da234ace5)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:22.088541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:22.210200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4dc93a23b7946cc8bed9e8da234ace5', 'request_id': 'req-53ef1768-f0fe-4b77-a906-b0eecad23564'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:22.276565 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4dc93a23b7946cc8bed9e8da234ace5', 'request_id': 'req-53ef1768-f0fe-4b77-a906-b0eecad23564'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:22.290430 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4dc93a23b7946cc8bed9e8da234ace5', 'request_id': 'req-53ef1768-f0fe-4b77-a906-b0eecad23564'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:22.299059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] The token cache is being invalidate because project c4dc93a23b7946cc8bed9e8da234ace5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:12:22.299375 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:22.300110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-53ef1768-f0fe-4b77-a906-b0eecad23564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:22.301668 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1319/2623] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:12:22 2022] DELETE /identity/v3/projects/c4dc93a23b7946cc8bed9e8da234ace5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:22.306757 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7385f-3b78-44d2-ae8a-86b0de613e83 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:22.307310 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7385f-3b78-44d2-ae8a-86b0de613e83 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:22.307412 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7385f-3b78-44d2-ae8a-86b0de613e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:22.331250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-40b7385f-3b78-44d2-ae8a-86b0de613e83 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:22.332351 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-40b7385f-3b78-44d2-ae8a-86b0de613e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:22.398817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1305/2624] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:22.406530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf3ae2-9152-40a5-9039-4766b9d23d30 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:22.407025 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf3ae2-9152-40a5-9039-4766b9d23d30 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:22.407383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf3ae2-9152-40a5-9039-4766b9d23d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:22.429740 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-cfcf3ae2-9152-40a5-9039-4766b9d23d30 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:22.430999 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-cfcf3ae2-9152-40a5-9039-4766b9d23d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:22.439044 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1320/2625] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:22.443177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7385f-3b78-44d2-ae8a-86b0de613e83 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:22.453259 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7385f-3b78-44d2-ae8a-86b0de613e83 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:22.457768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771acac7-4826-4f8f-8dd9-f099519a7a8c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v2kCYE2DRuqAAuB3fV6-_A, audit_chain_id=['v2kCYE2DRuqAAuB3fV6-_A']) at 0x7fe09de6cf70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:22.458360 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771acac7-4826-4f8f-8dd9-f099519a7a8c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:22.458649 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771acac7-4826-4f8f-8dd9-f099519a7a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:22.458930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771acac7-4826-4f8f-8dd9-f099519a7a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:22.459658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771acac7-4826-4f8f-8dd9-f099519a7a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:12:22.459998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771acac7-4826-4f8f-8dd9-f099519a7a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:22.461659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771acac7-4826-4f8f-8dd9-f099519a7a8c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:22.475643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1306/2626] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:12:22.479958 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf3ae2-9152-40a5-9039-4766b9d23d30 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:22.489849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf3ae2-9152-40a5-9039-4766b9d23d30 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:22.494515 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a1e35-6eaf-4404-b479-e600f80beb58 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v2kCYE2DRuqAAuB3fV6-_A, audit_chain_id=['v2kCYE2DRuqAAuB3fV6-_A']) at 0x7fe09e35fa00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:22.495144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1e35-6eaf-4404-b479-e600f80beb58 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:22.495512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1e35-6eaf-4404-b479-e600f80beb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:22.495798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1e35-6eaf-4404-b479-e600f80beb58 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:22.496447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a1e35-6eaf-4404-b479-e600f80beb58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:22.499517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a1e35-6eaf-4404-b479-e600f80beb58 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:22.628396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1321/2627] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:12:22 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:12:22.632513 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771acac7-4826-4f8f-8dd9-f099519a7a8c admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:22.648219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771acac7-4826-4f8f-8dd9-f099519a7a8c admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:22.718084 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82d91-b665-415c-885c-5ac220d4273a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v2kCYE2DRuqAAuB3fV6-_A, audit_chain_id=['v2kCYE2DRuqAAuB3fV6-_A']) at 0x7fe09e14ae20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:22.718716 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82d91-b665-415c-885c-5ac220d4273a admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:22.719011 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82d91-b665-415c-885c-5ac220d4273a admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:22.719320 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82d91-b665-415c-885c-5ac220d4273a admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:22.719979 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb82d91-b665-415c-885c-5ac220d4273a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:22.721907 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb82d91-b665-415c-885c-5ac220d4273a admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:22.808013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1307/2628] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:12:22 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:12:22.812537 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a1e35-6eaf-4404-b479-e600f80beb58 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:22.823106 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a1e35-6eaf-4404-b479-e600f80beb58 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:22.828541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c17fb1-34ca-4d5a-a64b-3544b159ab20 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v2kCYE2DRuqAAuB3fV6-_A, audit_chain_id=['v2kCYE2DRuqAAuB3fV6-_A']) at 0x7fe09de36850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:22.829145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c17fb1-34ca-4d5a-a64b-3544b159ab20 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:22.829434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c17fb1-34ca-4d5a-a64b-3544b159ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:22.829716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c17fb1-34ca-4d5a-a64b-3544b159ab20 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:22.830408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c17fb1-34ca-4d5a-a64b-3544b159ab20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:22.832179 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c17fb1-34ca-4d5a-a64b-3544b159ab20 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:22.843633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1322/2629] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:12:22.848219 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82d91-b665-415c-885c-5ac220d4273a admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:22.858434 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82d91-b665-415c-885c-5ac220d4273a admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:22.863631 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126892c-d12a-403f-b2aa-050f986cabc6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v2kCYE2DRuqAAuB3fV6-_A, audit_chain_id=['v2kCYE2DRuqAAuB3fV6-_A']) at 0x7fe09e716250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:22.864218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126892c-d12a-403f-b2aa-050f986cabc6 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:22.864512 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126892c-d12a-403f-b2aa-050f986cabc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:22.864803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126892c-d12a-403f-b2aa-050f986cabc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:22.865503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126892c-d12a-403f-b2aa-050f986cabc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:22.867128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126892c-d12a-403f-b2aa-050f986cabc6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:22.877737 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1308/2630] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:12:22.882511 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c17fb1-34ca-4d5a-a64b-3544b159ab20 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:22.893324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c17fb1-34ca-4d5a-a64b-3544b159ab20 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:22.897907 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd00bb-3315-4737-8772-83fec1ea56ed admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v2kCYE2DRuqAAuB3fV6-_A, audit_chain_id=['v2kCYE2DRuqAAuB3fV6-_A']) at 0x7fe09e14ecd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:22.898725 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd00bb-3315-4737-8772-83fec1ea56ed admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:22.899015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd00bb-3315-4737-8772-83fec1ea56ed admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:22.899332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd00bb-3315-4737-8772-83fec1ea56ed admin admin] PATH_INFO: `/v3/projects/f4f770cf25bf4c7ba13571df4298a933/users/81de109d96414ca5ad8789f0f0c04e67/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:22.920103 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd00bb-3315-4737-8772-83fec1ea56ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f770cf25bf4c7ba13571df4298a933, user_id=81de109d96414ca5ad8789f0f0c04e67, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:22.922764 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd00bb-3315-4737-8772-83fec1ea56ed admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:23.019943 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1323/2631] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:12:22 2022] PUT /identity/v3/projects/f4f770cf25bf4c7ba13571df4298a933/users/81de109d96414ca5ad8789f0f0c04e67/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:23.031398 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11b4d8-bad8-41c9-856f-afe5b5a38c81 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:23.031843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11b4d8-bad8-41c9-856f-afe5b5a38c81 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:23.031946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11b4d8-bad8-41c9-856f-afe5b5a38c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:23.072745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-1d11b4d8-bad8-41c9-856f-afe5b5a38c81 None None] MFA Rules not processed for user `81de109d96414ca5ad8789f0f0c04e67`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:23.073944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1d11b4d8-bad8-41c9-856f-afe5b5a38c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:23.155545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1309/2632] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:23 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:23.171355 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd00bb-3315-4737-8772-83fec1ea56ed admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:23.173300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6abd00bb-3315-4737-8772-83fec1ea56ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:23.248434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd00bb-3315-4737-8772-83fec1ea56ed admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:23.252059 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e322db-3c64-47ba-b3a0-f0061930c890 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=TvFjqSIbTa275Kqoum5bnA, audit_chain_id=['TvFjqSIbTa275Kqoum5bnA']) at 0x7fe09e1a18e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e956656659004428b3aaf23ae962f001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:23.252643 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e322db-3c64-47ba-b3a0-f0061930c890 service glance] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:23.252935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e322db-3c64-47ba-b3a0-f0061930c890 service glance] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:23.253219 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e322db-3c64-47ba-b3a0-f0061930c890 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:23.261776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e322db-3c64-47ba-b3a0-f0061930c890 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:23.264180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e322db-3c64-47ba-b3a0-f0061930c890 service glance] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:23.275147 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1324/2633] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:12:23 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:12:38.517632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11b4d8-bad8-41c9-856f-afe5b5a38c81 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:38.519134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1d11b4d8-bad8-41c9-856f-afe5b5a38c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:38.590213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11b4d8-bad8-41c9-856f-afe5b5a38c81 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:38.594944 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e3fa370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:38.595759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:38.596044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:38.596323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] PATH_INFO: `/v3/users/314eadff625543868c44032d657b7c62` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:38.597419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314eadff625543868c44032d657b7c62)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:38.599355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:38.859630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314eadff625543868c44032d657b7c62'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:38.961413 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314eadff625543868c44032d657b7c62'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:38.975068 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314eadff625543868c44032d657b7c62'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:38.975821 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314eadff625543868c44032d657b7c62'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:38.976472 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314eadff625543868c44032d657b7c62'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:38.989416 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1310/2634] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:12:38 2022] DELETE /identity/v3/users/314eadff625543868c44032d657b7c62 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:38.993944 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff006-125a-4f04-b14f-36067ac67915 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:38.994431 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff006-125a-4f04-b14f-36067ac67915 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:38.994678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ff006-125a-4f04-b14f-36067ac67915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:39.017842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-683ff006-125a-4f04-b14f-36067ac67915 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:39.019804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-683ff006-125a-4f04-b14f-36067ac67915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:39.089717 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1325/2635] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:12:39.100963 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:39.102332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:39.169223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fa59b-7f47-4614-83c7-080e3dfed809 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:39.172748 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ed399-82ae-4663-942a-b8193b78d501 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09debc580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:39.173332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ed399-82ae-4663-942a-b8193b78d501 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:39.173617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ed399-82ae-4663-942a-b8193b78d501 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:39.173898 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ed399-82ae-4663-942a-b8193b78d501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:39.182983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ed399-82ae-4663-942a-b8193b78d501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:39.184742 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ed399-82ae-4663-942a-b8193b78d501 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:39.193873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1311/2636] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:12:39 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:12:39.792490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ff006-125a-4f04-b14f-36067ac67915 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:39.793851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-683ff006-125a-4f04-b14f-36067ac67915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:39.805597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ff006-125a-4f04-b14f-36067ac67915 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:39.811588 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e194d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:39.812555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:39.812899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:39.813207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] PATH_INFO: `/v3/projects/d7599bca48014de4ad6104f9ef382370` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:39.814352 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7599bca48014de4ad6104f9ef382370)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:39.816395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:40.007940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7599bca48014de4ad6104f9ef382370', 'request_id': 'req-594f74a7-a1de-4c94-9ea0-c012429e776e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:40.139133 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7599bca48014de4ad6104f9ef382370', 'request_id': 'req-594f74a7-a1de-4c94-9ea0-c012429e776e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:40.150384 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7599bca48014de4ad6104f9ef382370', 'request_id': 'req-594f74a7-a1de-4c94-9ea0-c012429e776e'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:40.160981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] The token cache is being invalidate because project d7599bca48014de4ad6104f9ef382370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:12:40.161266 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:40.161890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:40.163379 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1326/2637] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:12:39 2022] DELETE /identity/v3/projects/d7599bca48014de4ad6104f9ef382370 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:40.167404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ed399-82ae-4663-942a-b8193b78d501 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:40.177936 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ed399-82ae-4663-942a-b8193b78d501 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:40.243176 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb8cb9-eeea-4109-81e1-a65379b69935 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e159490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:40.243902 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb8cb9-eeea-4109-81e1-a65379b69935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:40.244193 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb8cb9-eeea-4109-81e1-a65379b69935 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:40.244475 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb8cb9-eeea-4109-81e1-a65379b69935 admin admin] PATH_INFO: `/v3/users/e5fabd5d228e4c7f9421bdb03351e7c5` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:40.245574 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb8cb9-eeea-4109-81e1-a65379b69935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5fabd5d228e4c7f9421bdb03351e7c5)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:40.247548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb8cb9-eeea-4109-81e1-a65379b69935 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:40.506378 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:40.507663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:40.571508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f74a7-a1de-4c94-9ea0-c012429e776e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:40.574947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9127-9882-4106-ac1e-7d1ced3eb601 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e9ddc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:40.575556 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9127-9882-4106-ac1e-7d1ced3eb601 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:40.575849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9127-9882-4106-ac1e-7d1ced3eb601 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:40.576136 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9127-9882-4106-ac1e-7d1ced3eb601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:40.578517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-458c9127-9882-4106-ac1e-7d1ced3eb601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:40.587807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c9127-9882-4106-ac1e-7d1ced3eb601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:40.589221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c9127-9882-4106-ac1e-7d1ced3eb601 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:40.597181 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1327/2638] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:12:40 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:12:40.644144 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-59cb8cb9-eeea-4109-81e1-a65379b69935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5fabd5d228e4c7f9421bdb03351e7c5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:40.732988 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-59cb8cb9-eeea-4109-81e1-a65379b69935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5fabd5d228e4c7f9421bdb03351e7c5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:40.745884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-59cb8cb9-eeea-4109-81e1-a65379b69935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5fabd5d228e4c7f9421bdb03351e7c5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:40.746618 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-59cb8cb9-eeea-4109-81e1-a65379b69935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5fabd5d228e4c7f9421bdb03351e7c5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:40.747242 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-59cb8cb9-eeea-4109-81e1-a65379b69935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5fabd5d228e4c7f9421bdb03351e7c5'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:40.760990 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1312/2639] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:12:40 2022] DELETE /identity/v3/users/e5fabd5d228e4c7f9421bdb03351e7c5 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:41.749195 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9127-9882-4106-ac1e-7d1ced3eb601 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:41.750589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-458c9127-9882-4106-ac1e-7d1ced3eb601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:41.764756 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9127-9882-4106-ac1e-7d1ced3eb601 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:41.827636 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uyUhy4AWRDqs2njycuFILA, audit_chain_id=['uyUhy4AWRDqs2njycuFILA']) at 0x7fe09e4c8100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:41.828575 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:41.828868 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:41.829154 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] PATH_INFO: `/v3/projects/1e772cce100b4d64b5dc1e4c71a88beb` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:41.830255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e772cce100b4d64b5dc1e4c71a88beb)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:41.832172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:42.043086 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e772cce100b4d64b5dc1e4c71a88beb', 'request_id': 'req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:42.121476 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e772cce100b4d64b5dc1e4c71a88beb', 'request_id': 'req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:42.134395 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e772cce100b4d64b5dc1e4c71a88beb', 'request_id': 'req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:42.145012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] The token cache is being invalidate because project 1e772cce100b4d64b5dc1e4c71a88beb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:12:42.145328 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:42.145960 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ea2b2fd8-820a-4d10-ba91-d06b5e6b3521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:42.147790 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1328/2640] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:12:41 2022] DELETE /identity/v3/projects/1e772cce100b4d64b5dc1e4c71a88beb => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:42.153686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea6c93-6c9b-4dde-b301-970a4334c7e1 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:42.154203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea6c93-6c9b-4dde-b301-970a4334c7e1 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:42.154332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea6c93-6c9b-4dde-b301-970a4334c7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:42.177810 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-18ea6c93-6c9b-4dde-b301-970a4334c7e1 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:42.179058 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-18ea6c93-6c9b-4dde-b301-970a4334c7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:42.244035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1313/2641] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:42.252743 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8edda-4609-4601-8536-44f7305871d3 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:42.253047 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8edda-4609-4601-8536-44f7305871d3 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:42.253359 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8edda-4609-4601-8536-44f7305871d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:42.276881 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-f8d8edda-4609-4601-8536-44f7305871d3 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:42.278385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f8d8edda-4609-4601-8536-44f7305871d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:42.287026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1329/2642] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:42.291263 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea6c93-6c9b-4dde-b301-970a4334c7e1 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:42.301835 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea6c93-6c9b-4dde-b301-970a4334c7e1 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:42.306292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a773a4d-6067-4dd7-9326-be4ac585fb57 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09e3c4820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:42.306884 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a773a4d-6067-4dd7-9326-be4ac585fb57 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:42.307205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a773a4d-6067-4dd7-9326-be4ac585fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:42.307488 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a773a4d-6067-4dd7-9326-be4ac585fb57 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:42.308173 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a773a4d-6067-4dd7-9326-be4ac585fb57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:12:42.308473 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a773a4d-6067-4dd7-9326-be4ac585fb57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:42.310069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a773a4d-6067-4dd7-9326-be4ac585fb57 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:42.323450 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1314/2643] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:12:42.328979 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8edda-4609-4601-8536-44f7305871d3 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:42.338637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8edda-4609-4601-8536-44f7305871d3 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:42.344026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4240bf-d7ff-4870-a89c-e67752405367 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09ea13b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:42.344715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4240bf-d7ff-4870-a89c-e67752405367 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:42.345076 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4240bf-d7ff-4870-a89c-e67752405367 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:42.345386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4240bf-d7ff-4870-a89c-e67752405367 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:42.346067 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4240bf-d7ff-4870-a89c-e67752405367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:42.348146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4240bf-d7ff-4870-a89c-e67752405367 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:42.477272 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1330/2644] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:12:42 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:12:42.481505 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a773a4d-6067-4dd7-9326-be4ac585fb57 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:42.491912 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a773a4d-6067-4dd7-9326-be4ac585fb57 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:42.556910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e239e29-50ce-4765-95e5-bbc3f8d2246d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09e411d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:42.557560 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e239e29-50ce-4765-95e5-bbc3f8d2246d admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:42.557846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e239e29-50ce-4765-95e5-bbc3f8d2246d admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:42.558131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e239e29-50ce-4765-95e5-bbc3f8d2246d admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:42.558754 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e239e29-50ce-4765-95e5-bbc3f8d2246d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:42.560734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e239e29-50ce-4765-95e5-bbc3f8d2246d admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:42.676813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1315/2645] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:12:42 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:12:42.681227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4240bf-d7ff-4870-a89c-e67752405367 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:42.691989 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4240bf-d7ff-4870-a89c-e67752405367 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:42.696735 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7638f-3fa1-4159-8995-c430ec5eeec2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09e105340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:42.697447 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7638f-3fa1-4159-8995-c430ec5eeec2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:42.697784 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7638f-3fa1-4159-8995-c430ec5eeec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:42.698111 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7638f-3fa1-4159-8995-c430ec5eeec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:42.698865 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7638f-3fa1-4159-8995-c430ec5eeec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:42.700520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7638f-3fa1-4159-8995-c430ec5eeec2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:42.710708 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1331/2646] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:12:42.714658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e239e29-50ce-4765-95e5-bbc3f8d2246d admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:42.729082 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e239e29-50ce-4765-95e5-bbc3f8d2246d admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:42.729710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d0ad0-b9fc-4e8d-8eee-b243d87dd92c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09deb4d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:42.730311 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0ad0-b9fc-4e8d-8eee-b243d87dd92c admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:42.730597 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0ad0-b9fc-4e8d-8eee-b243d87dd92c admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:42.730878 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0ad0-b9fc-4e8d-8eee-b243d87dd92c admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:42.731617 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d0ad0-b9fc-4e8d-8eee-b243d87dd92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:42.733759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d0ad0-b9fc-4e8d-8eee-b243d87dd92c admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:42.743900 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1316/2647] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:12:42.748283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7638f-3fa1-4159-8995-c430ec5eeec2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:42.758894 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7638f-3fa1-4159-8995-c430ec5eeec2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:42.763602 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e52e-06b1-484c-a858-e91c844baf84 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09e15e580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:42.770400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e52e-06b1-484c-a858-e91c844baf84 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:42.770400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e52e-06b1-484c-a858-e91c844baf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:42.770400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e52e-06b1-484c-a858-e91c844baf84 admin admin] PATH_INFO: `/v3/projects/8e71dc2bb0e44443b56b692180901129/users/1010644c2f114c7894df9bb8ed440e6b/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:42.786195 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59e52e-06b1-484c-a858-e91c844baf84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e71dc2bb0e44443b56b692180901129, user_id=1010644c2f114c7894df9bb8ed440e6b, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:42.788878 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59e52e-06b1-484c-a858-e91c844baf84 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:42.875386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1332/2648] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:12:42 2022] PUT /identity/v3/projects/8e71dc2bb0e44443b56b692180901129/users/1010644c2f114c7894df9bb8ed440e6b/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:12:42.886791 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb3b1f-4b90-4e4d-8dc6-541a2f7785ef None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:42.887138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb3b1f-4b90-4e4d-8dc6-541a2f7785ef None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:42.890692 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb3b1f-4b90-4e4d-8dc6-541a2f7785ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:42.923852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-5afb3b1f-4b90-4e4d-8dc6-541a2f7785ef None None] MFA Rules not processed for user `1010644c2f114c7894df9bb8ed440e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:42.925005 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5afb3b1f-4b90-4e4d-8dc6-541a2f7785ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:42.997239 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1317/2649] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:42 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:43.002418 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e52e-06b1-484c-a858-e91c844baf84 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:43.069238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e52e-06b1-484c-a858-e91c844baf84 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:43.073492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88178416-fb8d-428e-b938-a762a0c50881 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09dd90760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:43.074081 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178416-fb8d-428e-b938-a762a0c50881 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:43.074369 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178416-fb8d-428e-b938-a762a0c50881 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:43.074648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178416-fb8d-428e-b938-a762a0c50881 admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:43.075313 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88178416-fb8d-428e-b938-a762a0c50881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:43.077324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88178416-fb8d-428e-b938-a762a0c50881 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:43.243438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1333/2650] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:12:43 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:12:43.247300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb3b1f-4b90-4e4d-8dc6-541a2f7785ef None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:43.257649 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb3b1f-4b90-4e4d-8dc6-541a2f7785ef None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:43.319163 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d059e4-aed9-42ad-b7dd-d77a9e056107 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09deb4610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:43.319819 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d059e4-aed9-42ad-b7dd-d77a9e056107 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:43.320048 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d059e4-aed9-42ad-b7dd-d77a9e056107 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:43.320354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d059e4-aed9-42ad-b7dd-d77a9e056107 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:43.320978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d059e4-aed9-42ad-b7dd-d77a9e056107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:43.322866 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d059e4-aed9-42ad-b7dd-d77a9e056107 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:43.487773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1318/2651] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:12:43 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:12:43.492018 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88178416-fb8d-428e-b938-a762a0c50881 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:43.502425 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88178416-fb8d-428e-b938-a762a0c50881 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:43.507104 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b41ae-2b26-492f-a470-d9a397f276e4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09ddfd3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:43.507671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b41ae-2b26-492f-a470-d9a397f276e4 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:43.507956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b41ae-2b26-492f-a470-d9a397f276e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:43.508232 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b41ae-2b26-492f-a470-d9a397f276e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:43.508956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b41ae-2b26-492f-a470-d9a397f276e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:43.510560 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b41ae-2b26-492f-a470-d9a397f276e4 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:43.521953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1334/2652] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:12:43.526349 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d059e4-aed9-42ad-b7dd-d77a9e056107 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:43.538229 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d059e4-aed9-42ad-b7dd-d77a9e056107 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:43.543193 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e968b2-d560-4e05-94bb-6d316b098651 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09e1df2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:43.544085 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e968b2-d560-4e05-94bb-6d316b098651 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:43.544438 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e968b2-d560-4e05-94bb-6d316b098651 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:43.544836 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e968b2-d560-4e05-94bb-6d316b098651 admin admin] PATH_INFO: `/v3/projects/36c00f1dae1b450c88ba3b3cf73ba62d/users/a4b2b15faf9a4396b138b3c335a441a8/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:43.565828 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e968b2-d560-4e05-94bb-6d316b098651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c00f1dae1b450c88ba3b3cf73ba62d, user_id=a4b2b15faf9a4396b138b3c335a441a8, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:43.568595 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e968b2-d560-4e05-94bb-6d316b098651 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:43.673637 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1319/2653] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:12:43 2022] PUT /identity/v3/projects/36c00f1dae1b450c88ba3b3cf73ba62d/users/a4b2b15faf9a4396b138b3c335a441a8/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:43.677798 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b41ae-2b26-492f-a470-d9a397f276e4 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:43.689471 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b41ae-2b26-492f-a470-d9a397f276e4 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:43.756319 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b7cf4-c677-41e5-bde2-f9b82fc14bfc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09e4c8b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:43.756921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7cf4-c677-41e5-bde2-f9b82fc14bfc admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:43.757207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7cf4-c677-41e5-bde2-f9b82fc14bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:43.757486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b7cf4-c677-41e5-bde2-f9b82fc14bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:43.765102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b7cf4-c677-41e5-bde2-f9b82fc14bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:43.765102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b7cf4-c677-41e5-bde2-f9b82fc14bfc admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:43.770339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1335/2654] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:12:43.774572 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e968b2-d560-4e05-94bb-6d316b098651 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:43.785109 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e968b2-d560-4e05-94bb-6d316b098651 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:43.789477 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2665e-e9e6-4360-874e-40b43f03abd3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09e1b80d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:43.790292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2665e-e9e6-4360-874e-40b43f03abd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:43.790582 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2665e-e9e6-4360-874e-40b43f03abd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:43.790865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2665e-e9e6-4360-874e-40b43f03abd3 admin admin] PATH_INFO: `/v3/projects/36c00f1dae1b450c88ba3b3cf73ba62d/users/a4b2b15faf9a4396b138b3c335a441a8/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:43.792708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2665e-e9e6-4360-874e-40b43f03abd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c00f1dae1b450c88ba3b3cf73ba62d, user_id=a4b2b15faf9a4396b138b3c335a441a8, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:43.795358 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2665e-e9e6-4360-874e-40b43f03abd3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:43.805218 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1320/2655] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:12:43 2022] PUT /identity/v3/projects/36c00f1dae1b450c88ba3b3cf73ba62d/users/a4b2b15faf9a4396b138b3c335a441a8/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:43.815678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7a240-f587-402e-8003-2ef24640b077 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:43.815975 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7a240-f587-402e-8003-2ef24640b077 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:43.816289 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7a240-f587-402e-8003-2ef24640b077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:43.851915 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-b0b7a240-f587-402e-8003-2ef24640b077 None None] MFA Rules not processed for user `a4b2b15faf9a4396b138b3c335a441a8`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:43.852994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b0b7a240-f587-402e-8003-2ef24640b077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:43.928675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1336/2656] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:43 2022] POST /identity/v3/auth/tokens => generated 3749 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:43.938535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2665e-e9e6-4360-874e-40b43f03abd3 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:43.940182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1ed2665e-e9e6-4360-874e-40b43f03abd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:44.010248 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2665e-e9e6-4360-874e-40b43f03abd3 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:44.013807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91e04b-1955-454b-82f5-75824c5a48c5 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e16e730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:44.014402 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91e04b-1955-454b-82f5-75824c5a48c5 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:44.014758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91e04b-1955-454b-82f5-75824c5a48c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:44.015142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91e04b-1955-454b-82f5-75824c5a48c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:44.080854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91e04b-1955-454b-82f5-75824c5a48c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:44.082293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91e04b-1955-454b-82f5-75824c5a48c5 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:44.091198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1321/2657] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:12:43 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:12:48.679526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7a240-f587-402e-8003-2ef24640b077 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:48.748555 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7a240-f587-402e-8003-2ef24640b077 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:48.753623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09dd906a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:48.754437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:48.754887 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:48.755201 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] PATH_INFO: `/v3/users/1010644c2f114c7894df9bb8ed440e6b` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:48.756333 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1010644c2f114c7894df9bb8ed440e6b)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:48.758224 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:48.948130 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1010644c2f114c7894df9bb8ed440e6b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:48.960255 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1010644c2f114c7894df9bb8ed440e6b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:48.961052 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1010644c2f114c7894df9bb8ed440e6b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:48.961663 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1010644c2f114c7894df9bb8ed440e6b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:49.041209 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1010644c2f114c7894df9bb8ed440e6b'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:49.056083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1337/2658] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:12:48 2022] DELETE /identity/v3/users/1010644c2f114c7894df9bb8ed440e6b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:49.062525 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59786b17-7b37-4d3e-a261-cd69eacfc226 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:49.063215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59786b17-7b37-4d3e-a261-cd69eacfc226 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:49.063586 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59786b17-7b37-4d3e-a261-cd69eacfc226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:49.088117 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-59786b17-7b37-4d3e-a261-cd69eacfc226 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:49.089405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-59786b17-7b37-4d3e-a261-cd69eacfc226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:49.155247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1322/2659] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:49.166396 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:49.171844 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:49.231496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7d922-f858-407f-9cba-e0f5a3f44bc2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:49.244924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2494fc-d456-4a11-9262-1d65bce25ac0 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09defe340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:49.244924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2494fc-d456-4a11-9262-1d65bce25ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:49.244924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2494fc-d456-4a11-9262-1d65bce25ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:49.244924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2494fc-d456-4a11-9262-1d65bce25ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:49.245409 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2494fc-d456-4a11-9262-1d65bce25ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:49.246169 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2494fc-d456-4a11-9262-1d65bce25ac0 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:49.255486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1338/2660] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:12:49 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:12:49.738600 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59786b17-7b37-4d3e-a261-cd69eacfc226 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:49.739985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-59786b17-7b37-4d3e-a261-cd69eacfc226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:49.751622 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59786b17-7b37-4d3e-a261-cd69eacfc226 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:49.755882 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09e8c84f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:49.756653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:49.756938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:49.757217 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] PATH_INFO: `/v3/projects/8e71dc2bb0e44443b56b692180901129` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:49.758297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e71dc2bb0e44443b56b692180901129)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:49.760222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:49.894260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e71dc2bb0e44443b56b692180901129', 'request_id': 'req-78f79653-90a4-4cb5-b77c-a66f44b406bf'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:49.905442 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e71dc2bb0e44443b56b692180901129', 'request_id': 'req-78f79653-90a4-4cb5-b77c-a66f44b406bf'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:49.973184 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e71dc2bb0e44443b56b692180901129', 'request_id': 'req-78f79653-90a4-4cb5-b77c-a66f44b406bf'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:49.984136 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] The token cache is being invalidate because project 8e71dc2bb0e44443b56b692180901129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:12:49.984411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:49.985575 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:49.987035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1323/2661] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:12:49 2022] DELETE /identity/v3/projects/8e71dc2bb0e44443b56b692180901129 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:49.991339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2494fc-d456-4a11-9262-1d65bce25ac0 service neutron] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:50.001214 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2494fc-d456-4a11-9262-1d65bce25ac0 service neutron] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:50.066275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1135fd2-e82b-41f5-ac4a-b33135547058 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09de36df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:50.067085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1135fd2-e82b-41f5-ac4a-b33135547058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:50.070057 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1135fd2-e82b-41f5-ac4a-b33135547058 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:50.070374 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1135fd2-e82b-41f5-ac4a-b33135547058 admin admin] PATH_INFO: `/v3/users/a4b2b15faf9a4396b138b3c335a441a8` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:50.071573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1135fd2-e82b-41f5-ac4a-b33135547058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b2b15faf9a4396b138b3c335a441a8)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:50.073502 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1135fd2-e82b-41f5-ac4a-b33135547058 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:50.237482 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-b1135fd2-e82b-41f5-ac4a-b33135547058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b2b15faf9a4396b138b3c335a441a8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:50.248966 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-b1135fd2-e82b-41f5-ac4a-b33135547058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b2b15faf9a4396b138b3c335a441a8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:50.249671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-b1135fd2-e82b-41f5-ac4a-b33135547058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b2b15faf9a4396b138b3c335a441a8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:50.250368 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-b1135fd2-e82b-41f5-ac4a-b33135547058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b2b15faf9a4396b138b3c335a441a8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:50.326951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-b1135fd2-e82b-41f5-ac4a-b33135547058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b2b15faf9a4396b138b3c335a441a8'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:50.340320 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1339/2662] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:12:49 2022] DELETE /identity/v3/users/a4b2b15faf9a4396b138b3c335a441a8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:50.842623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:50.844181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:50.857985 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79653-90a4-4cb5-b77c-a66f44b406bf admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:50.921097 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ks5FHhtfRx2opVRJJjj5Ng, audit_chain_id=['ks5FHhtfRx2opVRJJjj5Ng']) at 0x7fe09de54700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:50.921994 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:50.922291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:50.922600 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] PATH_INFO: `/v3/projects/36c00f1dae1b450c88ba3b3cf73ba62d` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:50.923860 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c00f1dae1b450c88ba3b3cf73ba62d)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:50.925755 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:51.019615 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c00f1dae1b450c88ba3b3cf73ba62d', 'request_id': 'req-0047bee7-86ff-4bb9-a6af-15fa044f2f33'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:51.031089 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c00f1dae1b450c88ba3b3cf73ba62d', 'request_id': 'req-0047bee7-86ff-4bb9-a6af-15fa044f2f33'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:51.109033 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c00f1dae1b450c88ba3b3cf73ba62d', 'request_id': 'req-0047bee7-86ff-4bb9-a6af-15fa044f2f33'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:51.119030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] The token cache is being invalidate because project 36c00f1dae1b450c88ba3b3cf73ba62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:12:51.119350 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:51.119983 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-0047bee7-86ff-4bb9-a6af-15fa044f2f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:51.121446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1324/2663] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:12:50 2022] DELETE /identity/v3/projects/36c00f1dae1b450c88ba3b3cf73ba62d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:51.127012 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502d1e-6cc3-403b-8df6-0878c9508c3c None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:51.127530 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502d1e-6cc3-403b-8df6-0878c9508c3c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:51.127627 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502d1e-6cc3-403b-8df6-0878c9508c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:51.150442 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-df502d1e-6cc3-403b-8df6-0878c9508c3c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:51.151623 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-df502d1e-6cc3-403b-8df6-0878c9508c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:51.215687 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1340/2664] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:51.223410 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172974-6dfe-408e-abcc-d668ea76b4a0 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:51.223745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172974-6dfe-408e-abcc-d668ea76b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:51.224030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172974-6dfe-408e-abcc-d668ea76b4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:51.246330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-ba172974-6dfe-408e-abcc-d668ea76b4a0 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:51.247510 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ba172974-6dfe-408e-abcc-d668ea76b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:51.255507 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1325/2665] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:51.261714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502d1e-6cc3-403b-8df6-0878c9508c3c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:51.275775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502d1e-6cc3-403b-8df6-0878c9508c3c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:51.280417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c70984-2939-4acc-865b-a195c7a546a0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nAkoI0_sTmaGRMVA4AR12Q, audit_chain_id=['nAkoI0_sTmaGRMVA4AR12Q']) at 0x7fe09e55f610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:51.281002 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70984-2939-4acc-865b-a195c7a546a0 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:51.281375 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70984-2939-4acc-865b-a195c7a546a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:51.282082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70984-2939-4acc-865b-a195c7a546a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:51.282904 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c70984-2939-4acc-865b-a195c7a546a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:12:51.283233 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c70984-2939-4acc-865b-a195c7a546a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:51.284805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c70984-2939-4acc-865b-a195c7a546a0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:51.296901 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1341/2666] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:12:51.301418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba172974-6dfe-408e-abcc-d668ea76b4a0 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:51.310199 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba172974-6dfe-408e-abcc-d668ea76b4a0 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:51.315076 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00f144-e07e-45b0-a443-2a460e18e7f0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nAkoI0_sTmaGRMVA4AR12Q, audit_chain_id=['nAkoI0_sTmaGRMVA4AR12Q']) at 0x7fe09e9224f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:51.315690 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00f144-e07e-45b0-a443-2a460e18e7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:51.315975 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00f144-e07e-45b0-a443-2a460e18e7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:51.316254 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00f144-e07e-45b0-a443-2a460e18e7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:51.316895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00f144-e07e-45b0-a443-2a460e18e7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:51.318792 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00f144-e07e-45b0-a443-2a460e18e7f0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:51.415643 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1326/2667] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:12:51 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:12:51.418566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c70984-2939-4acc-865b-a195c7a546a0 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:51.428858 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c70984-2939-4acc-865b-a195c7a546a0 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:51.491889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241554ed-6ad7-4489-87aa-fda1095f5adb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nAkoI0_sTmaGRMVA4AR12Q, audit_chain_id=['nAkoI0_sTmaGRMVA4AR12Q']) at 0x7fe09eacf9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:51.492489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241554ed-6ad7-4489-87aa-fda1095f5adb admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:51.492779 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241554ed-6ad7-4489-87aa-fda1095f5adb admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:51.493057 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241554ed-6ad7-4489-87aa-fda1095f5adb admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:51.493684 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241554ed-6ad7-4489-87aa-fda1095f5adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:51.495594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241554ed-6ad7-4489-87aa-fda1095f5adb admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:51.601966 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1342/2668] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:12:51 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:12:51.606334 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00f144-e07e-45b0-a443-2a460e18e7f0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:51.617034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00f144-e07e-45b0-a443-2a460e18e7f0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:51.621558 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a4c3f-4154-4ce9-9986-145b5007d2e2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nAkoI0_sTmaGRMVA4AR12Q, audit_chain_id=['nAkoI0_sTmaGRMVA4AR12Q']) at 0x7fe09e3acd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:51.622148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a4c3f-4154-4ce9-9986-145b5007d2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:51.622431 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a4c3f-4154-4ce9-9986-145b5007d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:51.622709 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a4c3f-4154-4ce9-9986-145b5007d2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:51.623456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a4c3f-4154-4ce9-9986-145b5007d2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:51.626039 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a4c3f-4154-4ce9-9986-145b5007d2e2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:51.636111 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1327/2669] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:12:51.640029 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241554ed-6ad7-4489-87aa-fda1095f5adb admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:51.650249 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241554ed-6ad7-4489-87aa-fda1095f5adb admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:51.654849 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359eedb3-133f-48d4-9572-d020dbc3c8e9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nAkoI0_sTmaGRMVA4AR12Q, audit_chain_id=['nAkoI0_sTmaGRMVA4AR12Q']) at 0x7fe09defe430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:51.655478 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eedb3-133f-48d4-9572-d020dbc3c8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:51.655768 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eedb3-133f-48d4-9572-d020dbc3c8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:51.656048 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eedb3-133f-48d4-9572-d020dbc3c8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:51.657008 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359eedb3-133f-48d4-9572-d020dbc3c8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:51.658397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359eedb3-133f-48d4-9572-d020dbc3c8e9 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:51.668417 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1343/2670] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:12:51.672971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a4c3f-4154-4ce9-9986-145b5007d2e2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:51.682425 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a4c3f-4154-4ce9-9986-145b5007d2e2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:51.686807 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf13d61-086d-49aa-8973-e52b06dff3db admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nAkoI0_sTmaGRMVA4AR12Q, audit_chain_id=['nAkoI0_sTmaGRMVA4AR12Q']) at 0x7fe09e3f3bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:51.688479 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf13d61-086d-49aa-8973-e52b06dff3db admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:51.688788 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf13d61-086d-49aa-8973-e52b06dff3db admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:51.689075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf13d61-086d-49aa-8973-e52b06dff3db admin admin] PATH_INFO: `/v3/projects/91178068aa4c4725a7c3c3aead6ca4cf/users/fa375a2491264284a32774e09b3a5502/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:51.709623 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf13d61-086d-49aa-8973-e52b06dff3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=91178068aa4c4725a7c3c3aead6ca4cf, user_id=fa375a2491264284a32774e09b3a5502, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:51.712250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf13d61-086d-49aa-8973-e52b06dff3db admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:51.795545 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1328/2671] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:12:51 2022] PUT /identity/v3/projects/91178068aa4c4725a7c3c3aead6ca4cf/users/fa375a2491264284a32774e09b3a5502/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:51.807724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2009d1d-01a7-4597-9e09-4150587587f1 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:51.808026 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2009d1d-01a7-4597-9e09-4150587587f1 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:51.808318 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2009d1d-01a7-4597-9e09-4150587587f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:51.846110 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-d2009d1d-01a7-4597-9e09-4150587587f1 None None] MFA Rules not processed for user `fa375a2491264284a32774e09b3a5502`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:51.847347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-d2009d1d-01a7-4597-9e09-4150587587f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:51.918509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1344/2672] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:51 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:12:51.928805 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf13d61-086d-49aa-8973-e52b06dff3db admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:51.930397 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-5bf13d61-086d-49aa-8973-e52b06dff3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:51.997124 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf13d61-086d-49aa-8973-e52b06dff3db admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:52.000636 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d748cf2-c1b0-41ae-a88c-92a0b8a3ccb8 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e17f490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:52.001213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d748cf2-c1b0-41ae-a88c-92a0b8a3ccb8 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:52.001502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d748cf2-c1b0-41ae-a88c-92a0b8a3ccb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:52.001784 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d748cf2-c1b0-41ae-a88c-92a0b8a3ccb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:52.009973 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d748cf2-c1b0-41ae-a88c-92a0b8a3ccb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:52.011449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d748cf2-c1b0-41ae-a88c-92a0b8a3ccb8 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:52.020146 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1329/2673] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:12:51 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:12:58.890728 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2009d1d-01a7-4597-9e09-4150587587f1 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:58.958172 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2009d1d-01a7-4597-9e09-4150587587f1 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:58.962412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nAkoI0_sTmaGRMVA4AR12Q, audit_chain_id=['nAkoI0_sTmaGRMVA4AR12Q']) at 0x7fe09ea7c760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:58.963242 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:58.963531 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:58.963813 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] PATH_INFO: `/v3/users/fa375a2491264284a32774e09b3a5502` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:58.964910 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa375a2491264284a32774e09b3a5502)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:58.966799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:59.163189 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa375a2491264284a32774e09b3a5502'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:59.175267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa375a2491264284a32774e09b3a5502'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:59.183679 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa375a2491264284a32774e09b3a5502'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:59.183679 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa375a2491264284a32774e09b3a5502'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:59.299016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa375a2491264284a32774e09b3a5502'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:12:59.312214 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1345/2674] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:12:58 2022] DELETE /identity/v3/users/fa375a2491264284a32774e09b3a5502 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:12:59.316813 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99062-45ee-4bc7-8601-28f8f50599b6 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:59.317355 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99062-45ee-4bc7-8601-28f8f50599b6 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:59.317456 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99062-45ee-4bc7-8601-28f8f50599b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:59.339922 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-f1b99062-45ee-4bc7-8601-28f8f50599b6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:12:59.341100 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f1b99062-45ee-4bc7-8601-28f8f50599b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:59.408457 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1330/2675] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:12:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:12:59.418794 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:12:59.420085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:12:59.483494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb4e33-a41a-4a3e-bbe9-5a06d65a85b2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:12:59.487637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394407c-eca4-4065-8f3b-92bd2355a820 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09de05cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:12:59.488220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394407c-eca4-4065-8f3b-92bd2355a820 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:12:59.488509 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394407c-eca4-4065-8f3b-92bd2355a820 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:12:59.488793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394407c-eca4-4065-8f3b-92bd2355a820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:12:59.497459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394407c-eca4-4065-8f3b-92bd2355a820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:12:59.498882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394407c-eca4-4065-8f3b-92bd2355a820 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:12:59.508043 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1346/2676] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:12:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:00.002536 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b99062-45ee-4bc7-8601-28f8f50599b6 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:00.005576 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-f1b99062-45ee-4bc7-8601-28f8f50599b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:00.016715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b99062-45ee-4bc7-8601-28f8f50599b6 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:00.021981 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nAkoI0_sTmaGRMVA4AR12Q, audit_chain_id=['nAkoI0_sTmaGRMVA4AR12Q']) at 0x7fe09e143fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:00.022786 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:00.023071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:00.023603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] PATH_INFO: `/v3/projects/91178068aa4c4725a7c3c3aead6ca4cf` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:00.024695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91178068aa4c4725a7c3c3aead6ca4cf)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:00.026585 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:00.132921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91178068aa4c4725a7c3c3aead6ca4cf', 'request_id': 'req-47b5202e-4298-4683-acd7-ba6ae601cb21'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:00.144548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91178068aa4c4725a7c3c3aead6ca4cf', 'request_id': 'req-47b5202e-4298-4683-acd7-ba6ae601cb21'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:00.293034 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91178068aa4c4725a7c3c3aead6ca4cf', 'request_id': 'req-47b5202e-4298-4683-acd7-ba6ae601cb21'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:00.304583 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] The token cache is being invalidate because project 91178068aa4c4725a7c3c3aead6ca4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:13:00.304870 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:00.305483 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-47b5202e-4298-4683-acd7-ba6ae601cb21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:00.306946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1331/2677] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:13:00 2022] DELETE /identity/v3/projects/91178068aa4c4725a7c3c3aead6ca4cf => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:00.311994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a35ed-4ea4-4ac2-8f3d-66b2efb600cd None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:00.312535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a35ed-4ea4-4ac2-8f3d-66b2efb600cd None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:00.312651 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a35ed-4ea4-4ac2-8f3d-66b2efb600cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:00.334753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a76a35ed-4ea4-4ac2-8f3d-66b2efb600cd None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:00.335952 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a76a35ed-4ea4-4ac2-8f3d-66b2efb600cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:00.401441 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1347/2678] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:00.410344 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc5a98-1111-4afb-9134-3b6d3a35ad3b None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:00.410840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc5a98-1111-4afb-9134-3b6d3a35ad3b None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:00.410951 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc5a98-1111-4afb-9134-3b6d3a35ad3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:00.433255 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-e5bc5a98-1111-4afb-9134-3b6d3a35ad3b None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:00.434411 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e5bc5a98-1111-4afb-9134-3b6d3a35ad3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:00.442014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1332/2679] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:00.446221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a35ed-4ea4-4ac2-8f3d-66b2efb600cd None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:00.455983 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a35ed-4ea4-4ac2-8f3d-66b2efb600cd None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:00.460706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a660f47-c48c-4524-a41d-a195d4b73bb2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e25b490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:00.461302 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a660f47-c48c-4524-a41d-a195d4b73bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:00.461596 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a660f47-c48c-4524-a41d-a195d4b73bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:00.461889 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a660f47-c48c-4524-a41d-a195d4b73bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:00.462566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a660f47-c48c-4524-a41d-a195d4b73bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:13:00.462872 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a660f47-c48c-4524-a41d-a195d4b73bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:00.464489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a660f47-c48c-4524-a41d-a195d4b73bb2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:00.478921 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1348/2680] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:13:00.483535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc5a98-1111-4afb-9134-3b6d3a35ad3b None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:00.493087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc5a98-1111-4afb-9134-3b6d3a35ad3b None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:00.497632 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3a422-504d-4b25-a05a-0106255efb98 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e50f460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:00.498205 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3a422-504d-4b25-a05a-0106255efb98 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:00.498494 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3a422-504d-4b25-a05a-0106255efb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:00.498778 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3a422-504d-4b25-a05a-0106255efb98 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:00.499449 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3a422-504d-4b25-a05a-0106255efb98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:00.502063 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3a422-504d-4b25-a05a-0106255efb98 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:00.615284 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1333/2681] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:13:00 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:13:00.620434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a660f47-c48c-4524-a41d-a195d4b73bb2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:00.631702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a660f47-c48c-4524-a41d-a195d4b73bb2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:00.697083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30c52-e66b-4686-82d3-c34bd9f4eea8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e1e6d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:00.697689 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30c52-e66b-4686-82d3-c34bd9f4eea8 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:00.697976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30c52-e66b-4686-82d3-c34bd9f4eea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:00.698260 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30c52-e66b-4686-82d3-c34bd9f4eea8 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:00.698886 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c30c52-e66b-4686-82d3-c34bd9f4eea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:00.700803 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c30c52-e66b-4686-82d3-c34bd9f4eea8 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:00.779932 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1349/2682] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:13:00 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:13:00.786250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3a422-504d-4b25-a05a-0106255efb98 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:00.796610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3a422-504d-4b25-a05a-0106255efb98 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:00.801864 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2f695-bc7c-4550-8e71-0211bebe2c75 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e3fa070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:00.802468 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2f695-bc7c-4550-8e71-0211bebe2c75 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:00.802762 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2f695-bc7c-4550-8e71-0211bebe2c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:00.803051 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2f695-bc7c-4550-8e71-0211bebe2c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:00.803832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2f695-bc7c-4550-8e71-0211bebe2c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:00.805465 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2f695-bc7c-4550-8e71-0211bebe2c75 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:00.816273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1334/2683] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:13:00.821083 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30c52-e66b-4686-82d3-c34bd9f4eea8 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:00.832681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30c52-e66b-4686-82d3-c34bd9f4eea8 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:00.837916 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e58de-4e35-4cbe-a078-bea52e057131 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e4ef0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:00.838508 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e58de-4e35-4cbe-a078-bea52e057131 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:00.838831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e58de-4e35-4cbe-a078-bea52e057131 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:00.839130 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e58de-4e35-4cbe-a078-bea52e057131 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:00.839821 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e58de-4e35-4cbe-a078-bea52e057131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:00.841400 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e58de-4e35-4cbe-a078-bea52e057131 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:00.852254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1350/2684] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:13:00.856505 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2f695-bc7c-4550-8e71-0211bebe2c75 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:00.867209 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2f695-bc7c-4550-8e71-0211bebe2c75 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:00.872933 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9303cc-cf94-4224-a2e7-cce66cc109b8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09df25310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:00.873747 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9303cc-cf94-4224-a2e7-cce66cc109b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:00.874038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9303cc-cf94-4224-a2e7-cce66cc109b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:00.874335 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9303cc-cf94-4224-a2e7-cce66cc109b8 admin admin] PATH_INFO: `/v3/projects/5213c64e563b49a2950fe2d7173e83d9/users/7ba332569bc04f099800d3f112c1c8a3/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:00.893515 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9303cc-cf94-4224-a2e7-cce66cc109b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5213c64e563b49a2950fe2d7173e83d9, user_id=7ba332569bc04f099800d3f112c1c8a3, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:00.896208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9303cc-cf94-4224-a2e7-cce66cc109b8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:00.983188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1335/2685] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:13:00 2022] PUT /identity/v3/projects/5213c64e563b49a2950fe2d7173e83d9/users/7ba332569bc04f099800d3f112c1c8a3/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:00.994128 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3a921-9bb5-4406-b9ac-22749b509208 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:00.994539 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3a921-9bb5-4406-b9ac-22749b509208 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:00.994827 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3a921-9bb5-4406-b9ac-22749b509208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:01.032905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a0e3a921-9bb5-4406-b9ac-22749b509208 None None] MFA Rules not processed for user `7ba332569bc04f099800d3f112c1c8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:01.032905 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a0e3a921-9bb5-4406-b9ac-22749b509208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:01.104332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1351/2686] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:00 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:13:01.112863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9303cc-cf94-4224-a2e7-cce66cc109b8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:01.184451 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9303cc-cf94-4224-a2e7-cce66cc109b8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:01.189293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20069c27-e78c-495b-b358-871e7629960e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09de5ffa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:01.189892 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20069c27-e78c-495b-b358-871e7629960e admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:01.190182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20069c27-e78c-495b-b358-871e7629960e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:01.190588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20069c27-e78c-495b-b358-871e7629960e admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:01.191252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20069c27-e78c-495b-b358-871e7629960e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:01.193149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20069c27-e78c-495b-b358-871e7629960e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:01.286883 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1336/2687] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:13:01 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:13:01.288060 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3a921-9bb5-4406-b9ac-22749b509208 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:01.298605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3a921-9bb5-4406-b9ac-22749b509208 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:01.315049 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20069c27-e78c-495b-b358-871e7629960e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:01.316925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-20069c27-e78c-495b-b358-871e7629960e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:01.361590 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286a029-55ac-461a-ad7d-0fa91e729a67 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e92eb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:01.362207 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286a029-55ac-461a-ad7d-0fa91e729a67 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:01.362481 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286a029-55ac-461a-ad7d-0fa91e729a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:01.362762 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286a029-55ac-461a-ad7d-0fa91e729a67 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:01.363438 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286a029-55ac-461a-ad7d-0fa91e729a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:01.365351 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286a029-55ac-461a-ad7d-0fa91e729a67 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:01.387096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20069c27-e78c-495b-b358-871e7629960e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:01.392222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0472a83-c3d5-4cb7-b9bc-ae78ce417ac9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v2kCYE2DRuqAAuB3fV6-_A, audit_chain_id=['v2kCYE2DRuqAAuB3fV6-_A']) at 0x7fe09e3e9e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:01.393023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0472a83-c3d5-4cb7-b9bc-ae78ce417ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:01.393312 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0472a83-c3d5-4cb7-b9bc-ae78ce417ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:01.393630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0472a83-c3d5-4cb7-b9bc-ae78ce417ac9 admin admin] PATH_INFO: `/v3/users/81de109d96414ca5ad8789f0f0c04e67` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:01.394757 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0472a83-c3d5-4cb7-b9bc-ae78ce417ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81de109d96414ca5ad8789f0f0c04e67)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:01.396700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0472a83-c3d5-4cb7-b9bc-ae78ce417ac9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:01.452848 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1352/2688] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:13:01 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:13:01.457296 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286a029-55ac-461a-ad7d-0fa91e729a67 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:01.466506 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286a029-55ac-461a-ad7d-0fa91e729a67 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:01.473238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61954cd-0ab1-4e13-8bff-de6eb1e8aedd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e194280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:01.473820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61954cd-0ab1-4e13-8bff-de6eb1e8aedd admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:01.474107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61954cd-0ab1-4e13-8bff-de6eb1e8aedd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:01.474387 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61954cd-0ab1-4e13-8bff-de6eb1e8aedd admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:01.475071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61954cd-0ab1-4e13-8bff-de6eb1e8aedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:01.476652 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61954cd-0ab1-4e13-8bff-de6eb1e8aedd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:01.486650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1353/2689] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:13:01.490347 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61954cd-0ab1-4e13-8bff-de6eb1e8aedd admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:01.499166 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61954cd-0ab1-4e13-8bff-de6eb1e8aedd admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:01.504155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de276f44-293c-4cde-a350-01efdefa3f25 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e8e06a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:01.504727 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de276f44-293c-4cde-a350-01efdefa3f25 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:01.505014 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de276f44-293c-4cde-a350-01efdefa3f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:01.505292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de276f44-293c-4cde-a350-01efdefa3f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:01.505963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de276f44-293c-4cde-a350-01efdefa3f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:01.507624 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de276f44-293c-4cde-a350-01efdefa3f25 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:01.518712 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1354/2690] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:13:01.522820 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de276f44-293c-4cde-a350-01efdefa3f25 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:01.532220 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de276f44-293c-4cde-a350-01efdefa3f25 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:01.536659 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68363c37-2776-4d14-869e-c0a1cfd16746 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09de5e460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:01.539519 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68363c37-2776-4d14-869e-c0a1cfd16746 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:01.539519 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68363c37-2776-4d14-869e-c0a1cfd16746 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:01.539519 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68363c37-2776-4d14-869e-c0a1cfd16746 admin admin] PATH_INFO: `/v3/projects/24fc56c1a8224dec86fdca386ddb2005/users/46a1a9bff4d944278ab50134e474ce3b/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:01.556744 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68363c37-2776-4d14-869e-c0a1cfd16746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fc56c1a8224dec86fdca386ddb2005, user_id=46a1a9bff4d944278ab50134e474ce3b, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:01.559412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68363c37-2776-4d14-869e-c0a1cfd16746 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:01.569041 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e0472a83-c3d5-4cb7-b9bc-ae78ce417ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81de109d96414ca5ad8789f0f0c04e67'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:01.618263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1355/2691] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:13:01 2022] PUT /identity/v3/projects/24fc56c1a8224dec86fdca386ddb2005/users/46a1a9bff4d944278ab50134e474ce3b/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:13:01.629899 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28452-9129-4fe1-827b-7d2a0c41ea72 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:01.630197 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28452-9129-4fe1-827b-7d2a0c41ea72 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:01.630486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28452-9129-4fe1-827b-7d2a0c41ea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:01.641141 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e0472a83-c3d5-4cb7-b9bc-ae78ce417ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81de109d96414ca5ad8789f0f0c04e67'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:01.655279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e0472a83-c3d5-4cb7-b9bc-ae78ce417ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81de109d96414ca5ad8789f0f0c04e67'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:01.656015 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e0472a83-c3d5-4cb7-b9bc-ae78ce417ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81de109d96414ca5ad8789f0f0c04e67'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:01.656633 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e0472a83-c3d5-4cb7-b9bc-ae78ce417ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81de109d96414ca5ad8789f0f0c04e67'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:01.669152 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-6dd28452-9129-4fe1-827b-7d2a0c41ea72 None None] MFA Rules not processed for user `46a1a9bff4d944278ab50134e474ce3b`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:01.670038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1337/2692] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:13:01 2022] DELETE /identity/v3/users/81de109d96414ca5ad8789f0f0c04e67 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:13:01.670489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6dd28452-9129-4fe1-827b-7d2a0c41ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:01.674509 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4726ad7-c970-4372-abd2-0837af8b79f6 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:01.674798 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4726ad7-c970-4372-abd2-0837af8b79f6 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:01.675138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4726ad7-c970-4372-abd2-0837af8b79f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:01.696778 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a4726ad7-c970-4372-abd2-0837af8b79f6 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:01.697952 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a4726ad7-c970-4372-abd2-0837af8b79f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:01.744470 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1356/2693] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:01 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:13:01.748989 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd28452-9129-4fe1-827b-7d2a0c41ea72 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:01.750526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6dd28452-9129-4fe1-827b-7d2a0c41ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:01.763603 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1338/2694] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:13:01.774328 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4726ad7-c970-4372-abd2-0837af8b79f6 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:01.775641 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a4726ad7-c970-4372-abd2-0837af8b79f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:01.821237 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd28452-9129-4fe1-827b-7d2a0c41ea72 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:01.825494 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee9aac-cb13-409d-aa04-60646b6d37cf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e196ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:01.826091 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee9aac-cb13-409d-aa04-60646b6d37cf admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:01.826385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee9aac-cb13-409d-aa04-60646b6d37cf admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:01.826667 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee9aac-cb13-409d-aa04-60646b6d37cf admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:01.827339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee9aac-cb13-409d-aa04-60646b6d37cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:01.829771 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee9aac-cb13-409d-aa04-60646b6d37cf admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:01.838686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4726ad7-c970-4372-abd2-0837af8b79f6 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:01.842211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f2b54-ce70-4ff3-846a-4ecc3981c233 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09ddd8ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:01.842787 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f2b54-ce70-4ff3-846a-4ecc3981c233 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:01.843072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f2b54-ce70-4ff3-846a-4ecc3981c233 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:01.843405 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f2b54-ce70-4ff3-846a-4ecc3981c233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:01.852719 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f2b54-ce70-4ff3-846a-4ecc3981c233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:01.854129 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f2b54-ce70-4ff3-846a-4ecc3981c233 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:01.864181 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1339/2695] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:13:01.916561 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1357/2696] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:13:01 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:13:01.920749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f2b54-ce70-4ff3-846a-4ecc3981c233 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:01.931978 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f2b54-ce70-4ff3-846a-4ecc3981c233 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:02.001734 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fbce3-e775-4245-baaa-0214e248e6cb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e198130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:02.002420 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fbce3-e775-4245-baaa-0214e248e6cb admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.002780 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fbce3-e775-4245-baaa-0214e248e6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.003065 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fbce3-e775-4245-baaa-0214e248e6cb admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.003779 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fbce3-e775-4245-baaa-0214e248e6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:02.005691 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fbce3-e775-4245-baaa-0214e248e6cb admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:02.092270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1340/2697] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:13:01 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:13:02.102882 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee9aac-cb13-409d-aa04-60646b6d37cf admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:02.109942 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee9aac-cb13-409d-aa04-60646b6d37cf admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:02.115674 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134133f6-94fd-41de-b136-75331f85eb4b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e1ddac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:02.116284 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134133f6-94fd-41de-b136-75331f85eb4b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.116706 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134133f6-94fd-41de-b136-75331f85eb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.116994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134133f6-94fd-41de-b136-75331f85eb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.117694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134133f6-94fd-41de-b136-75331f85eb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:02.119303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134133f6-94fd-41de-b136-75331f85eb4b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:02.131071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1358/2698] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:13:02.135350 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fbce3-e775-4245-baaa-0214e248e6cb admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:02.145529 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fbce3-e775-4245-baaa-0214e248e6cb admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:02.151504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4aad-8a69-49c1-b688-2a428db9b241 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e1cc2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:02.151504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4aad-8a69-49c1-b688-2a428db9b241 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.151504 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4aad-8a69-49c1-b688-2a428db9b241 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.151824 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4aad-8a69-49c1-b688-2a428db9b241 admin admin] PATH_INFO: `/v3/projects/7b0640ca2f894437b84a9c5f13ce4d8e/users/d5ff6b69bbb5455f99956bc524989dff/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.173548 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd4aad-8a69-49c1-b688-2a428db9b241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0640ca2f894437b84a9c5f13ce4d8e, user_id=d5ff6b69bbb5455f99956bc524989dff, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:02.176256 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd4aad-8a69-49c1-b688-2a428db9b241 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:02.297695 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1341/2699] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:13:02 2022] PUT /identity/v3/projects/7b0640ca2f894437b84a9c5f13ce4d8e/users/d5ff6b69bbb5455f99956bc524989dff/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:13:02.302443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134133f6-94fd-41de-b136-75331f85eb4b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:02.312146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134133f6-94fd-41de-b136-75331f85eb4b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:02.319553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4aad-8a69-49c1-b688-2a428db9b241 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:02.323751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ccbd4aad-8a69-49c1-b688-2a428db9b241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:02.379321 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211eb067-2b4d-476f-a226-d7a94ea702ea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e1aee20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:02.379973 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eb067-2b4d-476f-a226-d7a94ea702ea admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.380225 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eb067-2b4d-476f-a226-d7a94ea702ea admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.380506 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eb067-2b4d-476f-a226-d7a94ea702ea admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.381196 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211eb067-2b4d-476f-a226-d7a94ea702ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:02.382906 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211eb067-2b4d-476f-a226-d7a94ea702ea admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:02.393373 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1359/2700] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:13:02.394835 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4aad-8a69-49c1-b688-2a428db9b241 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:02.397795 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211eb067-2b4d-476f-a226-d7a94ea702ea admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:02.399514 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v2kCYE2DRuqAAuB3fV6-_A, audit_chain_id=['v2kCYE2DRuqAAuB3fV6-_A']) at 0x7fe09df0b6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:02.400293 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.400579 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.400857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] PATH_INFO: `/v3/projects/f4f770cf25bf4c7ba13571df4298a933` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.401999 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f770cf25bf4c7ba13571df4298a933)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:02.404170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:02.409492 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211eb067-2b4d-476f-a226-d7a94ea702ea admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:02.413364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b10ad-4116-415b-b6c1-29a6087daa6f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e4d3d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:02.414235 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b10ad-4116-415b-b6c1-29a6087daa6f admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.414523 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b10ad-4116-415b-b6c1-29a6087daa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.414808 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b10ad-4116-415b-b6c1-29a6087daa6f admin admin] PATH_INFO: `/v3/projects/7b0640ca2f894437b84a9c5f13ce4d8e/users/d5ff6b69bbb5455f99956bc524989dff/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.416682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b10ad-4116-415b-b6c1-29a6087daa6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0640ca2f894437b84a9c5f13ce4d8e, user_id=d5ff6b69bbb5455f99956bc524989dff, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:02.419300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b10ad-4116-415b-b6c1-29a6087daa6f admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:02.429769 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1360/2701] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:13:02 2022] PUT /identity/v3/projects/7b0640ca2f894437b84a9c5f13ce4d8e/users/d5ff6b69bbb5455f99956bc524989dff/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:13:02.440257 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea8f5a-1bc6-49d2-b7c6-8caaa21a1779 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.440553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea8f5a-1bc6-49d2-b7c6-8caaa21a1779 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.440839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea8f5a-1bc6-49d2-b7c6-8caaa21a1779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.476972 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-e8ea8f5a-1bc6-49d2-b7c6-8caaa21a1779 None None] MFA Rules not processed for user `d5ff6b69bbb5455f99956bc524989dff`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:02.478133 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e8ea8f5a-1bc6-49d2-b7c6-8caaa21a1779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:02.509447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f770cf25bf4c7ba13571df4298a933', 'request_id': 'req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:02.521362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f770cf25bf4c7ba13571df4298a933', 'request_id': 'req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:02.553862 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1361/2702] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:02 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:02.563974 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea8f5a-1bc6-49d2-b7c6-8caaa21a1779 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:02.565261 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-e8ea8f5a-1bc6-49d2-b7c6-8caaa21a1779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:02.601465 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f770cf25bf4c7ba13571df4298a933', 'request_id': 'req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:02.612613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] The token cache is being invalidate because project f4f770cf25bf4c7ba13571df4298a933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:13:02.612903 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:02.613565 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e8a0aeb9-6f43-44c2-ae8a-3c9a3c008c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:02.615039 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1342/2703] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:13:02 2022] DELETE /identity/v3/projects/f4f770cf25bf4c7ba13571df4298a933 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:02.619598 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff47c8-929c-45fc-95b4-825c8f83bdcc None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.619890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff47c8-929c-45fc-95b4-825c8f83bdcc None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.620175 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff47c8-929c-45fc-95b4-825c8f83bdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.635846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea8f5a-1bc6-49d2-b7c6-8caaa21a1779 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:02.643081 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a9ff47c8-929c-45fc-95b4-825c8f83bdcc None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:02.644258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a9ff47c8-929c-45fc-95b4-825c8f83bdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:02.698579 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58524038-e13d-4f64-9424-79e9ff4a607f service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e4ef040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:02.699246 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58524038-e13d-4f64-9424-79e9ff4a607f service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.699566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58524038-e13d-4f64-9424-79e9ff4a607f service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.702324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58524038-e13d-4f64-9424-79e9ff4a607f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.702324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-58524038-e13d-4f64-9424-79e9ff4a607f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:02.714232 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1343/2704] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:13:02.722804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45cec9-9207-4864-a803-6c41b61fcddc None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.723101 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45cec9-9207-4864-a803-6c41b61fcddc None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.723418 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45cec9-9207-4864-a803-6c41b61fcddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.745564 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-7e45cec9-9207-4864-a803-6c41b61fcddc None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:02.746716 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-7e45cec9-9207-4864-a803-6c41b61fcddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:02.754194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1344/2705] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:02.758192 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45cec9-9207-4864-a803-6c41b61fcddc None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:02.767264 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45cec9-9207-4864-a803-6c41b61fcddc None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:02.771809 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bd7bc-3aea-4169-b90f-e73b456eba80 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2rNw__QsT6ONO-1NbzgY2w, audit_chain_id=['2rNw__QsT6ONO-1NbzgY2w']) at 0x7fe09e411820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:02.772392 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bd7bc-3aea-4169-b90f-e73b456eba80 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.772686 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bd7bc-3aea-4169-b90f-e73b456eba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.772805 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58524038-e13d-4f64-9424-79e9ff4a607f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:02.772984 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bd7bc-3aea-4169-b90f-e73b456eba80 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.773657 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bd7bc-3aea-4169-b90f-e73b456eba80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:13:02.773960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bd7bc-3aea-4169-b90f-e73b456eba80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:02.774211 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58524038-e13d-4f64-9424-79e9ff4a607f service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:02.775587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bd7bc-3aea-4169-b90f-e73b456eba80 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:02.784119 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1362/2706] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:02 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:13:02.789394 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1345/2707] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:13:02.793862 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58524038-e13d-4f64-9424-79e9ff4a607f service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:02.804653 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58524038-e13d-4f64-9424-79e9ff4a607f service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:02.809252 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57eada-a02c-42ff-bb27-8ad4587dd83a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2rNw__QsT6ONO-1NbzgY2w, audit_chain_id=['2rNw__QsT6ONO-1NbzgY2w']) at 0x7fe09e474fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:02.809846 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57eada-a02c-42ff-bb27-8ad4587dd83a admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.810135 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57eada-a02c-42ff-bb27-8ad4587dd83a admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.810443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57eada-a02c-42ff-bb27-8ad4587dd83a admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.811080 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57eada-a02c-42ff-bb27-8ad4587dd83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:02.813254 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57eada-a02c-42ff-bb27-8ad4587dd83a admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:02.908437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1363/2708] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:13:02 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:13:02.909896 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bd7bc-3aea-4169-b90f-e73b456eba80 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:02.919700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bd7bc-3aea-4169-b90f-e73b456eba80 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:02.984447 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1230-dd39-4d7c-a63a-4e486db4b2e1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2rNw__QsT6ONO-1NbzgY2w, audit_chain_id=['2rNw__QsT6ONO-1NbzgY2w']) at 0x7fe09e3e4a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:02.985076 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1230-dd39-4d7c-a63a-4e486db4b2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:02.985388 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1230-dd39-4d7c-a63a-4e486db4b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:02.985681 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1230-dd39-4d7c-a63a-4e486db4b2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:02.986324 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff1230-dd39-4d7c-a63a-4e486db4b2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:02.988297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff1230-dd39-4d7c-a63a-4e486db4b2e1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:03.082348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1346/2709] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:13:02 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:13:03.086459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57eada-a02c-42ff-bb27-8ad4587dd83a admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:03.096472 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57eada-a02c-42ff-bb27-8ad4587dd83a admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:03.101126 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebe786-a4ba-41f3-abd5-0b41ca8401c3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2rNw__QsT6ONO-1NbzgY2w, audit_chain_id=['2rNw__QsT6ONO-1NbzgY2w']) at 0x7fe09ddaab50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:03.101724 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebe786-a4ba-41f3-abd5-0b41ca8401c3 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:03.102015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebe786-a4ba-41f3-abd5-0b41ca8401c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:03.102297 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebe786-a4ba-41f3-abd5-0b41ca8401c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:03.102987 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebe786-a4ba-41f3-abd5-0b41ca8401c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:03.104605 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebe786-a4ba-41f3-abd5-0b41ca8401c3 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:03.121081 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1364/2710] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:13:03.122242 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1230-dd39-4d7c-a63a-4e486db4b2e1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:03.132588 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1230-dd39-4d7c-a63a-4e486db4b2e1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:03.137074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508d2de-3079-4a92-99dc-85da4a9013f3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2rNw__QsT6ONO-1NbzgY2w, audit_chain_id=['2rNw__QsT6ONO-1NbzgY2w']) at 0x7fe09e411790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:03.137630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d2de-3079-4a92-99dc-85da4a9013f3 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:03.137932 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d2de-3079-4a92-99dc-85da4a9013f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:03.138197 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d2de-3079-4a92-99dc-85da4a9013f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:03.138901 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508d2de-3079-4a92-99dc-85da4a9013f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:03.140514 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508d2de-3079-4a92-99dc-85da4a9013f3 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:03.151229 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1347/2711] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:13:03.155490 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebe786-a4ba-41f3-abd5-0b41ca8401c3 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:03.165264 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebe786-a4ba-41f3-abd5-0b41ca8401c3 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:03.169650 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8f389-f081-40cb-81a5-c6ebaa7410a0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2rNw__QsT6ONO-1NbzgY2w, audit_chain_id=['2rNw__QsT6ONO-1NbzgY2w']) at 0x7fe09dec1ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:03.170459 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8f389-f081-40cb-81a5-c6ebaa7410a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:03.170747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8f389-f081-40cb-81a5-c6ebaa7410a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:03.171028 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8f389-f081-40cb-81a5-c6ebaa7410a0 admin admin] PATH_INFO: `/v3/projects/c35671b1e3cb4250b1ba2d451be891f8/users/7c64d20b2d314e9bbee9699c5be38300/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:03.191061 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8f389-f081-40cb-81a5-c6ebaa7410a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35671b1e3cb4250b1ba2d451be891f8, user_id=7c64d20b2d314e9bbee9699c5be38300, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:03.193713 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8f389-f081-40cb-81a5-c6ebaa7410a0 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:03.270854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1365/2712] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:13:03 2022] PUT /identity/v3/projects/c35671b1e3cb4250b1ba2d451be891f8/users/7c64d20b2d314e9bbee9699c5be38300/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:13:03.281478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583e904-e8c5-413b-81b1-afe47ac210d4 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:03.281782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583e904-e8c5-413b-81b1-afe47ac210d4 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:03.282072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583e904-e8c5-413b-81b1-afe47ac210d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:03.319694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-9583e904-e8c5-413b-81b1-afe47ac210d4 None None] MFA Rules not processed for user `7c64d20b2d314e9bbee9699c5be38300`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:03.320894 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9583e904-e8c5-413b-81b1-afe47ac210d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:03.393027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1348/2713] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:03 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:03.402738 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8f389-f081-40cb-81a5-c6ebaa7410a0 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:03.404437 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-bbb8f389-f081-40cb-81a5-c6ebaa7410a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:03.469394 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8f389-f081-40cb-81a5-c6ebaa7410a0 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:03.473549 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627cf9f-8020-4fea-885a-0097e0a7a96e service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e9b1130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:03.474138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cf9f-8020-4fea-885a-0097e0a7a96e service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:03.474425 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cf9f-8020-4fea-885a-0097e0a7a96e service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:03.474705 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cf9f-8020-4fea-885a-0097e0a7a96e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:03.483621 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627cf9f-8020-4fea-885a-0097e0a7a96e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:03.485045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627cf9f-8020-4fea-885a-0097e0a7a96e service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:03.494953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1366/2714] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:03 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:04.970356 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583e904-e8c5-413b-81b1-afe47ac210d4 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:04.971857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9583e904-e8c5-413b-81b1-afe47ac210d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:04.983357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583e904-e8c5-413b-81b1-afe47ac210d4 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:04.987863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858b3e2-fc9b-4e9d-916d-26b500d299d2 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09de54b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:04.988439 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858b3e2-fc9b-4e9d-916d-26b500d299d2 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:04.988729 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858b3e2-fc9b-4e9d-916d-26b500d299d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:04.989008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858b3e2-fc9b-4e9d-916d-26b500d299d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:04.990665 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-0858b3e2-fc9b-4e9d-916d-26b500d299d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:05.056409 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858b3e2-fc9b-4e9d-916d-26b500d299d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:05.057840 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858b3e2-fc9b-4e9d-916d-26b500d299d2 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:05.067314 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1349/2715] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:04 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:05.546424 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c9e0-b999-4a01-8ba7-409e360a67c8 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:05.546978 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c9e0-b999-4a01-8ba7-409e360a67c8 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:05.547152 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c9e0-b999-4a01-8ba7-409e360a67c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:05.572924 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-8e66c9e0-b999-4a01-8ba7-409e360a67c8 None None] MFA Rules not processed for user `7c64d20b2d314e9bbee9699c5be38300`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:05.574127 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8e66c9e0-b999-4a01-8ba7-409e360a67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:05.581085 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1367/2716] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:05 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:06.627407 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858b3e2-fc9b-4e9d-916d-26b500d299d2 service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:06.635822 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858b3e2-fc9b-4e9d-916d-26b500d299d2 service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:06.639321 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a01da-c3e7-4d79-8ab5-64dc2b2eaa6f service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09dee1a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:06.639899 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a01da-c3e7-4d79-8ab5-64dc2b2eaa6f service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:06.640188 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a01da-c3e7-4d79-8ab5-64dc2b2eaa6f service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:06.640470 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a01da-c3e7-4d79-8ab5-64dc2b2eaa6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:06.642131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b00a01da-c3e7-4d79-8ab5-64dc2b2eaa6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:06.711658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a01da-c3e7-4d79-8ab5-64dc2b2eaa6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:06.713022 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a01da-c3e7-4d79-8ab5-64dc2b2eaa6f service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:06.723138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1350/2717] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:06 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:07.209412 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66c9e0-b999-4a01-8ba7-409e360a67c8 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:07.210864 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8e66c9e0-b999-4a01-8ba7-409e360a67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:07.288951 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66c9e0-b999-4a01-8ba7-409e360a67c8 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:07.294054 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f392a-494c-41bf-8fda-87f59e46b933 service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=PTVXDCHNQWCQjy3BZQYY3Q, audit_chain_id=['PTVXDCHNQWCQjy3BZQYY3Q']) at 0x7fe09e105340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f330acd453f445ea31acf9fc43b53ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:07.294633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f392a-494c-41bf-8fda-87f59e46b933 service placement] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:07.294963 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f392a-494c-41bf-8fda-87f59e46b933 service placement] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:07.295270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f392a-494c-41bf-8fda-87f59e46b933 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:07.296880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-655f392a-494c-41bf-8fda-87f59e46b933 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:07.309853 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f392a-494c-41bf-8fda-87f59e46b933 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:07.311710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f392a-494c-41bf-8fda-87f59e46b933 service placement] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:07.322500 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1368/2718] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:07 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:08.439198 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a01da-c3e7-4d79-8ab5-64dc2b2eaa6f service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:08.440895 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-b00a01da-c3e7-4d79-8ab5-64dc2b2eaa6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:08.454102 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a01da-c3e7-4d79-8ab5-64dc2b2eaa6f service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:08.460249 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972902cd-d192-494f-b09a-ca0d799bf2dd service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=RLyH0N9xSwiZDKvJxMSolg, audit_chain_id=['RLyH0N9xSwiZDKvJxMSolg']) at 0x7fe09e3e4490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f330acd453f445ea31acf9fc43b53ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:08.461016 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972902cd-d192-494f-b09a-ca0d799bf2dd service placement] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:08.461308 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972902cd-d192-494f-b09a-ca0d799bf2dd service placement] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:08.461796 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972902cd-d192-494f-b09a-ca0d799bf2dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:08.463689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-972902cd-d192-494f-b09a-ca0d799bf2dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:08.476998 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972902cd-d192-494f-b09a-ca0d799bf2dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:08.478613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972902cd-d192-494f-b09a-ca0d799bf2dd service placement] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:08.488876 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1351/2719] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:08 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:08.690304 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f392a-494c-41bf-8fda-87f59e46b933 service placement] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:08.699680 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f392a-494c-41bf-8fda-87f59e46b933 service placement] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:08.703917 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2d4e8-0a67-4968-a811-117d0f010ff5 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09df241c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:08.704497 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2d4e8-0a67-4968-a811-117d0f010ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:08.705275 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2d4e8-0a67-4968-a811-117d0f010ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:08.705557 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2d4e8-0a67-4968-a811-117d0f010ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:08.707306 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-f8d2d4e8-0a67-4968-a811-117d0f010ff5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:08.781851 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2d4e8-0a67-4968-a811-117d0f010ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:08.784238 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2d4e8-0a67-4968-a811-117d0f010ff5 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:08.794862 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1369/2720] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:08 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:14.164402 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972902cd-d192-494f-b09a-ca0d799bf2dd service placement] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:14.165856 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-972902cd-d192-494f-b09a-ca0d799bf2dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:14.320925 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972902cd-d192-494f-b09a-ca0d799bf2dd service placement] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:14.326037 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09de14730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:14.327203 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:14.327703 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:14.328195 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] PATH_INFO: `/v3/users/7ba332569bc04f099800d3f112c1c8a3` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:14.329516 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba332569bc04f099800d3f112c1c8a3)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:14.331849 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:14.552327 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba332569bc04f099800d3f112c1c8a3'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:14.630095 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba332569bc04f099800d3f112c1c8a3'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:14.643879 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba332569bc04f099800d3f112c1c8a3'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:14.644923 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba332569bc04f099800d3f112c1c8a3'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:14.645953 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba332569bc04f099800d3f112c1c8a3'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:14.660458 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1352/2721] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:13:14 2022] DELETE /identity/v3/users/7ba332569bc04f099800d3f112c1c8a3 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:14.664875 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01e239-8168-4cd3-b524-c19f949d29e8 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:14.665353 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01e239-8168-4cd3-b524-c19f949d29e8 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:14.665470 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01e239-8168-4cd3-b524-c19f949d29e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:14.700566 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-ca01e239-8168-4cd3-b524-c19f949d29e8 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:14.701787 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ca01e239-8168-4cd3-b524-c19f949d29e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:14.772045 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1370/2722] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:14.783467 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:14.784989 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:14.916279 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e677b7-5a6f-4fa4-91cc-3b6c8d08f4d8 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:14.920247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cf81d-f0df-411d-8623-78eb0fcdbd89 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e159e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:14.920907 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cf81d-f0df-411d-8623-78eb0fcdbd89 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:14.921300 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cf81d-f0df-411d-8623-78eb0fcdbd89 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:14.921700 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cf81d-f0df-411d-8623-78eb0fcdbd89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:14.932295 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cf81d-f0df-411d-8623-78eb0fcdbd89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:14.935257 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cf81d-f0df-411d-8623-78eb0fcdbd89 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:14.944909 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1353/2723] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:15.653294 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01e239-8168-4cd3-b524-c19f949d29e8 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:15.654819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ca01e239-8168-4cd3-b524-c19f949d29e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:15.667390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01e239-8168-4cd3-b524-c19f949d29e8 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:15.671976 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e14ecd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:15.672778 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:15.673071 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:15.673358 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] PATH_INFO: `/v3/projects/5213c64e563b49a2950fe2d7173e83d9` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:15.674475 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5213c64e563b49a2950fe2d7173e83d9)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:15.676489 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:15.844461 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5213c64e563b49a2950fe2d7173e83d9', 'request_id': 'req-ba521c57-52ee-4dab-ad7d-d8094a8f83da'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:15.915669 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5213c64e563b49a2950fe2d7173e83d9', 'request_id': 'req-ba521c57-52ee-4dab-ad7d-d8094a8f83da'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:15.927997 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5213c64e563b49a2950fe2d7173e83d9', 'request_id': 'req-ba521c57-52ee-4dab-ad7d-d8094a8f83da'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:15.939625 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] The token cache is being invalidate because project 5213c64e563b49a2950fe2d7173e83d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:13:15.940027 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:15.941614 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:15.942880 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1371/2724] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:13:15 2022] DELETE /identity/v3/projects/5213c64e563b49a2950fe2d7173e83d9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:15.947014 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cf81d-f0df-411d-8623-78eb0fcdbd89 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:15.958042 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cf81d-f0df-411d-8623-78eb0fcdbd89 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:16.025162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e1c8ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:16.026108 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:16.026401 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:16.026689 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] PATH_INFO: `/v3/users/46a1a9bff4d944278ab50134e474ce3b` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:16.028173 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a1a9bff4d944278ab50134e474ce3b)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:16.030148 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:16.220125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a1a9bff4d944278ab50134e474ce3b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:16.321023 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a1a9bff4d944278ab50134e474ce3b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:16.333645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a1a9bff4d944278ab50134e474ce3b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:16.334392 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a1a9bff4d944278ab50134e474ce3b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:16.335128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a1a9bff4d944278ab50134e474ce3b'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:16.348596 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1354/2725] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:13:15 2022] DELETE /identity/v3/users/46a1a9bff4d944278ab50134e474ce3b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:16.873250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:16.874855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:16.964573 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba521c57-52ee-4dab-ad7d-d8094a8f83da admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:17.047226 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800cd50-5a1c-42f2-b0ac-2856ae8a3885 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=wTjUJdAdSkmocIsusTZBDA, audit_chain_id=['wTjUJdAdSkmocIsusTZBDA']) at 0x7fe09dd906a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:17.047850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800cd50-5a1c-42f2-b0ac-2856ae8a3885 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:17.048141 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800cd50-5a1c-42f2-b0ac-2856ae8a3885 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:17.048423 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800cd50-5a1c-42f2-b0ac-2856ae8a3885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:17.050204 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-8800cd50-5a1c-42f2-b0ac-2856ae8a3885 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:17.061644 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800cd50-5a1c-42f2-b0ac-2856ae8a3885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:17.063241 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800cd50-5a1c-42f2-b0ac-2856ae8a3885 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:17.073406 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:17.076520 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1372/2726] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:16 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:17.080322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:17.159239 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fffacf-8229-4997-af8f-92e6be248ee1 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:17.164208 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09e3edbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:17.165012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:17.165307 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:17.165599 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] PATH_INFO: `/v3/projects/24fc56c1a8224dec86fdca386ddb2005` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:17.166732 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24fc56c1a8224dec86fdca386ddb2005)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:17.168668 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:17.413151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24fc56c1a8224dec86fdca386ddb2005', 'request_id': 'req-e5ce1504-fe41-41a4-93b0-32006bb50792'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:17.425663 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24fc56c1a8224dec86fdca386ddb2005', 'request_id': 'req-e5ce1504-fe41-41a4-93b0-32006bb50792'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:17.542721 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24fc56c1a8224dec86fdca386ddb2005', 'request_id': 'req-e5ce1504-fe41-41a4-93b0-32006bb50792'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:17.554135 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] The token cache is being invalidate because project 24fc56c1a8224dec86fdca386ddb2005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:13:17.554419 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:17.555053 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:17.556528 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1355/2727] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:13:17 2022] DELETE /identity/v3/projects/24fc56c1a8224dec86fdca386ddb2005 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:17.560558 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800cd50-5a1c-42f2-b0ac-2856ae8a3885 service nova] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:17.571383 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800cd50-5a1c-42f2-b0ac-2856ae8a3885 service nova] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:17.638170 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd4ef4-c351-47aa-88b3-710094ed84b7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09df3b9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:17.638977 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd4ef4-c351-47aa-88b3-710094ed84b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:17.639293 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd4ef4-c351-47aa-88b3-710094ed84b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:17.639572 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd4ef4-c351-47aa-88b3-710094ed84b7 admin admin] PATH_INFO: `/v3/users/d5ff6b69bbb5455f99956bc524989dff` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:17.640681 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd4ef4-c351-47aa-88b3-710094ed84b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ff6b69bbb5455f99956bc524989dff)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:17.642753 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd4ef4-c351-47aa-88b3-710094ed84b7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:17.832483 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cccd4ef4-c351-47aa-88b3-710094ed84b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ff6b69bbb5455f99956bc524989dff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:17.844883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cccd4ef4-c351-47aa-88b3-710094ed84b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ff6b69bbb5455f99956bc524989dff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:17.846603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cccd4ef4-c351-47aa-88b3-710094ed84b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ff6b69bbb5455f99956bc524989dff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:17.846603 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cccd4ef4-c351-47aa-88b3-710094ed84b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ff6b69bbb5455f99956bc524989dff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:17.944390 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-cccd4ef4-c351-47aa-88b3-710094ed84b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ff6b69bbb5455f99956bc524989dff'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:17.960288 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1373/2728] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:13:17 2022] DELETE /identity/v3/users/d5ff6b69bbb5455f99956bc524989dff => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:18.904007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:18.905715 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:18.918762 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce1504-fe41-41a4-93b0-32006bb50792 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:18.983551 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T0AkdW_oTBCUyjsat7cdKg, audit_chain_id=['T0AkdW_oTBCUyjsat7cdKg']) at 0x7fe09deb4d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:18.984343 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:18.984635 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:18.984921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] PATH_INFO: `/v3/projects/7b0640ca2f894437b84a9c5f13ce4d8e` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:18.986026 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0640ca2f894437b84a9c5f13ce4d8e)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:18.988128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:19.246153 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0640ca2f894437b84a9c5f13ce4d8e', 'request_id': 'req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:19.259303 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0640ca2f894437b84a9c5f13ce4d8e', 'request_id': 'req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:19.424196 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0640ca2f894437b84a9c5f13ce4d8e', 'request_id': 'req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:19.439025 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] The token cache is being invalidate because project 7b0640ca2f894437b84a9c5f13ce4d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:13:19.439332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:19.440064 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-2ab1a274-c4fa-442f-ae8c-bbc1e376dcf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:19.442162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1356/2729] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:13:18 2022] DELETE /identity/v3/projects/7b0640ca2f894437b84a9c5f13ce4d8e => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:19.447512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd2c56-faf0-40af-b909-032bd8236c6e None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:19.448016 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd2c56-faf0-40af-b909-032bd8236c6e None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:19.448117 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd2c56-faf0-40af-b909-032bd8236c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:19.497961 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-48bd2c56-faf0-40af-b909-032bd8236c6e None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:19.499227 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-48bd2c56-faf0-40af-b909-032bd8236c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:19.564797 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1374/2730] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:13:19.573520 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c9e98-2433-4baa-b38f-1865518a3895 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:19.573815 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c9e98-2433-4baa-b38f-1865518a3895 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:19.574102 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c9e98-2433-4baa-b38f-1865518a3895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:19.601319 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-0e0c9e98-2433-4baa-b38f-1865518a3895 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:19.602506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-0e0c9e98-2433-4baa-b38f-1865518a3895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:19.609930 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1357/2731] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:19.614850 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd2c56-faf0-40af-b909-032bd8236c6e None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:19.624093 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd2c56-faf0-40af-b909-032bd8236c6e None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:19.628675 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7baa0-2a6c-4157-ae06-ecbfbea2783b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=phu9IowSTIaHkoJVmhCC8A, audit_chain_id=['phu9IowSTIaHkoJVmhCC8A']) at 0x7fe09e1e6d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:19.629362 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7baa0-2a6c-4157-ae06-ecbfbea2783b admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:19.629655 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7baa0-2a6c-4157-ae06-ecbfbea2783b admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:19.629941 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7baa0-2a6c-4157-ae06-ecbfbea2783b admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:19.630628 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7baa0-2a6c-4157-ae06-ecbfbea2783b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:13:19.630933 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7baa0-2a6c-4157-ae06-ecbfbea2783b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:19.632557 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7baa0-2a6c-4157-ae06-ecbfbea2783b admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:19.645061 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1375/2732] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:13:19.649749 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c9e98-2433-4baa-b38f-1865518a3895 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:19.659253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c9e98-2433-4baa-b38f-1865518a3895 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:19.664149 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8a03-04fd-4282-9dc8-a37b2038cbc5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=phu9IowSTIaHkoJVmhCC8A, audit_chain_id=['phu9IowSTIaHkoJVmhCC8A']) at 0x7fe09df1a340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:19.664727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8a03-04fd-4282-9dc8-a37b2038cbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:19.665013 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8a03-04fd-4282-9dc8-a37b2038cbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:19.665292 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8a03-04fd-4282-9dc8-a37b2038cbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:19.665917 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f8a03-04fd-4282-9dc8-a37b2038cbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:19.667832 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f8a03-04fd-4282-9dc8-a37b2038cbc5 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:19.900297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1358/2733] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:13:19 2022] POST /identity/v3/projects => generated 363 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:13:19.904919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7baa0-2a6c-4157-ae06-ecbfbea2783b admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:19.915107 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7baa0-2a6c-4157-ae06-ecbfbea2783b admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:19.978486 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9c8a8-4786-4060-96f8-8b0c482c3bc2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=phu9IowSTIaHkoJVmhCC8A, audit_chain_id=['phu9IowSTIaHkoJVmhCC8A']) at 0x7fe09de5efd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:19.979089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c8a8-4786-4060-96f8-8b0c482c3bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:19.979411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c8a8-4786-4060-96f8-8b0c482c3bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:19.979696 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c8a8-4786-4060-96f8-8b0c482c3bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:19.980332 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9c8a8-4786-4060-96f8-8b0c482c3bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:19.982216 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9c8a8-4786-4060-96f8-8b0c482c3bc2 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:20.097324 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1376/2734] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:13:19 2022] POST /identity/v3/users => generated 282 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:13:20.101676 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8a03-04fd-4282-9dc8-a37b2038cbc5 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:20.112348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8a03-04fd-4282-9dc8-a37b2038cbc5 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:20.117317 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16a4e8-079f-4a75-be86-1e927ad4cac2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=phu9IowSTIaHkoJVmhCC8A, audit_chain_id=['phu9IowSTIaHkoJVmhCC8A']) at 0x7fe09e17fee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:20.117986 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16a4e8-079f-4a75-be86-1e927ad4cac2 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:20.118315 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16a4e8-079f-4a75-be86-1e927ad4cac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:20.118682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16a4e8-079f-4a75-be86-1e927ad4cac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:20.119484 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16a4e8-079f-4a75-be86-1e927ad4cac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:20.121799 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16a4e8-079f-4a75-be86-1e927ad4cac2 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:20.132992 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1359/2735] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:13:20.137292 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9c8a8-4786-4060-96f8-8b0c482c3bc2 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:20.147871 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9c8a8-4786-4060-96f8-8b0c482c3bc2 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:20.152448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b75eea-e6e4-4936-b5eb-21baf9397c1e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=phu9IowSTIaHkoJVmhCC8A, audit_chain_id=['phu9IowSTIaHkoJVmhCC8A']) at 0x7fe09e212520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:20.153038 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b75eea-e6e4-4936-b5eb-21baf9397c1e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:20.153329 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b75eea-e6e4-4936-b5eb-21baf9397c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:20.153694 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b75eea-e6e4-4936-b5eb-21baf9397c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:20.154338 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b75eea-e6e4-4936-b5eb-21baf9397c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:20.155956 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b75eea-e6e4-4936-b5eb-21baf9397c1e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:20.166983 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1377/2736] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:13:20.171769 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16a4e8-079f-4a75-be86-1e927ad4cac2 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:20.181430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16a4e8-079f-4a75-be86-1e927ad4cac2 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:20.186485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f276e-2151-4270-b68d-598d7efee2f0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=phu9IowSTIaHkoJVmhCC8A, audit_chain_id=['phu9IowSTIaHkoJVmhCC8A']) at 0x7fe09de100a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:20.187316 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f276e-2151-4270-b68d-598d7efee2f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:20.187601 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f276e-2151-4270-b68d-598d7efee2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:20.187874 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f276e-2151-4270-b68d-598d7efee2f0 admin admin] PATH_INFO: `/v3/projects/b13910e216a44286b9d7e78f0574ffc0/users/dd3685658003430fbfe1d4e55e724969/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:20.208341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f276e-2151-4270-b68d-598d7efee2f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13910e216a44286b9d7e78f0574ffc0, user_id=dd3685658003430fbfe1d4e55e724969, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:20.211077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f276e-2151-4270-b68d-598d7efee2f0 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:20.316091 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1360/2737] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:13:20 2022] PUT /identity/v3/projects/b13910e216a44286b9d7e78f0574ffc0/users/dd3685658003430fbfe1d4e55e724969/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:20.326970 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59af0-dac9-4e3e-9e62-93f8ef3b1e5d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:20.327305 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59af0-dac9-4e3e-9e62-93f8ef3b1e5d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:20.327594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59af0-dac9-4e3e-9e62-93f8ef3b1e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:20.366826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-6ce59af0-dac9-4e3e-9e62-93f8ef3b1e5d None None] MFA Rules not processed for user `dd3685658003430fbfe1d4e55e724969`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:20.367935 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-6ce59af0-dac9-4e3e-9e62-93f8ef3b1e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:20.442541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1378/2738] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:20 2022] POST /identity/v3/auth/tokens => generated 3670 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:20.452539 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f276e-2151-4270-b68d-598d7efee2f0 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:20.454286 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-036f276e-2151-4270-b68d-598d7efee2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:20.527271 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f276e-2151-4270-b68d-598d7efee2f0 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:20.530857 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4576d25-8e6c-4f93-b2ba-0b7fbec94a8b service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=oiFFwmPSSbyyca3V1sYlPQ, audit_chain_id=['oiFFwmPSSbyyca3V1sYlPQ']) at 0x7fe09e3d1eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:20.531478 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4576d25-8e6c-4f93-b2ba-0b7fbec94a8b service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:20.531767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4576d25-8e6c-4f93-b2ba-0b7fbec94a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:20.532051 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4576d25-8e6c-4f93-b2ba-0b7fbec94a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:20.540640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4576d25-8e6c-4f93-b2ba-0b7fbec94a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:20.542074 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4576d25-8e6c-4f93-b2ba-0b7fbec94a8b service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:20.551035 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1361/2739] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:20 2022] GET /identity/v3/auth/tokens => generated 3670 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:21.044353 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ac04e-db0f-49bb-bee2-b44951e8ff8c None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:21.044909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ac04e-db0f-49bb-bee2-b44951e8ff8c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:21.044909 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ac04e-db0f-49bb-bee2-b44951e8ff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:21.066911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-383ac04e-db0f-49bb-bee2-b44951e8ff8c None None] MFA Rules not processed for user `59f038939b324d9b8e7214cec4e82933`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:21.068073 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-383ac04e-db0f-49bb-bee2-b44951e8ff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:21.133272 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1379/2740] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:21 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:25.099872 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4576d25-8e6c-4f93-b2ba-0b7fbec94a8b service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:25.101339 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e4576d25-8e6c-4f93-b2ba-0b7fbec94a8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:25.192660 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4576d25-8e6c-4f93-b2ba-0b7fbec94a8b service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:25.199244 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0af1a-042a-4e0e-a6d8-184c1479ecea service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=wTjUJdAdSkmocIsusTZBDA, audit_chain_id=['wTjUJdAdSkmocIsusTZBDA']) at 0x7fe09e2727c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:25.199863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0af1a-042a-4e0e-a6d8-184c1479ecea service nova] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:25.200151 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0af1a-042a-4e0e-a6d8-184c1479ecea service nova] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:25.200432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0af1a-042a-4e0e-a6d8-184c1479ecea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:25.202250 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-aad0af1a-042a-4e0e-a6d8-184c1479ecea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:25.217812 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0af1a-042a-4e0e-a6d8-184c1479ecea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:25.220326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0af1a-042a-4e0e-a6d8-184c1479ecea service nova] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:25.232735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1362/2741] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:25 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:13:37.621480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daff61-dd1e-4c6c-a06c-76ce628ff407 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:37.621990 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daff61-dd1e-4c6c-a06c-76ce628ff407 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:37.622092 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daff61-dd1e-4c6c-a06c-76ce628ff407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:37.656578 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-00daff61-dd1e-4c6c-a06c-76ce628ff407 None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:37.657819 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-00daff61-dd1e-4c6c-a06c-76ce628ff407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:37.719203 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1380/2742] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:13:37 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:37.871669 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0af1a-042a-4e0e-a6d8-184c1479ecea service nova] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:37.873066 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-aad0af1a-042a-4e0e-a6d8-184c1479ecea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:37.948672 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0af1a-042a-4e0e-a6d8-184c1479ecea service nova] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:37.953357 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a716da-aaa0-4fd7-8979-6190af3637e4 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e94cd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:37.953938 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a716da-aaa0-4fd7-8979-6190af3637e4 service swift] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:37.954223 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a716da-aaa0-4fd7-8979-6190af3637e4 service swift] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:37.954503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a716da-aaa0-4fd7-8979-6190af3637e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:37.964664 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a716da-aaa0-4fd7-8979-6190af3637e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:37.966253 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a716da-aaa0-4fd7-8979-6190af3637e4 service swift] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:37.974878 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1363/2743] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:13:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 19:13:38.967222 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df5d2c-2108-4a08-85ed-7507c03d29ea None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:38.967700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df5d2c-2108-4a08-85ed-7507c03d29ea None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:38.967700 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df5d2c-2108-4a08-85ed-7507c03d29ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:38.990777 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-44df5d2c-2108-4a08-85ed-7507c03d29ea None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:38.991613 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-44df5d2c-2108-4a08-85ed-7507c03d29ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:38.998419 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1381/2744] 10.222.0.21 () {58 vars in 967 bytes} [Mon Feb 28 19:13:38 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:39.011133 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a716da-aaa0-4fd7-8979-6190af3637e4 service swift] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:39.022758 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a716da-aaa0-4fd7-8979-6190af3637e4 service swift] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:39.028138 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4244-3063-49dc-86ba-406c7d6fda67 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e8faa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:39.028858 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4244-3063-49dc-86ba-406c7d6fda67 service swift] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:39.037215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4244-3063-49dc-86ba-406c7d6fda67 service swift] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:39.037215 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4244-3063-49dc-86ba-406c7d6fda67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:39.038608 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d4244-3063-49dc-86ba-406c7d6fda67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:39.040291 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d4244-3063-49dc-86ba-406c7d6fda67 service swift] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:39.048430 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1364/2745] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:13:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 19:13:39.758040 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750ac4-44cd-4d06-ac78-ff47dc43bd04 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:39.758335 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750ac4-44cd-4d06-ac78-ff47dc43bd04 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:39.758620 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750ac4-44cd-4d06-ac78-ff47dc43bd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:39.781102 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-b4750ac4-44cd-4d06-ac78-ff47dc43bd04 None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:39.782279 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b4750ac4-44cd-4d06-ac78-ff47dc43bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:39.790048 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1382/2746] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:13:39 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:39.802948 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4244-3063-49dc-86ba-406c7d6fda67 service swift] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:39.813146 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4244-3063-49dc-86ba-406c7d6fda67 service swift] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:39.818054 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d868d-273d-49dc-aa02-195e16b12ba9 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e1593d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:39.818620 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d868d-273d-49dc-aa02-195e16b12ba9 service swift] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:39.818906 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d868d-273d-49dc-aa02-195e16b12ba9 service swift] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:39.819221 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d868d-273d-49dc-aa02-195e16b12ba9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:39.827628 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d868d-273d-49dc-aa02-195e16b12ba9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:39.829211 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d868d-273d-49dc-aa02-195e16b12ba9 service swift] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:39.837027 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1365/2747] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:13:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 19:13:40.604857 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3179-9655-4980-a814-0955696b43b7 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:40.605303 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3179-9655-4980-a814-0955696b43b7 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:40.605428 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3179-9655-4980-a814-0955696b43b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:40.627772 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-b1ed3179-9655-4980-a814-0955696b43b7 None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:40.628911 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b1ed3179-9655-4980-a814-0955696b43b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:40.635930 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1383/2748] 10.222.0.21 () {58 vars in 967 bytes} [Mon Feb 28 19:13:40 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:40.647946 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d868d-273d-49dc-aa02-195e16b12ba9 service swift] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:40.658352 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d868d-273d-49dc-aa02-195e16b12ba9 service swift] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:40.663613 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8f319-9ef7-4a1f-ba01-1254a292f3e6 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=8NSXeokHQSaUb7IQptks5A, audit_chain_id=['8NSXeokHQSaUb7IQptks5A']) at 0x7fe09e143fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf96e3d5ba3483896dcb079f8e7b0bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:40.664179 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8f319-9ef7-4a1f-ba01-1254a292f3e6 service swift] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:40.664468 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8f319-9ef7-4a1f-ba01-1254a292f3e6 service swift] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:40.664751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8f319-9ef7-4a1f-ba01-1254a292f3e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:40.672666 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8f319-9ef7-4a1f-ba01-1254a292f3e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:40.674222 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8f319-9ef7-4a1f-ba01-1254a292f3e6 service swift] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:40.682682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1366/2749] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 19:13:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 19:13:44.108384 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed3179-9655-4980-a814-0955696b43b7 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:44.109939 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-b1ed3179-9655-4980-a814-0955696b43b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:44.205567 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed3179-9655-4980-a814-0955696b43b7 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:44.210710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2rNw__QsT6ONO-1NbzgY2w, audit_chain_id=['2rNw__QsT6ONO-1NbzgY2w']) at 0x7fe09e4f3a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:44.211780 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:44.218448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:44.218448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] PATH_INFO: `/v3/users/7c64d20b2d314e9bbee9699c5be38300` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:44.218448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c64d20b2d314e9bbee9699c5be38300)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:44.218448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:44.327915 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8f319-9ef7-4a1f-ba01-1254a292f3e6 service swift] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:44.329460 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-4df8f319-9ef7-4a1f-ba01-1254a292f3e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:44.409239 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8f319-9ef7-4a1f-ba01-1254a292f3e6 service swift] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:44.412742 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945eb6d-e19a-40f1-8e45-9b251b35ae5d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e8dfaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:44.413322 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945eb6d-e19a-40f1-8e45-9b251b35ae5d service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:44.413610 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945eb6d-e19a-40f1-8e45-9b251b35ae5d service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:44.413890 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945eb6d-e19a-40f1-8e45-9b251b35ae5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:44.415587 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-1945eb6d-e19a-40f1-8e45-9b251b35ae5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:44.463154 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c64d20b2d314e9bbee9699c5be38300'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:44.475253 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c64d20b2d314e9bbee9699c5be38300'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:44.475965 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c64d20b2d314e9bbee9699c5be38300'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:44.476571 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c64d20b2d314e9bbee9699c5be38300'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:44.491387 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945eb6d-e19a-40f1-8e45-9b251b35ae5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:44.492831 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945eb6d-e19a-40f1-8e45-9b251b35ae5d service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:44.502007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1367/2750] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:44 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:13:44.566134 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c64d20b2d314e9bbee9699c5be38300'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:44.586250 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1384/2751] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:13:44 2022] DELETE /identity/v3/users/7c64d20b2d314e9bbee9699c5be38300 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:13:44.590444 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba96e-7fb5-4832-ba7a-1a36ec1d6604 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:44.590765 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba96e-7fb5-4832-ba7a-1a36ec1d6604 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:44.591094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba96e-7fb5-4832-ba7a-1a36ec1d6604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:44.614727 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-018ba96e-7fb5-4832-ba7a-1a36ec1d6604 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:44.615976 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-018ba96e-7fb5-4832-ba7a-1a36ec1d6604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:44.686489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1368/2752] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:44.697557 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:44.699138 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:44.771730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d17eb-5861-44ae-afc2-1ae541d74dea admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:44.778843 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7840bb8-e23b-470f-acf4-ad9bec6839cc service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e6ad7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:44.779495 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7840bb8-e23b-470f-acf4-ad9bec6839cc service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:44.779781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7840bb8-e23b-470f-acf4-ad9bec6839cc service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:44.780061 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7840bb8-e23b-470f-acf4-ad9bec6839cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:44.789685 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7840bb8-e23b-470f-acf4-ad9bec6839cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:44.791137 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7840bb8-e23b-470f-acf4-ad9bec6839cc service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:44.801200 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1385/2753] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:45.110652 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba96e-7fb5-4832-ba7a-1a36ec1d6604 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:45.111880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-018ba96e-7fb5-4832-ba7a-1a36ec1d6604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:45.123546 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba96e-7fb5-4832-ba7a-1a36ec1d6604 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:45.128852 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2rNw__QsT6ONO-1NbzgY2w, audit_chain_id=['2rNw__QsT6ONO-1NbzgY2w']) at 0x7fe09e3ed5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:45.129682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:45.130038 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:45.130578 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] PATH_INFO: `/v3/projects/c35671b1e3cb4250b1ba2d451be891f8` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:45.132078 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35671b1e3cb4250b1ba2d451be891f8)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:45.134584 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:45.305041 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35671b1e3cb4250b1ba2d451be891f8', 'request_id': 'req-d88838f2-9867-4be4-916a-3b2ba57593fa'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:45.317433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35671b1e3cb4250b1ba2d451be891f8', 'request_id': 'req-d88838f2-9867-4be4-916a-3b2ba57593fa'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:45.381427 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35671b1e3cb4250b1ba2d451be891f8', 'request_id': 'req-d88838f2-9867-4be4-916a-3b2ba57593fa'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:45.392814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] The token cache is being invalidate because project c35671b1e3cb4250b1ba2d451be891f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:13:45.394050 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:45.394461 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-d88838f2-9867-4be4-916a-3b2ba57593fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:13:45.396044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1369/2754] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:13:45 2022] DELETE /identity/v3/projects/c35671b1e3cb4250b1ba2d451be891f8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:45.400953 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afbbf1-49f9-4cd4-ba6c-2a8424bc4907 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:45.401641 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afbbf1-49f9-4cd4-ba6c-2a8424bc4907 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:45.401919 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afbbf1-49f9-4cd4-ba6c-2a8424bc4907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:45.438258 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-a9afbbf1-49f9-4cd4-ba6c-2a8424bc4907 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:45.440205 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-a9afbbf1-49f9-4cd4-ba6c-2a8424bc4907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:45.507544 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1386/2755] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:45.515356 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b166-5231-45a1-90bb-4cee455af08d None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:45.515675 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b166-5231-45a1-90bb-4cee455af08d None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:45.515958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b166-5231-45a1-90bb-4cee455af08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:45.540527 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-d7a1b166-5231-45a1-90bb-4cee455af08d None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:45.541724 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-d7a1b166-5231-45a1-90bb-4cee455af08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:45.552372 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1370/2756] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:45.556604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afbbf1-49f9-4cd4-ba6c-2a8424bc4907 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:45.566270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afbbf1-49f9-4cd4-ba6c-2a8424bc4907 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:45.570947 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfa84e-242a-4405-990e-e1536d05c8fe admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1Sq2-5RlQTieG4MKHpfbzw, audit_chain_id=['1Sq2-5RlQTieG4MKHpfbzw']) at 0x7fe09e1c0610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:45.571594 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfa84e-242a-4405-990e-e1536d05c8fe admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:45.571890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfa84e-242a-4405-990e-e1536d05c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:45.572175 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfa84e-242a-4405-990e-e1536d05c8fe admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:45.572870 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfa84e-242a-4405-990e-e1536d05c8fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:13:45.573174 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfa84e-242a-4405-990e-e1536d05c8fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:45.574770 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfa84e-242a-4405-990e-e1536d05c8fe admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:45.588386 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1387/2757] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 19:13:45.592682 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b166-5231-45a1-90bb-4cee455af08d None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:45.603184 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b166-5231-45a1-90bb-4cee455af08d None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:45.607877 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f84597-ee5c-4993-98e0-65c560a4744b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1Sq2-5RlQTieG4MKHpfbzw, audit_chain_id=['1Sq2-5RlQTieG4MKHpfbzw']) at 0x7fe09de54bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:45.608553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84597-ee5c-4993-98e0-65c560a4744b admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:45.608846 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84597-ee5c-4993-98e0-65c560a4744b admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:45.609130 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84597-ee5c-4993-98e0-65c560a4744b admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:45.609773 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f84597-ee5c-4993-98e0-65c560a4744b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:45.611803 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f84597-ee5c-4993-98e0-65c560a4744b admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:45.737332 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1371/2758] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:13:45 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:13:45.741980 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfa84e-242a-4405-990e-e1536d05c8fe admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:45.753671 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfa84e-242a-4405-990e-e1536d05c8fe admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:45.822535 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc2b46-0fde-4a32-a6c6-d4390b200085 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1Sq2-5RlQTieG4MKHpfbzw, audit_chain_id=['1Sq2-5RlQTieG4MKHpfbzw']) at 0x7fe09def91c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:45.823176 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc2b46-0fde-4a32-a6c6-d4390b200085 admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:45.823470 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc2b46-0fde-4a32-a6c6-d4390b200085 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:45.823776 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc2b46-0fde-4a32-a6c6-d4390b200085 admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:45.824440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc2b46-0fde-4a32-a6c6-d4390b200085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:45.826397 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc2b46-0fde-4a32-a6c6-d4390b200085 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:45.960221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1388/2759] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:13:45 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:13:45.964266 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f84597-ee5c-4993-98e0-65c560a4744b admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:45.975366 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f84597-ee5c-4993-98e0-65c560a4744b admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:45.980670 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d0b72-4c15-4b3f-ac0b-8cf8229535fe admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1Sq2-5RlQTieG4MKHpfbzw, audit_chain_id=['1Sq2-5RlQTieG4MKHpfbzw']) at 0x7fe09df1a310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:45.981353 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d0b72-4c15-4b3f-ac0b-8cf8229535fe admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:45.981653 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d0b72-4c15-4b3f-ac0b-8cf8229535fe admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:45.981965 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d0b72-4c15-4b3f-ac0b-8cf8229535fe admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:45.982710 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d0b72-4c15-4b3f-ac0b-8cf8229535fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:45.984337 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d0b72-4c15-4b3f-ac0b-8cf8229535fe admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:45.995767 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1372/2760] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:13:46.000032 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc2b46-0fde-4a32-a6c6-d4390b200085 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:46.009826 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc2b46-0fde-4a32-a6c6-d4390b200085 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:46.015152 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a506060-b7a7-4362-b6cd-09035667641d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1Sq2-5RlQTieG4MKHpfbzw, audit_chain_id=['1Sq2-5RlQTieG4MKHpfbzw']) at 0x7fe09de3cb50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:46.015765 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a506060-b7a7-4362-b6cd-09035667641d admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:46.016055 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a506060-b7a7-4362-b6cd-09035667641d admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:46.016339 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a506060-b7a7-4362-b6cd-09035667641d admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:46.017031 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a506060-b7a7-4362-b6cd-09035667641d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:46.018747 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a506060-b7a7-4362-b6cd-09035667641d admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:46.029653 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1389/2761] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:13:46.034448 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d0b72-4c15-4b3f-ac0b-8cf8229535fe admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:46.045817 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d0b72-4c15-4b3f-ac0b-8cf8229535fe admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:46.050894 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bdcce-98b4-4395-9679-c8794a73e343 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1Sq2-5RlQTieG4MKHpfbzw, audit_chain_id=['1Sq2-5RlQTieG4MKHpfbzw']) at 0x7fe09e3de1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:46.051741 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bdcce-98b4-4395-9679-c8794a73e343 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:46.052030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bdcce-98b4-4395-9679-c8794a73e343 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:46.052502 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bdcce-98b4-4395-9679-c8794a73e343 admin admin] PATH_INFO: `/v3/projects/1c06762c8979480f92330ac600b63c5c/users/8668df273a9344938c66d1ee69a42238/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:46.072270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bdcce-98b4-4395-9679-c8794a73e343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c06762c8979480f92330ac600b63c5c, user_id=8668df273a9344938c66d1ee69a42238, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:46.074897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bdcce-98b4-4395-9679-c8794a73e343 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:46.209559 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1373/2762] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:13:46 2022] PUT /identity/v3/projects/1c06762c8979480f92330ac600b63c5c/users/8668df273a9344938c66d1ee69a42238/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:13:46.214775 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671af6a-c544-4eb3-aa1a-3703512b6f01 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:46.215132 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671af6a-c544-4eb3-aa1a-3703512b6f01 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:46.215512 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671af6a-c544-4eb3-aa1a-3703512b6f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:46.241134 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-3671af6a-c544-4eb3-aa1a-3703512b6f01 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:46.242309 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-3671af6a-c544-4eb3-aa1a-3703512b6f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:46.321711 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1390/2763] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:46.332102 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bdcce-98b4-4395-9679-c8794a73e343 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:46.333800 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-448bdcce-98b4-4395-9679-c8794a73e343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:46.406390 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bdcce-98b4-4395-9679-c8794a73e343 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:46.410931 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba458da-65f3-419e-a68b-21828be229b1 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e3e9e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:46.411568 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba458da-65f3-419e-a68b-21828be229b1 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:46.411863 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba458da-65f3-419e-a68b-21828be229b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:46.412152 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba458da-65f3-419e-a68b-21828be229b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:46.422193 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba458da-65f3-419e-a68b-21828be229b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:46.423693 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba458da-65f3-419e-a68b-21828be229b1 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:46.433830 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1374/2764] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:46 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:13:47.955213 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aa941-04d6-4a85-a4b9-9713dd8fa351 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:47.957003 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aa941-04d6-4a85-a4b9-9713dd8fa351 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:47.957511 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aa941-04d6-4a85-a4b9-9713dd8fa351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:48.005698 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-547aa941-04d6-4a85-a4b9-9713dd8fa351 None None] MFA Rules not processed for user `8668df273a9344938c66d1ee69a42238`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:48.006897 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-547aa941-04d6-4a85-a4b9-9713dd8fa351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:48.088236 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1391/2765] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:47 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:48.246612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba458da-65f3-419e-a68b-21828be229b1 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:48.246612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-fba458da-65f3-419e-a68b-21828be229b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:48.246612 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba458da-65f3-419e-a68b-21828be229b1 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:48.247168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18218f75-4ad3-4af7-9ed6-9bd258f14462 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e3fa070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:48.247168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218f75-4ad3-4af7-9ed6-9bd258f14462 service cinder] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:48.247168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218f75-4ad3-4af7-9ed6-9bd258f14462 service cinder] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:48.247168 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218f75-4ad3-4af7-9ed6-9bd258f14462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:48.247503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18218f75-4ad3-4af7-9ed6-9bd258f14462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:48.247503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18218f75-4ad3-4af7-9ed6-9bd258f14462 service cinder] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:48.247503 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1375/2766] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:48 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:51.311092 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b537fd-2f2d-4f42-95f0-7e716e0e0e9d None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:51.311638 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b537fd-2f2d-4f42-95f0-7e716e0e0e9d None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:51.311757 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b537fd-2f2d-4f42-95f0-7e716e0e0e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:51.334532 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-92b537fd-2f2d-4f42-95f0-7e716e0e0e9d None None] MFA Rules not processed for user `8668df273a9344938c66d1ee69a42238`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:13:51.340415 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-92b537fd-2f2d-4f42-95f0-7e716e0e0e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:51.342089 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1392/2767] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:13:51 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:13:51.756549 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18218f75-4ad3-4af7-9ed6-9bd258f14462 service cinder] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:51.766007 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18218f75-4ad3-4af7-9ed6-9bd258f14462 service cinder] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:51.769650 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66f90a-55f9-45c1-89d1-6eda9e60412f service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09ddd8730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:51.770186 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66f90a-55f9-45c1-89d1-6eda9e60412f service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:51.770474 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66f90a-55f9-45c1-89d1-6eda9e60412f service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:51.770759 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66f90a-55f9-45c1-89d1-6eda9e60412f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:51.772459 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-eb66f90a-55f9-45c1-89d1-6eda9e60412f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:51.782967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66f90a-55f9-45c1-89d1-6eda9e60412f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:51.785213 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66f90a-55f9-45c1-89d1-6eda9e60412f service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:51.794191 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1376/2768] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:51 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:13:57.244095 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b537fd-2f2d-4f42-95f0-7e716e0e0e9d None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:13:57.245600 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-92b537fd-2f2d-4f42-95f0-7e716e0e0e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:57.341678 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b537fd-2f2d-4f42-95f0-7e716e0e0e9d None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:13:57.350640 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af73a3-7f19-40f8-ad14-9970aa6ce783 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=wTjUJdAdSkmocIsusTZBDA, audit_chain_id=['wTjUJdAdSkmocIsusTZBDA']) at 0x7fe09dddf4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d280e56dc8848eb92cbee073fd9fbc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:13:57.351453 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af73a3-7f19-40f8-ad14-9970aa6ce783 service nova] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:13:57.351763 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af73a3-7f19-40f8-ad14-9970aa6ce783 service nova] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:13:57.352015 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af73a3-7f19-40f8-ad14-9970aa6ce783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:13:57.354501 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-58af73a3-7f19-40f8-ad14-9970aa6ce783 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:13:57.367419 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af73a3-7f19-40f8-ad14-9970aa6ce783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:13:57.371606 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af73a3-7f19-40f8-ad14-9970aa6ce783 service nova] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:13:57.380796 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1393/2769] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:13:57 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:14:14.698128 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66f90a-55f9-45c1-89d1-6eda9e60412f service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:14.699708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-eb66f90a-55f9-45c1-89d1-6eda9e60412f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:14.718008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66f90a-55f9-45c1-89d1-6eda9e60412f service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:14.722245 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=phu9IowSTIaHkoJVmhCC8A, audit_chain_id=['phu9IowSTIaHkoJVmhCC8A']) at 0x7fe09de7f250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:14.723582 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:14.723865 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:14.724142 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] PATH_INFO: `/v3/users/dd3685658003430fbfe1d4e55e724969` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:14.725255 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3685658003430fbfe1d4e55e724969)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:14.727171 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:14.944875 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3685658003430fbfe1d4e55e724969'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:15.046069 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3685658003430fbfe1d4e55e724969'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:15.059538 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3685658003430fbfe1d4e55e724969'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:15.060183 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3685658003430fbfe1d4e55e724969'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:15.060795 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3685658003430fbfe1d4e55e724969'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:15.074844 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1377/2770] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:14:14 2022] DELETE /identity/v3/users/dd3685658003430fbfe1d4e55e724969 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:14:15.079547 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab95534-48fa-4604-a6f4-15e2d5129213 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:15.080050 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab95534-48fa-4604-a6f4-15e2d5129213 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:15.080364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab95534-48fa-4604-a6f4-15e2d5129213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:15.101831 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-5ab95534-48fa-4604-a6f4-15e2d5129213 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:14:15.102968 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-5ab95534-48fa-4604-a6f4-15e2d5129213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:15.174145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1394/2771] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:14:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:14:15.184733 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:15.186056 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:15.256094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50801e8f-5926-4ce1-b30e-d45ba5828c0f admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:15.259532 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d789e-5425-4d3d-9ebf-fc85b7f3beb6 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e3dc2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:15.260113 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d789e-5425-4d3d-9ebf-fc85b7f3beb6 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:15.260402 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d789e-5425-4d3d-9ebf-fc85b7f3beb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:15.260685 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d789e-5425-4d3d-9ebf-fc85b7f3beb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:15.271814 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d789e-5425-4d3d-9ebf-fc85b7f3beb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:15.273344 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d789e-5425-4d3d-9ebf-fc85b7f3beb6 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:15.283958 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1378/2772] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:14:15 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:14:15.807249 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab95534-48fa-4604-a6f4-15e2d5129213 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:15.808604 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-5ab95534-48fa-4604-a6f4-15e2d5129213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:15.820432 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab95534-48fa-4604-a6f4-15e2d5129213 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:15.825503 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=phu9IowSTIaHkoJVmhCC8A, audit_chain_id=['phu9IowSTIaHkoJVmhCC8A']) at 0x7fe09e14ea00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:15.826300 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:15.826597 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:15.826888 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] PATH_INFO: `/v3/projects/b13910e216a44286b9d7e78f0574ffc0` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:15.828037 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13910e216a44286b9d7e78f0574ffc0)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:15.830070 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:16.006231 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13910e216a44286b9d7e78f0574ffc0', 'request_id': 'req-aec3fe9d-b764-42de-b9a7-dd45024673a1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:16.114180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13910e216a44286b9d7e78f0574ffc0', 'request_id': 'req-aec3fe9d-b764-42de-b9a7-dd45024673a1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:16.125807 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13910e216a44286b9d7e78f0574ffc0', 'request_id': 'req-aec3fe9d-b764-42de-b9a7-dd45024673a1'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:16.136364 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] The token cache is being invalidate because project b13910e216a44286b9d7e78f0574ffc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:14:16.136648 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:16.137283 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-aec3fe9d-b764-42de-b9a7-dd45024673a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:16.138727 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1395/2773] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:14:15 2022] DELETE /identity/v3/projects/b13910e216a44286b9d7e78f0574ffc0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:14:16.143662 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b163-2af6-4b7f-bd9c-5090a3061f48 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:16.144131 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b163-2af6-4b7f-bd9c-5090a3061f48 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:16.144247 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b163-2af6-4b7f-bd9c-5090a3061f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:16.168330 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-a310b163-2af6-4b7f-bd9c-5090a3061f48 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:14:16.169433 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-a310b163-2af6-4b7f-bd9c-5090a3061f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:16.236260 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1379/2774] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:14:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 19:14:16.245299 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1ec0-c7b7-4b4d-b6f9-deec74deb83c None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:16.245589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1ec0-c7b7-4b4d-b6f9-deec74deb83c None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:16.245868 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1ec0-c7b7-4b4d-b6f9-deec74deb83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:16.268710 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-439e1ec0-c7b7-4b4d-b6f9-deec74deb83c None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:14:16.270781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-439e1ec0-c7b7-4b4d-b6f9-deec74deb83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:16.278470 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1396/2775] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:14:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:14:16.283075 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310b163-2af6-4b7f-bd9c-5090a3061f48 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:16.293096 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310b163-2af6-4b7f-bd9c-5090a3061f48 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:16.297745 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090f391-4577-437e-821e-ce9a960c6539 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Hb2IY3lJTyKVzAuwHFtDDw, audit_chain_id=['Hb2IY3lJTyKVzAuwHFtDDw']) at 0x7fe09e272610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:16.298342 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f391-4577-437e-821e-ce9a960c6539 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:16.298630 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f391-4577-437e-821e-ce9a960c6539 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:16.298909 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f391-4577-437e-821e-ce9a960c6539 admin admin] PATH_INFO: `/v3/domains` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:16.299640 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090f391-4577-437e-821e-ce9a960c6539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:14:16.299940 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090f391-4577-437e-821e-ce9a960c6539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:16.301567 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090f391-4577-437e-821e-ce9a960c6539 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:16.314534 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1380/2776] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:14:16.319547 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e1ec0-c7b7-4b4d-b6f9-deec74deb83c None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:16.328427 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e1ec0-c7b7-4b4d-b6f9-deec74deb83c None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:16.333385 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72836cc-3462-466e-b62e-3c02b705707c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Hb2IY3lJTyKVzAuwHFtDDw, audit_chain_id=['Hb2IY3lJTyKVzAuwHFtDDw']) at 0x7fe09ebb9f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:16.334109 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72836cc-3462-466e-b62e-3c02b705707c admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:16.334419 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72836cc-3462-466e-b62e-3c02b705707c admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:16.334834 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72836cc-3462-466e-b62e-3c02b705707c admin admin] PATH_INFO: `/v3/projects` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:16.336076 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72836cc-3462-466e-b62e-3c02b705707c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:16.338180 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72836cc-3462-466e-b62e-3c02b705707c admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:16.466866 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1397/2777] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:14:16 2022] POST /identity/v3/projects => generated 391 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 19:14:16.468258 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090f391-4577-437e-821e-ce9a960c6539 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:16.478707 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090f391-4577-437e-821e-ce9a960c6539 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:16.549297 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69143d37-2a0c-4f14-9c0d-9dacac915033 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Hb2IY3lJTyKVzAuwHFtDDw, audit_chain_id=['Hb2IY3lJTyKVzAuwHFtDDw']) at 0x7fe09ded03a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:16.549908 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69143d37-2a0c-4f14-9c0d-9dacac915033 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:16.550194 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69143d37-2a0c-4f14-9c0d-9dacac915033 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:16.550474 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69143d37-2a0c-4f14-9c0d-9dacac915033 admin admin] PATH_INFO: `/v3/users` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:16.552030 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69143d37-2a0c-4f14-9c0d-9dacac915033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:16.553794 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69143d37-2a0c-4f14-9c0d-9dacac915033 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:16.663348 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1381/2778] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:14:16 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:14:16.667382 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72836cc-3462-466e-b62e-3c02b705707c admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:16.678491 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72836cc-3462-466e-b62e-3c02b705707c admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:16.682810 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e003824-ca0a-4d7c-8d32-ba7e6767965e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Hb2IY3lJTyKVzAuwHFtDDw, audit_chain_id=['Hb2IY3lJTyKVzAuwHFtDDw']) at 0x7fe09dec1ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:16.683443 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e003824-ca0a-4d7c-8d32-ba7e6767965e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:16.683734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e003824-ca0a-4d7c-8d32-ba7e6767965e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:16.684023 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e003824-ca0a-4d7c-8d32-ba7e6767965e admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:16.684715 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e003824-ca0a-4d7c-8d32-ba7e6767965e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:16.686308 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e003824-ca0a-4d7c-8d32-ba7e6767965e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:16.697221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1398/2779] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 19:14:16.701432 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69143d37-2a0c-4f14-9c0d-9dacac915033 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:16.712782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69143d37-2a0c-4f14-9c0d-9dacac915033 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:16.717354 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50c2b2-5641-46e1-b035-58dde019e598 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Hb2IY3lJTyKVzAuwHFtDDw, audit_chain_id=['Hb2IY3lJTyKVzAuwHFtDDw']) at 0x7fe09df26e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:16.717962 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c2b2-5641-46e1-b035-58dde019e598 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:16.718252 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c2b2-5641-46e1-b035-58dde019e598 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:16.718535 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c2b2-5641-46e1-b035-58dde019e598 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:16.719296 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50c2b2-5641-46e1-b035-58dde019e598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:16.721012 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50c2b2-5641-46e1-b035-58dde019e598 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:16.732605 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1382/2780] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:14:16.737006 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e003824-ca0a-4d7c-8d32-ba7e6767965e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:16.747682 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e003824-ca0a-4d7c-8d32-ba7e6767965e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:16.751948 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee2e6d-5502-4bd3-91c0-272699907fcf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Hb2IY3lJTyKVzAuwHFtDDw, audit_chain_id=['Hb2IY3lJTyKVzAuwHFtDDw']) at 0x7fe09e21bd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:16.752758 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2e6d-5502-4bd3-91c0-272699907fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:16.753041 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2e6d-5502-4bd3-91c0-272699907fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:16.753343 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2e6d-5502-4bd3-91c0-272699907fcf admin admin] PATH_INFO: `/v3/projects/5f8e0d9e77334ed8ab326af2728e6c3d/users/e06c4a989df74c43b4821b00ea0eafd2/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:16.775873 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee2e6d-5502-4bd3-91c0-272699907fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8e0d9e77334ed8ab326af2728e6c3d, user_id=e06c4a989df74c43b4821b00ea0eafd2, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:16.778526 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee2e6d-5502-4bd3-91c0-272699907fcf admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:16.906668 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1399/2781] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:14:16 2022] PUT /identity/v3/projects/5f8e0d9e77334ed8ab326af2728e6c3d/users/e06c4a989df74c43b4821b00ea0eafd2/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:14:16.917621 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3dd5-30ab-4b3a-8f4a-df70c38a3293 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:16.917943 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3dd5-30ab-4b3a-8f4a-df70c38a3293 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:16.918225 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3dd5-30ab-4b3a-8f4a-df70c38a3293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:17.058276 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-ef4a3dd5-30ab-4b3a-8f4a-df70c38a3293 None None] MFA Rules not processed for user `e06c4a989df74c43b4821b00ea0eafd2`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:14:17.059489 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ef4a3dd5-30ab-4b3a-8f4a-df70c38a3293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:17.134538 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1383/2782] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:14:16 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:14:17.144985 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee2e6d-5502-4bd3-91c0-272699907fcf admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:17.146598 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-39ee2e6d-5502-4bd3-91c0-272699907fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:17.213157 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee2e6d-5502-4bd3-91c0-272699907fcf admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:17.216844 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc47de-ed4f-4100-b878-0265d693e736 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=y5aZNnQlRQabsp9Mp_YMeQ, audit_chain_id=['y5aZNnQlRQabsp9Mp_YMeQ']) at 0x7fe09e4f3a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43304b4fcb06440f9d5166ca439a581b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:17.217425 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc47de-ed4f-4100-b878-0265d693e736 service cinder] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:17.217716 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc47de-ed4f-4100-b878-0265d693e736 service cinder] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:17.218000 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc47de-ed4f-4100-b878-0265d693e736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:17.226761 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc47de-ed4f-4100-b878-0265d693e736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:17.228307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc47de-ed4f-4100-b878-0265d693e736 service cinder] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:17.240883 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1400/2783] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:14:17 2022] GET /identity/v3/auth/tokens => generated 3698 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:14:44.904182 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a3dd5-30ab-4b3a-8f4a-df70c38a3293 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:44.905542 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-ef4a3dd5-30ab-4b3a-8f4a-df70c38a3293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:45.015313 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a3dd5-30ab-4b3a-8f4a-df70c38a3293 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:45.020200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fa3f0-5fbd-4f36-b289-388e4d376e8d service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=RLyH0N9xSwiZDKvJxMSolg, audit_chain_id=['RLyH0N9xSwiZDKvJxMSolg']) at 0x7fe09e20e040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f330acd453f445ea31acf9fc43b53ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:45.020782 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa3f0-5fbd-4f36-b289-388e4d376e8d service placement] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:45.021077 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa3f0-5fbd-4f36-b289-388e4d376e8d service placement] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:45.021364 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fa3f0-5fbd-4f36-b289-388e4d376e8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:45.023071 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-3f9fa3f0-5fbd-4f36-b289-388e4d376e8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:45.034726 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fa3f0-5fbd-4f36-b289-388e4d376e8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:45.036500 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fa3f0-5fbd-4f36-b289-388e4d376e8d service placement] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:45.045880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1384/2784] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:14:44 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:14:53.168353 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc47de-ed4f-4100-b878-0265d693e736 service cinder] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:53.243637 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc47de-ed4f-4100-b878-0265d693e736 service cinder] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:53.247986 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Hb2IY3lJTyKVzAuwHFtDDw, audit_chain_id=['Hb2IY3lJTyKVzAuwHFtDDw']) at 0x7fe09df241c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:53.248828 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:53.249123 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:53.249411 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] PATH_INFO: `/v3/users/e06c4a989df74c43b4821b00ea0eafd2` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:53.250553 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06c4a989df74c43b4821b00ea0eafd2)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:53.252504 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:53.435551 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06c4a989df74c43b4821b00ea0eafd2'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:53.449599 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06c4a989df74c43b4821b00ea0eafd2'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:53.450442 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06c4a989df74c43b4821b00ea0eafd2'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:53.451140 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06c4a989df74c43b4821b00ea0eafd2'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:53.513734 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.notifications [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06c4a989df74c43b4821b00ea0eafd2'} {{(pid=67132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:53.529726 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1401/2785] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 19:14:53 2022] DELETE /identity/v3/users/e06c4a989df74c43b4821b00ea0eafd2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:14:53.534485 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447fb92-33ab-481e-8a25-85e46bb4cab3 None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:53.534996 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447fb92-33ab-481e-8a25-85e46bb4cab3 None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:53.535200 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447fb92-33ab-481e-8a25-85e46bb4cab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:53.559765 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-8447fb92-33ab-481e-8a25-85e46bb4cab3 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:14:53.560971 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8447fb92-33ab-481e-8a25-85e46bb4cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:53.636553 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1385/2786] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:14:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:14:53.647517 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:53.648890 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:53.717349 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba214ac-214a-4a32-abc7-3d78bbe8a551 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:53.720836 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212b6af-c4d6-4e35-a7e1-d73a9d1f5132 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=sRKPNgfRRFOvEIc7XXpzkA, audit_chain_id=['sRKPNgfRRFOvEIc7XXpzkA']) at 0x7fe09e14a940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:53.721427 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212b6af-c4d6-4e35-a7e1-d73a9d1f5132 service neutron] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:53.721714 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212b6af-c4d6-4e35-a7e1-d73a9d1f5132 service neutron] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:53.721994 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212b6af-c4d6-4e35-a7e1-d73a9d1f5132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:53.732344 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212b6af-c4d6-4e35-a7e1-d73a9d1f5132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:53.733835 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212b6af-c4d6-4e35-a7e1-d73a9d1f5132 service neutron] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:53.744100 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1402/2787] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:14:53 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:14:54.255382 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447fb92-33ab-481e-8a25-85e46bb4cab3 None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:54.257804 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-8447fb92-33ab-481e-8a25-85e46bb4cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:54.270160 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447fb92-33ab-481e-8a25-85e46bb4cab3 None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:54.275302 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Hb2IY3lJTyKVzAuwHFtDDw, audit_chain_id=['Hb2IY3lJTyKVzAuwHFtDDw']) at 0x7fe09e887070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:54.276095 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:54.276404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:54.276683 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] PATH_INFO: `/v3/projects/5f8e0d9e77334ed8ab326af2728e6c3d` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:54.277837 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8e0d9e77334ed8ab326af2728e6c3d)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:54.279783 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:54.396134 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8e0d9e77334ed8ab326af2728e6c3d', 'request_id': 'req-f06838b5-5d9c-4e82-a729-b0cf577cfad6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:54.407776 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8e0d9e77334ed8ab326af2728e6c3d', 'request_id': 'req-f06838b5-5d9c-4e82-a729-b0cf577cfad6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:54.498341 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8e0d9e77334ed8ab326af2728e6c3d', 'request_id': 'req-f06838b5-5d9c-4e82-a729-b0cf577cfad6'} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:54.509897 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] The token cache is being invalidate because project 5f8e0d9e77334ed8ab326af2728e6c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=67131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:14:54.510187 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:54.510823 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.notifications [None req-f06838b5-5d9c-4e82-a729-b0cf577cfad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=67131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:14:54.512740 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1386/2788] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 19:14:54 2022] DELETE /identity/v3/projects/5f8e0d9e77334ed8ab326af2728e6c3d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:14:54.518405 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3aae-a31c-42cd-85df-68058dc00726 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:54.518908 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3aae-a31c-42cd-85df-68058dc00726 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:54.519017 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3aae-a31c-42cd-85df-68058dc00726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:54.543702 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-2e6d3aae-a31c-42cd-85df-68058dc00726 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:14:54.544842 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-2e6d3aae-a31c-42cd-85df-68058dc00726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:54.609642 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1403/2789] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:14:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:14:54.619041 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16960-d010-45c4-aeed-6dddd59507ef None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:54.619627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16960-d010-45c4-aeed-6dddd59507ef None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:54.619627 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16960-d010-45c4-aeed-6dddd59507ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:54.645967 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-39f16960-d010-45c4-aeed-6dddd59507ef None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:14:54.648424 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-39f16960-d010-45c4-aeed-6dddd59507ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:54.656087 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1387/2790] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:14:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:14:54.661090 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d3aae-a31c-42cd-85df-68058dc00726 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:54.671613 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d3aae-a31c-42cd-85df-68058dc00726 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:54.675912 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aa1da-f90d-4b6b-ab94-6d504b64308e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09eb27fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:54.676505 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aa1da-f90d-4b6b-ab94-6d504b64308e admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:54.676792 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aa1da-f90d-4b6b-ab94-6d504b64308e admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:54.677072 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aa1da-f90d-4b6b-ab94-6d504b64308e admin admin] PATH_INFO: `/v3/domains` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:54.677855 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5aa1da-f90d-4b6b-ab94-6d504b64308e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=67132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 19:14:54.678152 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5aa1da-f90d-4b6b-ab94-6d504b64308e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:54.679793 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5aa1da-f90d-4b6b-ab94-6d504b64308e admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:54.692692 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1404/2791] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 19:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 19:14:54.697413 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16960-d010-45c4-aeed-6dddd59507ef None None] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:54.706581 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16960-d010-45c4-aeed-6dddd59507ef None None] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:54.712273 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27720511-65f3-4535-bb36-a936579a89c9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09e518d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:54.712873 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27720511-65f3-4535-bb36-a936579a89c9 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:54.713162 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27720511-65f3-4535-bb36-a936579a89c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:54.713446 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27720511-65f3-4535-bb36-a936579a89c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:54.714133 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27720511-65f3-4535-bb36-a936579a89c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:54.716083 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27720511-65f3-4535-bb36-a936579a89c9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:54.814645 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1388/2792] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:14:54 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:14:54.820270 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aa1da-f90d-4b6b-ab94-6d504b64308e admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:54.839434 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aa1da-f90d-4b6b-ab94-6d504b64308e admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:54.907839 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f52dd-6041-4a9b-8e85-69d0e812f0cf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09def9070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:54.908365 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f52dd-6041-4a9b-8e85-69d0e812f0cf admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:54.908662 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f52dd-6041-4a9b-8e85-69d0e812f0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:54.908949 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f52dd-6041-4a9b-8e85-69d0e812f0cf admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:54.909589 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f52dd-6041-4a9b-8e85-69d0e812f0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:54.911607 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f52dd-6041-4a9b-8e85-69d0e812f0cf admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:55.064363 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1405/2793] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:14:54 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:14:55.069404 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27720511-65f3-4535-bb36-a936579a89c9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:55.080090 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27720511-65f3-4535-bb36-a936579a89c9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:55.085326 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1444-10b6-4fa1-aa16-3e62b2a3b8f9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09e3bfd00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:55.085937 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1444-10b6-4fa1-aa16-3e62b2a3b8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:55.086226 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1444-10b6-4fa1-aa16-3e62b2a3b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:55.086510 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1444-10b6-4fa1-aa16-3e62b2a3b8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:55.087304 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be1444-10b6-4fa1-aa16-3e62b2a3b8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:55.088904 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be1444-10b6-4fa1-aa16-3e62b2a3b8f9 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:55.099644 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1389/2794] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:14:55.103993 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f52dd-6041-4a9b-8e85-69d0e812f0cf admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:55.113739 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f52dd-6041-4a9b-8e85-69d0e812f0cf admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:55.118229 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b01589-d40c-4f54-b80d-a1edd814ea86 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09dd906a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:55.118832 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b01589-d40c-4f54-b80d-a1edd814ea86 admin admin] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:55.119144 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b01589-d40c-4f54-b80d-a1edd814ea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:55.119428 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b01589-d40c-4f54-b80d-a1edd814ea86 admin admin] PATH_INFO: `/v3/roles` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:55.120119 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b01589-d40c-4f54-b80d-a1edd814ea86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:55.121690 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b01589-d40c-4f54-b80d-a1edd814ea86 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:55.133146 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1406/2795] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:14:55.137571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1444-10b6-4fa1-aa16-3e62b2a3b8f9 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:55.147694 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1444-10b6-4fa1-aa16-3e62b2a3b8f9 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:55.152935 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f126b-4ccd-42a6-aa6b-93310e7c3db7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09e3e0b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:55.153756 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f126b-4ccd-42a6-aa6b-93310e7c3db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:55.154042 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f126b-4ccd-42a6-aa6b-93310e7c3db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:55.154323 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f126b-4ccd-42a6-aa6b-93310e7c3db7 admin admin] PATH_INFO: `/v3/projects/f298627f53d14c5d92595dd3a87578d4/users/bc3aec60992f441d8f8370f3beafe080/roles/ddd473dfc0884753855419d1711fd868` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:55.174044 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f126b-4ccd-42a6-aa6b-93310e7c3db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f298627f53d14c5d92595dd3a87578d4, user_id=bc3aec60992f441d8f8370f3beafe080, role_id=ddd473dfc0884753855419d1711fd868)` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:55.176692 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f126b-4ccd-42a6-aa6b-93310e7c3db7 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:55.247708 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1390/2796] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:14:55 2022] PUT /identity/v3/projects/f298627f53d14c5d92595dd3a87578d4/users/bc3aec60992f441d8f8370f3beafe080/roles/ddd473dfc0884753855419d1711fd868 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:14:55.252781 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71aba7-16d6-4c92-a678-9ab682e3e943 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:55.253077 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71aba7-16d6-4c92-a678-9ab682e3e943 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:55.253360 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71aba7-16d6-4c92-a678-9ab682e3e943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:55.277277 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-be71aba7-16d6-4c92-a678-9ab682e3e943 None None] MFA Rules not processed for user `6ab015dd8bfa4c7bab33bb2ae75070c3`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:14:55.278440 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-be71aba7-16d6-4c92-a678-9ab682e3e943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:55.344854 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1407/2797] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:14:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:14:55.355854 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f126b-4ccd-42a6-aa6b-93310e7c3db7 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:14:55.357843 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-e56f126b-4ccd-42a6-aa6b-93310e7c3db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:14:55.424177 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f126b-4ccd-42a6-aa6b-93310e7c3db7 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:14:55.428170 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640ef5-73d3-4811-a558-79e48ab737c8 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=EkROZ7E8R12zAfhq1T8MYw, audit_chain_id=['EkROZ7E8R12zAfhq1T8MYw']) at 0x7fe09e8a0670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a9c92fb5144e3dacc922eede1131fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:14:55.428921 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640ef5-73d3-4811-a558-79e48ab737c8 service neutron] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:14:55.429224 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640ef5-73d3-4811-a558-79e48ab737c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:14:55.429498 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640ef5-73d3-4811-a558-79e48ab737c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:14:55.438711 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3640ef5-73d3-4811-a558-79e48ab737c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:14:55.440204 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3640ef5-73d3-4811-a558-79e48ab737c8 service neutron] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:14:55.450241 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1391/2798] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:14:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:15:02.635145 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0a52-0783-46a7-bb66-14b6984e3f11 None None] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:15:02.635611 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0a52-0783-46a7-bb66-14b6984e3f11 None None] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:15:02.635730 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0a52-0783-46a7-bb66-14b6984e3f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:15:02.673496 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.auth.core [None req-723e0a52-0783-46a7-bb66-14b6984e3f11 None None] MFA Rules not processed for user `bc3aec60992f441d8f8370f3beafe080`. Rule list: `[]` (Enabled: `True`). {{(pid=67132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:15:02.674818 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-723e0a52-0783-46a7-bb66-14b6984e3f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:15:02.754981 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1408/2799] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:15:02 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:15:02.760066 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640ef5-73d3-4811-a558-79e48ab737c8 service neutron] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:15:02.771282 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640ef5-73d3-4811-a558-79e48ab737c8 service neutron] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:15:02.776751 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d6ced-5b04-48ad-80ce-55cf33bf2199 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09e3ed040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:15:02.779299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6ced-5b04-48ad-80ce-55cf33bf2199 admin admin] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:15:02.779299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6ced-5b04-48ad-80ce-55cf33bf2199 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:15:02.779299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6ced-5b04-48ad-80ce-55cf33bf2199 admin admin] PATH_INFO: `/v3/projects` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:15:02.779299 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d6ced-5b04-48ad-80ce-55cf33bf2199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:15:02.780571 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d6ced-5b04-48ad-80ce-55cf33bf2199 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:15:02.863526 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1392/2800] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 19:15:02 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:15:02.868545 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e0a52-0783-46a7-bb66-14b6984e3f11 None None] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:15:02.878779 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e0a52-0783-46a7-bb66-14b6984e3f11 None None] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:15:02.941448 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f1185-b6ec-4a78-b881-a5af81dfdadd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09e194250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:15:02.942221 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f1185-b6ec-4a78-b881-a5af81dfdadd admin admin] REQUEST_METHOD: `POST` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:15:02.942541 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f1185-b6ec-4a78-b881-a5af81dfdadd admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:15:02.942818 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f1185-b6ec-4a78-b881-a5af81dfdadd admin admin] PATH_INFO: `/v3/users` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:15:02.944225 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f1185-b6ec-4a78-b881-a5af81dfdadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:15:02.946267 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f1185-b6ec-4a78-b881-a5af81dfdadd admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:15:03.039442 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1409/2801] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 19:15:02 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 19:15:03.043746 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d6ced-5b04-48ad-80ce-55cf33bf2199 admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:15:03.054880 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d6ced-5b04-48ad-80ce-55cf33bf2199 admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:15:03.059464 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc441f2-e384-46bc-9423-7ccbc3acb94e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09e3bf2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:15:03.060072 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc441f2-e384-46bc-9423-7ccbc3acb94e admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:15:03.060362 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc441f2-e384-46bc-9423-7ccbc3acb94e admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:15:03.060658 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc441f2-e384-46bc-9423-7ccbc3acb94e admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:15:03.061374 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc441f2-e384-46bc-9423-7ccbc3acb94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:15:03.062953 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc441f2-e384-46bc-9423-7ccbc3acb94e admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:15:03.074365 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1393/2802] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:15:03.078568 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f1185-b6ec-4a78-b881-a5af81dfdadd admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:15:03.088348 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f1185-b6ec-4a78-b881-a5af81dfdadd admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:15:03.092634 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d1598-bbbd-4843-94b6-b30771362f28 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09ea13b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:15:03.093444 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1598-bbbd-4843-94b6-b30771362f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:15:03.093729 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1598-bbbd-4843-94b6-b30771362f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:15:03.094006 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1598-bbbd-4843-94b6-b30771362f28 admin admin] PATH_INFO: `/v3/projects/ab629e8ccc5541d1af382bbd5024b112/users/56feb633d64d43938d82e0a692438cad/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:15:03.112892 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d1598-bbbd-4843-94b6-b30771362f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab629e8ccc5541d1af382bbd5024b112, user_id=56feb633d64d43938d82e0a692438cad, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:15:03.116155 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d1598-bbbd-4843-94b6-b30771362f28 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:15:03.227686 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1410/2803] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:15:03 2022] PUT /identity/v3/projects/ab629e8ccc5541d1af382bbd5024b112/users/56feb633d64d43938d82e0a692438cad/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:15:03.231910 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc441f2-e384-46bc-9423-7ccbc3acb94e admin admin] Authenticating user token {{(pid=67131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:15:03.241659 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc441f2-e384-46bc-9423-7ccbc3acb94e admin admin] Validating token access rules against request {{(pid=67131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:15:03.307768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec90f2-c362-4059-aa18-8de3fdcabd67 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09df26f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:15:03.308384 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec90f2-c362-4059-aa18-8de3fdcabd67 admin admin] REQUEST_METHOD: `GET` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:15:03.308677 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec90f2-c362-4059-aa18-8de3fdcabd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:15:03.308960 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec90f2-c362-4059-aa18-8de3fdcabd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:15:03.309655 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec90f2-c362-4059-aa18-8de3fdcabd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:15:03.311288 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec90f2-c362-4059-aa18-8de3fdcabd67 admin admin] RBAC: Authorization granted {{(pid=67131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:15:03.322032 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1394/2804] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 19:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 19:15:03.325940 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d1598-bbbd-4843-94b6-b30771362f28 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:15:03.336633 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d1598-bbbd-4843-94b6-b30771362f28 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:15:03.341263 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017a5a5-aba5-47af-b193-eb2e5ea459e7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pJ5jgEhgQYW0dE_shCzCGA, audit_chain_id=['pJ5jgEhgQYW0dE_shCzCGA']) at 0x7fe09dde0760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ab015dd8bfa4c7bab33bb2ae75070c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d9ce9af82b4fd68fac993b9e9f37e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:15:03.342082 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a5a5-aba5-47af-b193-eb2e5ea459e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:15:03.342372 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a5a5-aba5-47af-b193-eb2e5ea459e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:15:03.342658 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017a5a5-aba5-47af-b193-eb2e5ea459e7 admin admin] PATH_INFO: `/v3/projects/ab629e8ccc5541d1af382bbd5024b112/users/56feb633d64d43938d82e0a692438cad/roles/bf363c82fad34c8c9be7cee42a8f474c` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:15:03.344480 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017a5a5-aba5-47af-b193-eb2e5ea459e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab629e8ccc5541d1af382bbd5024b112, user_id=56feb633d64d43938d82e0a692438cad, role_id=bf363c82fad34c8c9be7cee42a8f474c)` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:15:03.347076 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017a5a5-aba5-47af-b193-eb2e5ea459e7 admin admin] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:15:03.358404 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1411/2805] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 19:15:03 2022] PUT /identity/v3/projects/ab629e8ccc5541d1af382bbd5024b112/users/56feb633d64d43938d82e0a692438cad/roles/bf363c82fad34c8c9be7cee42a8f474c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:15:10.769506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc59b-93c2-4c3f-953f-5d09ff40a9ad None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:15:10.770008 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc59b-93c2-4c3f-953f-5d09ff40a9ad None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:15:10.770125 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc59b-93c2-4c3f-953f-5d09ff40a9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:15:10.820094 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-132dc59b-93c2-4c3f-953f-5d09ff40a9ad None None] MFA Rules not processed for user `56feb633d64d43938d82e0a692438cad`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:15:10.820768 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-132dc59b-93c2-4c3f-953f-5d09ff40a9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:15:10.904521 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1395/2806] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 19:15:10 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:15:10.916079 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017a5a5-aba5-47af-b193-eb2e5ea459e7 admin admin] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:15:10.919804 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-c017a5a5-aba5-47af-b193-eb2e5ea459e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:15:11.000230 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017a5a5-aba5-47af-b193-eb2e5ea459e7 admin admin] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:15:11.020617 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac822d9-903d-428e-b5e3-801297cfd946 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=TvFjqSIbTa275Kqoum5bnA, audit_chain_id=['TvFjqSIbTa275Kqoum5bnA']) at 0x7fe09de0c280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e956656659004428b3aaf23ae962f001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65bccb1addf41ecb44dfe73b3d94bea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=67132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:15:11.021975 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac822d9-903d-428e-b5e3-801297cfd946 service glance] REQUEST_METHOD: `GET` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:15:11.022408 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac822d9-903d-428e-b5e3-801297cfd946 service glance] SCRIPT_NAME: `/identity` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:15:11.022799 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac822d9-903d-428e-b5e3-801297cfd946 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=67132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:15:11.088874 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac822d9-903d-428e-b5e3-801297cfd946 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:15:11.090307 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac822d9-903d-428e-b5e3-801297cfd946 service glance] RBAC: Authorization granted {{(pid=67132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 19:15:11.098800 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: [pid: 67132|app: 0|req: 1412/2807] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 19:15:10 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 19:15:11.379506 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8e15c-2198-4b2a-a6d1-030bb533da0a None None] REQUEST_METHOD: `POST` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:15:11.379809 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8e15c-2198-4b2a-a6d1-030bb533da0a None None] SCRIPT_NAME: `/identity` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:15:11.380126 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8e15c-2198-4b2a-a6d1-030bb533da0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=67131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:15:11.450270 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.auth.core [None req-9db8e15c-2198-4b2a-a6d1-030bb533da0a None None] MFA Rules not processed for user `94bc9c43b3bc4eb4bcd1d0c997340376`. Rule list: `[]` (Enabled: `True`). {{(pid=67131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 19:15:11.451486 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: DEBUG keystone.common.fernet_utils [None req-9db8e15c-2198-4b2a-a6d1-030bb533da0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:15:11.529735 dv-cinder-831187-1-iscsi devstack@keystone.service[67131]: [pid: 67131|app: 0|req: 1396/2808] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 19:15:11 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 19:15:11.684356 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac822d9-903d-428e-b5e3-801297cfd946 service glance] Authenticating user token {{(pid=67132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:15:11.685705 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.common.fernet_utils [None req-cac822d9-903d-428e-b5e3-801297cfd946 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=67132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:15:11.795477 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac822d9-903d-428e-b5e3-801297cfd946 service glance] Validating token access rules against request {{(pid=67132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:15:11.800506 dv-cinder-831187-1-iscsi devstack@keystone.service[67132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712769ce-1813-4fff-a8d3-dc56f57a1a48 service swift] RBAC: auth_context: {'token': <